Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preprocessor should test topic to ensure enough partitions exist #618

Open
bryanlb opened this issue Jul 24, 2023 · 0 comments
Open

Preprocessor should test topic to ensure enough partitions exist #618

bryanlb opened this issue Jul 24, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@bryanlb
Copy link
Contributor

bryanlb commented Jul 24, 2023

Description

Today if you attempt to connect a preprocessor to a kafka topic, and configure it to more output partitions than exist on the kafka topic it is difficult to detect. This ends up throwing a significant amount of confusing messages as it still attempts to register a stream application with an invalid config.

The preprocessor should test the validity of a dataset config (possibly using admin client) and alert the user if it detects something that cannot be satisfied.

@bryanlb bryanlb added the enhancement New feature or request label Jul 24, 2023
@github-actions github-actions bot added the Stale label Mar 8, 2024
@bryanlb bryanlb removed the Stale label Mar 8, 2024
@github-actions github-actions bot added the Stale label Sep 5, 2024
@slackhq slackhq deleted a comment from github-actions bot Sep 5, 2024
@slackhq slackhq deleted a comment from github-actions bot Sep 5, 2024
@bryanlb bryanlb removed the Stale label Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant