Skip to content

[connectors] Clock connector picks up clock resolution changes.#6001

Open
ryzhyk wants to merge 3 commits intomainfrom
clock_resolution_change
Open

[connectors] Clock connector picks up clock resolution changes.#6001
ryzhyk wants to merge 3 commits intomainfrom
clock_resolution_change

Conversation

@ryzhyk
Copy link
Copy Markdown
Contributor

@ryzhyk ryzhyk commented Apr 7, 2026

This fixes the following scenario:

  • Start a pipeline with a clock connector.
  • Checkpoint and stop the pipeline
  • Change clock resolution in pipeline config.
  • Restart the pipeline.

The clock connector is initialized from the checkpoint, which contains connector config with the previous clock resolution value, instead of picking up the new config.

The fix is to ignore the checkpointed connector and create a fresh connector instead.

ryzhyk added 2 commits April 6, 2026 17:47
Enhance the `now` connector test to stop the pipeline,
reconfigure clock resolution and restart the pipeline.
This checks that the connector is correctly recreated
after the restart. We don't have an easy way that the
connector comes up with the updated config -- we currently
don't expose that via the API.

Signed-off-by: Leonid Ryzhyk <ryzhyk@gmail.com>
This fixes the following scenario:
- Start a pipeline with a clock connector.
- Checkpoint and stop the pipeline
- Change clock resolution in pipeline config.
- Restart the pipeline.

The clock connector is initialized from the checkpoint, which
contains connector config with the previous clock resolution value,
instead of picking up the new config.

The fix is to ignore the checkpointed connector and create
a fresh connctor instead.

Signed-off-by: Leonid Ryzhyk <ryzhyk@gmail.com>
@ryzhyk ryzhyk requested a review from blp April 7, 2026 01:07
@ryzhyk ryzhyk added the connectors Issues related to the adapters/connectors crate label Apr 7, 2026
Signed-off-by: feldera-bot <feldera-bot@feldera.com>
Copy link
Copy Markdown

@mythical-fred mythical-fred left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Member

@blp blp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems reasonable.

I checked that replays don't depend on the configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

connectors Issues related to the adapters/connectors crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants