Tags: flak153/feldera
Tags
[adapters]: parallel delta output encoder Use SplitCursor to split the batch and distribute it across tasks, each task retries encoding and writing to delta lake and then returns Add actions which main task retries to commit to delta lake Signed-off-by: Swanand Mulay <73115739+swanandx@users.noreply.github.com>
[dbsp] Fix recently introduced bug in pairs seralizer. Commit 99cbbbc ("[dbsp] Optimize how we cache rkyv serialization data structures.") dropped the code that adds offsets to the offsets array in PairsSerializer. This broke multihost pipelines. This fixes the problem. Thanks to Swanand Mulay for reporting the issue. Signed-off-by: Ben Pfaff <blp@feldera.com>
build: quiet on warnings In docker builds we often execute build scripts without a proper .git folder present. In this case the vergen Emitter emits a warning through cargo. This is confusing for users. This make sure the warning disappears. Our code already handles the cases where these env variables are not set. Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
Generate unique topic names and lazy-initialize Kafka/Schema Registry… … connections - Replace run-id based topic names by unique UUID based topic names to avoid collisions across test runs - Lazy-initialize Kafka and Schema registry connections to prevent import-time network calls Signed-off-by: rivudhk <rivudhkr@gmail.com>
PreviousNext