When bootstrapping is triggered by a Feldera upgrade, the output of modified views doesn't change (these are the same views computed using a new query plan), except if the upgrade involves a bug fix. It is not helpful to dump the entire output of such views during bootstrapping. There needs to be a way to disable output connectors during bootstrapping in this scenario.
Today this behavior can be achieved by removing the connectors for the duration of bootstrapping, which is not ideal.
Not sure how general this feature needs to be, e.g., do we want a general way to disable/enable output connectors, similar to how we can pause/unpause inputs. A disabled connector would drop all outputs on the floor, while declaring them as completed for progress tracking purposes.
This feature might work well in tandem with #6042 , which allows dumping the entire view snapshot on-demand.
When bootstrapping is triggered by a Feldera upgrade, the output of modified views doesn't change (these are the same views computed using a new query plan), except if the upgrade involves a bug fix. It is not helpful to dump the entire output of such views during bootstrapping. There needs to be a way to disable output connectors during bootstrapping in this scenario.
Today this behavior can be achieved by removing the connectors for the duration of bootstrapping, which is not ideal.
Not sure how general this feature needs to be, e.g., do we want a general way to disable/enable output connectors, similar to how we can pause/unpause inputs. A disabled connector would drop all outputs on the floor, while declaring them as completed for progress tracking purposes.
This feature might work well in tandem with #6042 , which allows dumping the entire view snapshot on-demand.