Skip to content

[DOCS] Document buffer_size_records connector option#6542

Merged
mihaibudiu merged 1 commit into
feldera:mainfrom
mihaibudiu:issue5035
Jun 27, 2026
Merged

[DOCS] Document buffer_size_records connector option#6542
mihaibudiu merged 1 commit into
feldera:mainfrom
mihaibudiu:issue5035

Conversation

@mihaibudiu

Copy link
Copy Markdown
Contributor

Fixes #5035

Checklist

  • Documentation updated

Signed-off-by: Mihai Budiu <mbudiu@feldera.com>
@mihaibudiu mihaibudiu enabled auto-merge June 25, 2026 22:29
@mihaibudiu mihaibudiu requested a review from lalithsuresh June 25, 2026 22:29

@mythical-fred mythical-fred left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Defaults match: csv/json buffer_size_records defaults to 10000, parquet to 100000 — all three doc additions are accurate.

@mihaibudiu mihaibudiu added this pull request to the merge queue Jun 26, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jun 26, 2026
- `"fields"` — strip leading and trailing ASCII whitespace from every field value.
- `"headers"` — strip whitespace from header names only (effective only when `headers` is `true`).
- `"all"` — strip whitespace from both field values and header names.
- `buffer_size_records`: Maximum number of records to batch into a single output message (output connectors only). When this threshold is reached, the encoder flushes the buffer to the transport. The default is `10000`.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need to say encoder or transport here? I don't think they are user-facing concepts. Same comment elsewhere.

@mihaibudiu mihaibudiu added this pull request to the merge queue Jun 27, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jun 27, 2026
@mihaibudiu mihaibudiu added this pull request to the merge queue Jun 27, 2026
Merged via the queue into feldera:main with commit 89a9918 Jun 27, 2026
1 check passed
@mihaibudiu mihaibudiu deleted the issue5035 branch June 27, 2026 03:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DOCS] Document the connector option buffer_size_records

4 participants