Skip to content

adapters: use dataframes instead of sql strings#6245

Merged
gz merged 1 commit into
mainfrom
sql-to-dataframes
May 15, 2026
Merged

adapters: use dataframes instead of sql strings#6245
gz merged 1 commit into
mainfrom
sql-to-dataframes

Conversation

@gz

@gz gz commented May 15, 2026

Copy link
Copy Markdown
Contributor

This was prompted by some invalid SQL injection reporter.

While nothing here exposed a real "sql injection" (because there is no point where an untrusted source can write a connector config), it still seemed more ergonomic to transform this into the data-frame API when looking at it.
I think it also enhances error reporting in some cases. The PR adds a few more tests.

Checklist

  • Unit tests added/updated

Breaking Changes?

Ideally none.

This was prompted by an errornous SQL injection report.

While those arent really security vulnerabilities here
because there is no point where this can get injected by
an untrusted source, it still seemed more ergonomic
to transform this into data-frame API calls when looking
at it.

I think it also enhances error reporting in some cases.
Adds a few more tests.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
@gz
gz requested a review from swanandx May 15, 2026 07:49

@swanandx swanandx left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work! 🚀

@gz
gz added this pull request to the merge queue May 15, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks May 15, 2026
@gz
gz added this pull request to the merge queue May 15, 2026

@mythical-fred mythical-fred left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Merged via the queue into main with commit da2149b May 15, 2026
1 check passed
@gz
gz deleted the sql-to-dataframes branch May 15, 2026 19:27
@gz gz mentioned this pull request May 29, 2026
2 tasks
gz added a commit that referenced this pull request May 29, 2026
PR #6245 caused a regression for `cdc_order_by` which prevented
parsing of order by clauses with multiple fields.
That was because we didn't use the right DF function to parse it.

This corrects the mistakes and adds a series of tests.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
mihaibudiu pushed a commit to mihaibudiu/dbsp that referenced this pull request May 29, 2026
PR feldera#6245 caused a regression for `cdc_order_by` which prevented
parsing of order by clauses with multiple fields.
That was because we didn't use the right DF function to parse it.

This corrects the mistakes and adds a series of tests.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants