Skip to content

[dbsp Implement From<NonZeroUsize> for CircuitConfig#5961

Merged
gz merged 1 commit intofeldera:mainfrom
lstwn:main
Apr 1, 2026
Merged

[dbsp Implement From<NonZeroUsize> for CircuitConfig#5961
gz merged 1 commit intofeldera:mainfrom
lstwn:main

Conversation

@lstwn
Copy link
Copy Markdown
Contributor

@lstwn lstwn commented Mar 31, 2026

Describe Manual Test Plan

Tiny quality of life change. Recompiled, works.

Checklist

  • Unit tests added/updated
  • Integration tests added/updated
  • Documentation updated
  • Changelog updated

Breaking Changes?

Mark if you think the answer is yes for any of these components:

Describe Incompatible Changes

@blp
Copy link
Copy Markdown
Member

blp commented Mar 31, 2026

Seems harmless but a little unusual. Do you have a project that would use this?

Copy link
Copy Markdown

@mythical-fred mythical-fred left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@gz
Copy link
Copy Markdown
Contributor

gz commented Apr 1, 2026

Thank you for your contribution. I'm also curious (if you can share) what you're using feldera for?

@gz gz added this pull request to the merge queue Apr 1, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 1, 2026
@gz gz added this pull request to the merge queue Apr 1, 2026
Merged via the queue into feldera:main with commit c1ad4cb Apr 1, 2026
1 check passed
@lstwn
Copy link
Copy Markdown
Contributor Author

lstwn commented Apr 3, 2026

Hello! I'm using DBSP as an incremental computation backend for a Datalog language I've built to experiment with running CRDTs (convergent replicated data types) on.

@blp
Copy link
Copy Markdown
Member

blp commented Apr 3, 2026

Hello! I'm using DBSP as an incremental computation backend for a Datalog language I've built to experiment with running CRDTs (convergent replicated data types) on.

That's awesome. I assume you know about Differential Datalog?

@lstwn
Copy link
Copy Markdown
Contributor Author

lstwn commented Apr 4, 2026

Yes, I've encountered it while researching approaches in the beginning. If I'm not mistaken, it has a compilation step (using rustc), right?

I ended up writing my own interpreter-based approach because:

  1. I wanted to "own" my tech stack, at least down to the computation backend. Admittedly, DBSP's internals are still mostly a black box to me.
  2. For the environments I'm interested in, I don't want to bundle a full compiler.
  3. I'm also interested in comparing different incremental computation approaches, that is, differential dataflow and DBSP (do you know about other similarly capable systems?). Although I'm not quite there yet, I want to implement a differential dataflow backend, compare runtimes and understand differences (or limitations) in their expressive power. Until today, I haven't found a definitive analysis on what exactly sets the two apart in terms of their expressive power, underlying time assumptions, and performance.
  4. Also I want to understand the gap between incremental and non-incremental approaches for CRDT use cases (frequent and small updates to a view defining the state of the CRDT). For that I plan to wire up a DuckDB backend to my Datolog language to also have a representative of a non-incremental query engine.

@blp
Copy link
Copy Markdown
Member

blp commented Apr 4, 2026

Yes, I've encountered it while researching approaches in the beginning. If I'm not mistaken, it has a compilation step (using rustc), right?

Yes.

...

  1. I'm also interested in comparing different incremental computation approaches, that is, differential dataflow and DBSP (do you know about other similarly capable systems?).

There are, at least, Python and Java implementations of the DBSP approach. I am not sure whether they are production systems or just demos or toys.

It sounds like you've got some fun goals. Good luck!

@mihaibudiu
Copy link
Copy Markdown
Contributor

Clearly, there's also Materialize.com, which is on top of differential dataflow, but you probably know that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants