Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: feldera/feldera
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: feldera/feldera
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: crucible
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 7 commits
  • 11 files changed
  • 1 contributor

Commits on Jul 3, 2026

  1. feat(sqllib): pin now() via FELDERA_NOW_OVERRIDE_MS for deterministic… 

    … testing

now() honors the FELDERA_NOW_OVERRIDE_MS env var (milliseconds since the Unix epoch, read once into a LazyLock) and returns that fixed instant instead of the wall clock, so a harvest or test gets a reproducible now(). Factored into now_from(Option<i64>) so the override path is unit-tested without env-var flakiness.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    bfad4d3 View commit details
    Browse the repository at this point in the history

  2. feat(sql-compiler): expression oracle harvest backend 

    ExpressionOracleHarvest extracts each operator closure from a compiled circuit and emits it as an {ir, inputs, outputs} record: the ground-truth corpus the forge circuit-expr interpreter is validated against. BaseSQLTests wires it into the test path.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    4e44f24 View commit details
    Browse the repository at this point in the history

  3. wip(pipeline-manager): run the crucible engine 

    Compile and launch the crucible single-binary engine from the pipeline manager: the rust compiler and local runner build and run the crucible binary, with the program and SQL-compiler plumbing carrying the engine selection.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    0587c76 View commit details
    Browse the repository at this point in the history

  4. feat(slt): wire the expression-oracle harvest into the slt executor 

    DBSPExecutor.maybeHarvest after the per-query circuit is built, so the sqllogictest suite contributes to the expression-oracle corpus when FELDERA_EXPR_ORACLE_DIR is set (gated; a normal slt run is unaffected).

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    73231a4 View commit details
    Browse the repository at this point in the history

  5. feat(expr-oracle): record generating SQL on harvested closures 

    Each harvest record gains a generating_sql array: the view query the closure feeds, found by walking upstream from every sink. On a dedup collision (an identical closure from a different query) the SQL set is merged, so re-harvesting accumulates provenance instead of overwriting it. Lets a corpus case be traced back to the SQL that produced it.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    f7996d2 View commit details
    Browse the repository at this point in the history

  6. feat(expr-oracle): harvest array closures and python suite SQL 

    isSupportedLeaf admits Array<element> when the element is itself a supported leaf,
so array-of-scalar (and nested-array) closures harvest instead of being skipped.

PythonCorpusHarvest compiles the SQL extracted from feldera's python test suites
(driven by PYTHON_CORPUS_SQL_DIR) so the oracle harvest hook records their closures;
it is skipped when that variable is unset, so a normal mvn test is unaffected.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    afd97d9 View commit details
    Browse the repository at this point in the history

  7. feat(slt): parallel parse-only harvesting for the expression oracle 

    Gate three changes on FELDERA_EXPR_ORACLE_DIR so a normal SLT run is
unchanged. When harvesting: skip a query whose compile fails instead of
aborting the 500-query batch, and in parse-only mode (-n) skip writing
the generated Rust and copying the temp Cargo.lock the harness never
compiles. Together these let the expression-oracle harvest run the whole
sqllogictest suite across many shard JVMs that share a working directory
without racing on the discarded temp files.

Signed-off-by: Gerd Zellweger <mail@gerdzellweger.com>
    @gz
    gz committed Jul 3, 2026
    Configuration menu
    Copy the full SHA
    8fe7009 View commit details
    Browse the repository at this point in the history
Loading