Repository navigation
Releases: databendlabs/databend
Releases · databendlabs/databend
Release list
v1.2.960-nightly
What's Changed
Thoughtful Bug Fix 🔧
- fix(query): materialize outer input where correlated aliases are invalid by @SkyFan2002 in #20892
Code Refactor 🎉
- refactor(query): select if branches by mask word for all types by @SkyFan2002 in #20904
- refactor(query): avoid optimizer trace overhead when tracing is off by @SkyFan2002 in #20878
- refactor(query): bypass ineffective rank-limit pre-sort in partial aggregate by @SkyFan2002 in #20879
- refactor(cache): kind-based cache store; migrate all caches by @bohutang in #20899
Full Changelog: v1.2.959-nightly...v1.2.960-nightly
v1.2.959-nightly
What's Changed
Thoughtful Bug Fix 🔧
- fix(query): exact float-to-decimal casts and decimal quantile_cont by @forsaken628 in #20897
- fix(query): decode each segment once in row fetch by @b41sh in #20894
- fix(parser): avoid reparsing trailing function arguments by @KKould in #20912
Build/Testing/CI Infra Changes 🔌
Others 📒
Full Changelog: v1.2.958-nightly...v1.2.959-nightly
v1.2.958-nightly
What's Changed
Exciting New Features ✨
- feat(query): evaluate functions, grouping and aggregates on encoded dictionaries by @KKould in #20873
Thoughtful Bug Fix 🔧
- fix(query): block runtime filters across row-sensitive probe paths by @dantengsky in #20805
- fix(query): dedup in-flight cascades group tasks by @SkyFan2002 in #20883
- fix(query): keep hash shuffle sender running after its output finishes by @dqhl76 in #20893
Code Refactor 🎉
- refactor(query): optimize numeric if branch selection by @SkyFan2002 in #20881
Full Changelog: v1.2.957-nightly...v1.2.958-nightly
v1.2.957-nightly
What's Changed
Exciting New Features ✨
- feat(query): sandbox Python UDF workers and bound script UDF resources by @sundy-li in #20830
- feat(query): Vector Index support refine by @b41sh in #20832
- feat(query): fold runtime bloom filters to target fpp after build by @SkyFan2002 in #20869
Thoughtful Bug Fix 🔧
- fix(query): make prune cache key exact for floats and session settings by @SkyFan2002 in #20845
- fix(query): resolve qualified names as tables, not CTEs by @TCeason in #20695
- fix(storage): decode escaped custom TEXT delimiters by @youngsofun in #20844
- fix(query): restrict identity visibility and redact credentials by @TCeason in #20833
- fix(storage): report tolerated errors for ON_ERROR=ABORT_N by @youngsofun in #20849
- fix(query): parse non-integer text into int columns exactly by @youngsofun in #20851
- fix(query): make decimal arithmetic, casts and rounding exact by @forsaken628 in #20848
- fix(query): avoid nested nullable column in TRY_CAST(variant AS decimal) by @bohutang in #20861
- fix(query): preserve year-one timestamp boundaries and text round trips by @TCeason in #20853
- fix(formats): ignore input escape when quoting CSV output by @youngsofun in #20863
- fix(query): retain only exact NDV bounds after estimation by @dantengsky in #20798
- fix(query): reject spilling blocks without columns by @dqhl76 in #20855
- fix(query): own next-level hash join spill states by their parent level by @dqhl76 in #20857
- fix(query): bound hash shuffle memory independent of cluster size by @dqhl76 in #20778
Build/Testing/CI Infra Changes 🔌
- ci: strengthen session header HTTP tests by @youngsofun in #20858
- ci(fuse): test partition-key moves by mutation and ALTER PARTITION BY by @bohutang in #20866
Documentation 📔
- docs: meta: update compatibility tables through 1.2.956 by @drmingdrmer in #20852
Others 📒
- chore(deps): bump tokio from 1.52.3 to 1.54.1 by @dqhl76 in #20875
- chore(settings): disable enable_recluster_multiway_merge by default by @zhang2014 in #20882
Full Changelog: v1.2.956-nightly...v1.2.957-nightly
v1.2.956-nightly
What's Changed
Exciting New Features ✨
- feat(query): push FTS score TopK down to the inverted index collector by @bohutang in #20831
- feat(query): keep fuse scan columns encoded in memory by @KKould in #20819
- feat(query): check SELECT grants before ownership on table access by @bohutang in #20835
- feat(query): check SELECT grants before ownership on table access by @bohutang in #20842
- feat(query): support unmasked WHERE values for masking policies by @zhang2014 in #20818
Thoughtful Bug Fix 🔧
- fix(storage): skip replace bloom pruning without partitioning by @dantengsky in #20828
- fix(config): load OSS credentials from ALIBABA_CLOUD_* env aliases by @zhang2014 in #20841
Code Refactor 🎉
Others 📒
Full Changelog: v1.2.955-nightly...v1.2.956-nightly
v1.2.955-nightly
What's Changed
Exciting New Features ✨
- feat(storage): add database and external-table S3 storage classes by @dantengsky in #20689
- feat(query): manage remote UDF access with SQL integrations by @KKould in #20787
- feat(storage): detect S3 region via AWS_REGION regional endpoint by @dantengsky in #20815
- feat(query): add min_scale for decimals by @vbmithr in #20701
Thoughtful Bug Fix 🔧
- fix(expression): keep float DEFAULT values exact across SQL text by @forsaken628 in #20779
- fix(udf): isolate Python scalar scripts with bounded workers by @sundy-li in #20808
- fix(query): release queued acquire entry when future is dropped by @youngsofun in #20629
- fix(query): seed filter domains with boolean identities by @dantengsky in #20803
- fix(query): accelerate single-key hash shuffle by @dqhl76 in #20812
- fix(optimizer): avoid incorrect anti joins for expression keys by @dantengsky in #20804
- chore(optimizer): improve defensive checks and diagnostics by @dantengsky in #20806
- fix(storage): detect duplicated replace into keys before pruning by @dantengsky in #20799
Code Refactor 🎉
- refactor(query): unify stream consumption metadata requests by @zhyass in #20807
- refactor(query): optimize time_slice with constant slice arguments by @vbmithr in #20727
Build/Testing/CI Infra Changes 🔌
Others 📒
- chore(meta): reuse source-option read when validating MV source by @zhyass in #20822
- chore(build): generate the embedded meta-service code once by @sundy-li in #20814
Full Changelog: v1.2.954-nightly...v1.2.955-nightly
v1.2.954-nightly
What's Changed
Thoughtful Bug Fix 🔧
- fix(query): correct decimal text parsing and JSON precision by @youngsofun in #20788
- fix(query): reuse flight connections for distributed query setup by @dqhl76 in #20673
- fix(query): drop memory-heavy state when processors finish by @dqhl76 in #20716
- fix(query): keep constant NULL columns through exchange, spill and merge by @dqhl76 in #20777
Code Refactor 🎉
Full Changelog: v1.2.953-nightly...v1.2.954-nightly
v1.2.953-nightly
What's Changed
Exciting New Features ✨
- feat(query): Inverted Index support User dictionary by @b41sh in #20565
- feat(query): materialize row-level TTL via DELETE mutation by @zhyass in #20597
- feat(planner): multiply AND filter selectivities across columns by @forsaken628 in #20598
- feat(query): vacuum spill directories concurrently in VACUUM TEMPORARY FILES by @bohutang in #20647
- feat(rbac): require ATTACH TABLE privilege alongside CREATE by @TCeason in #20683
- feat(query): add send_notification for async delivery by @TCeason in #20656
- feat(query): support zero-copy table clone by @zhyass in #20454
Thoughtful Bug Fix 🔧
- fix(meta): skip undecodable table meta when collecting dropped tables by @SkyFan2002 in #20634
- fix(query): preserve LIKE operand order in filter selector by @sundy-li in #20642
- fix(query): exclude MV candidates from dynamic table sources by @sundy-li in #20557
- fix(query): keep empty groups of correlated scalar aggregate subqueries by @youngsofun in #20633
- fix(query): avoid window top-n truncating rows used by grouped windows by @dqhl76 in #20652
- fix(query): skip inactive rows in regexp functions by @KKould in #20654
- fix(meta): skip unreadable tables during listing by @TCeason in #20663
- fix(query): parse nested task MODIFY AS statements by @KKould in #20617
- fix(query): raise flight listener accept backlog by @dqhl76 in #20658
- fix(query): bound window partition restore memory by @dqhl76 in #20650
- fix(storage): advance stream offsets when no-op DML skips commit by @SkyFan2002 in #20671
- fix(query): isolate view name scope from outer CTEs by @TCeason in #20655
- fix(query): evaluate decimal modulo exactly instead of through Float64 by @vbmithr in #20693
- fix(query): stop datetime functions contending on the timezone LUT cache by @vbmithr in #20694
- fix(query): source query data metrics from per-query IoStats by @dantengsky in #20687
- fix(query): avoid column id overflow when reading virtual columns with
_row_idby @b41sh in #20664 - fix(storage): support Iceberg name mapping and file physical schema by @sundy-li in #20594
- fix(query): keep rows for the next OR child when LIKE input is constant NULL by @forsaken628 in #20696
- fix(storage): merge transaction statistics on commit retry by @zhyass in #20719
- fix(query): normalize inferred filter constraints by @KKould in #20668
- fix(storage): cache decoded vector indexes by @bohutang in #20744
- fix(query): clean up cancelled lock waits and FlightSQL statements by @zhyass in #20734
- fix(storage): only honor s3 storage class setting for external tables, mark it experimental by @dantengsky in #20721
- fix(query): preserve original pipeline errors before interruption by @SkyFan2002 in #20750
- fix(query): reclaim metadata of dropped tables with retired engines by @SkyFan2002 in #20797
- fix(version): remove nightly suffix from binary versions by @sundy-li in #20792
- fix(query): isolate stream batches from source table cache by @zhyass in #20796
Code Refactor 🎉
- refactor(query): simplify inverted index cache warmup by @b41sh in #20641
- refactor(storage): report scan progress before prewhere filtering by @dantengsky in #20666
- refactor: meta: make metactl RPC timeouts configurable by @drmingdrmer in #20706
- refactor(query): optimize day-level datetime functions when the UTC offset is fixed by @vbmithr in #20699
- refactor(query): defer aggregate splitting to physical planning by @forsaken628 in #20667
- refactor(storage): share adaptive concurrency and retry observation by @bohutang in #20729
- refactor(expression): fold range constraints in linear time by @KKould in #20653
Build/Testing/CI Infra Changes 🔌
- ci: build release binaries in two parallel groups by @bohutang in #20661
- ci(sqllogic): run http and hybrid handlers in one job instead of two by @bohutang in #20662
- chore(build): speed up release builds without touching hot-path codegen by @bohutang in #20657
- ci: post a CI timing comment on PRs after Dev and Cloud runs by @bohutang in #20665
- ci: support hold-ci label to pause heavy CI during review iteration by @bohutang in #20672
- ci: move mac_check from PR workflow to main by @bohutang in #20677
- ci: run stage sqllogic dedup/size variants inside one job per storage backend by @bohutang in #20681
- ci: resolve fork PRs in CI timing comment script by @bohutang in #20688
- ci: make CI timing comment tolerant of transient API errors by @bohutang in #20702
- ci: skip PR description and AI assistance checks on draft PRs by @bohutang in #20707
- ci: fix metachaos FUSE disconnects on statx by @bohutang in #20771
Others 📒
- chore: strengthen dropped-table vacuum regression tests by @dantengsky in #20649
- chore(storage): cover scan progress with an in-process integration test by @dantengsky in #20684
- chore(security): add SECURITY.md and OSS Scanner enrolment files by @bohutang in #20692
- chore: consolidate root linter and python configs into subdirs by @bohutang in #20698
- chore(security): slim the OSS Scanner image and threat model by @bohutang in #20697
- chore: make the top-level LICENSE the Apache-2.0 text by @bohutang in #20703
- chore: fix flaky vector-pruner test by @dantengsky in #20704
- chore(deps): bump rustls from 0.23.36 to 0.23.45 by @dependabot[bot] in #20648
- chore(build): cut clean debug build time by ~20% by @sundy-li in #20745
New Contributors
Full Changelog: v1.2.952-nightly...v1.2.953-nightly
v1.2.925-patch-15
v1.2.952-nightly
What's Changed
Exciting New Features ✨
- feat(storage): add horizontal recluster and inverted-index multiway merge by @zhang2014 in #20620
- feat(query): apply hash write layout to replace, insert all and merge by @KKould in #20602
- feat(storage): support DROP PARTITION KEY by @KKould in #20638
Thoughtful Bug Fix 🔧
- fix(query): avoid worker starvation during Python UDF initialization by @sundy-li in #20613
- fix(query): initialize hashes for singleton group keys by @sundy-li in #20616
- fix(query): preserve ordered aggregate keys in grouping sets by @sundy-li in #20614
- fix(query): avoid blocking query runtime in EXPLAIN pruning by @dqhl76 in #20618
- fix(query): keep empty groups of lateral scalar aggregates by @youngsofun in #20587
- fix(query): spill the final sort run under memory pressure by @dqhl76 in #20624
- fix(query): cache scalar number formats per batch by @KKould in #20622
- fix(query): prune single-use scalar CSE candidates by @KKould in #20623
- fix(query): reject context functions in persisted expressions by @sundy-li in #20595
- fix(query): remove static value-statistics TopN pruning by @SkyFan2002 in #20619
- fix(query): rank limit follows ORDER BY key order by @dqhl76 in #20643
- fix(fuse): increase append write parallelism after block preparation by @KKould in #20621
Code Refactor 🎉
- refactor(query): decouple logical optimization from physical planning by @forsaken628 in #20604
- refactor(fuse): compact recent segments without scanning full history by @zhyass in #20579
Full Changelog: v1.2.951-nightly...v1.2.952-nightly