Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 28, 2026

• Revert "[SPARK-55952][SPARK-55953][SQL] Add ResolveChangelogTable analyzer rule for batch CDC post-processing"

  Show description for fe6051a
  dongjoon-hyun

  committed
  fe6051a

  Copy full SHA for fe6051a

• [SPARK-56605][SQL] Wire resolution engine to use SQL PATH for table, function, and variable lookup

  Show description for d3bf353
  

  srielau

  authored and

  gengliangwang

  committed
  d3bf353

  Copy full SHA for d3bf353

• [SPARK-52729][SQL] Add MetadataOnlyTable and CREATE/ALTER VIEW support for DS v2 catalogs

  Show description for 697d021
  cloud-fan

  committed
  697d021

  Copy full SHA for 697d021

• [SPARK-55952][SPARK-55953][SQL] Add ResolveChangelogTable analyzer rule for batch CDC post-processing

  Show description for 881957a
  

  SanJSp

  and

  gengliangwang

  committed
  881957a

  Copy full SHA for 881957a

Commits on Apr 27, 2026

• [SPARK-55441][SQL] Types Framework - Phase 1c - Client Integration

  Show description for e75c162
  

  davidm-db

  authored and

  MaxGekk

  committed
  e75c162

  Copy full SHA for e75c162

• [SPARK-56616][SQL] Make `UnresolvedPipeAggregateOrdinal` extend `NamedExpression` directly

  Show description for 1224661
  

  mihailoale-db

  authored and

  cloud-fan

  committed
  1224661

  Copy full SHA for 1224661

• [SPARK-56030][SQL] Normalize inner Project when below Project -> Filter

  Show description for f94bb18
  

  mihailoale-db

  authored and

  cloud-fan

  committed
  f94bb18

  Copy full SHA for f94bb18

Commits on Apr 26, 2026

• [SPARK-56614][SQL][CONNECT] Add config for strict DataFrame column resolution

  Show description for fb3092a
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  fb3092a

  Copy full SHA for fb3092a

Commits on Apr 25, 2026

• [SPARK-56615][SQL] Clarify `KeyedPartitioning` `satisfies0()` and `nonGroupedSatisfies()`/`groupedSatisfies()` contract

  Show description for 9ca3919
  peter-toth

  committed
  9ca3919

  Copy full SHA for 9ca3919

Commits on Apr 24, 2026

• [SPARK-56570][SQL] `PlanMerger` correctness fix and code cleanup

  Show description for 174fc60
  

  peter-toth

  and

  cloud-fan

  committed
  174fc60

  Copy full SHA for 174fc60

Commits on Apr 23, 2026

• [SPARK-56520][SQL] Persist SQL PATH in views and SQL functions, expose in DESCRIBE

  Show description for 7d17224
  

  srielau

  authored and

  cloud-fan

  committed
  7d17224

  Copy full SHA for 7d17224

• [SPARK-39660][SQL] Support v2 DESCRIBE TABLE .. PARTITION

  Show description for 7dc8912
  viirya

  committed
  7dc8912

  Copy full SHA for 7dc8912

• [SPARK-55959][SQL][FOLLOWUP] Gate map-lookup hash optimization on foldable input

  Show description for 54ee1a9
  cloud-fan

  committed
  54ee1a9

  Copy full SHA for 54ee1a9

• [SPARK-56569] Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037

  Show description for 438c880
  

  pnikic-db

  authored and

  cloud-fan

  committed
  438c880

  Copy full SHA for 438c880

• [SPARK-56567][SQL] Fix array_insert `Int.MinValue` pos overflow

  Show description for 55ddfe3
  

  aknayar

  authored and

  cloud-fan

  committed
  55ddfe3

  Copy full SHA for 55ddfe3

• [SPARK-56551][SQL] Add operation metrics for DELETE queries in DSv2

  Show description for 569d56a
  

  ZiyaZa

  authored and

  aokolnychyi

  committed
  569d56a

  Copy full SHA for 569d56a

• [SPARK-56521][SQL] Support PartitionPredicate in runtime filters

  Show description for 4c56079
  

  szehon-ho

  authored and

  cloud-fan

  committed
  4c56079

  Copy full SHA for 4c56079

Commits on Apr 22, 2026

• [SPARK-56547][SQL][CONNECT] Improve error message when DataFrame column is referenced from a wrong DataFrame

  Show description for b4aff0b
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  b4aff0b

  Copy full SHA for b4aff0b

• [SPARK-31561][SQL] Add QUALIFY Clause

  Show description for 7caa5f0
  viirya

  committed
  7caa5f0

  Copy full SHA for 7caa5f0

Commits on Apr 21, 2026

• [SPARK-56554][SQL] Respect inferSchema option when parsing XML as variant

  Show description for 955aecb
  

  xiaonanyang-db

  authored and

  HyukjinKwon

  committed
  955aecb

  Copy full SHA for 955aecb

• [SPARK-56501] SET PATH syntax

  Show description for 345b856
  

  srielau

  authored and

  dtenedor

  committed
  345b856

  Copy full SHA for 345b856

• [SPARK-56125][SQL] Refactor MERGE INTO schema evolution to use assignment-based approach

  Show description for 0f7682c
  

  szehon-ho

  authored and

  aokolnychyi

  committed
  0f7682c

  Copy full SHA for 0f7682c

• [SPARK-56524][SQL] Add operation metrics for UPDATE queries in DSv2

  Show description for acabb7c
  

  ZiyaZa

  authored and

  aokolnychyi

  committed
  acabb7c

  Copy full SHA for acabb7c

• [SPARK-40193][SQL] Merge subplans with different filter conditions

  Show description for f7b4481
  peter-toth

  committed
  f7b4481

  Copy full SHA for f7b4481

Commits on Apr 20, 2026

• [SPARK-55959][SQL] Optimize Map Key Lookup for `GetMapValue` and `ElementAt`

  Show description for 878e505
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  878e505

  Copy full SHA for 878e505

• [SPARK-56472][SQL] Fix MERGE schema evolution with WHEN MATCHED THEN DELETE

  Show description for b32a3cf
  

  johanl-db

  authored and

  cloud-fan

  committed
  b32a3cf

  Copy full SHA for b32a3cf

• [SPARK-56054][SQL] Undo handling aliased assignments in MERGE INTO schema evolution and add tests

  Show description for 0cf7c2a
  

  johanl-db

  authored and

  cloud-fan

  committed
  0cf7c2a

  Copy full SHA for 0cf7c2a

• [SPARK-56510][SQL] Fix ReplaceData DML without metadata attributes not projecting out the operation column

  Show description for d6c1f9a
  

  ZiyaZa

  authored and

  aokolnychyi

  committed
  d6c1f9a

  Copy full SHA for d6c1f9a

Commits on Apr 18, 2026

• [SPARK-56384][SS] Support stream-stream non-outer join in Update mode

  Show description for acfae33
  HeartSaVioR

  committed
  acfae33

  Copy full SHA for acfae33

Commits on Apr 17, 2026

• [SPARK-56315][SQL] Pre-aggregate before `Expand` to reduce data amplification for multiple `COUNT(DISTINCT)`

  Show description for 57b6522
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  57b6522

  Copy full SHA for 57b6522

Commits on Apr 16, 2026

• [SPARK-56489][SQL] Add CURRENT_PATH() builtin expression and keywords

  Show description for 96e0f8f
  

  srielau

  authored and

  dtenedor

  committed
  96e0f8f

  Copy full SHA for 96e0f8f

• [SPARK-56485][SQL] Fix RowCount Estimation in CBO to avoid unintended BroadcastHashJoin

  Show description for 96ebbaa
  

  JkSelf

  authored and

  dongjoon-hyun

  committed
  96ebbaa

  Copy full SHA for 96ebbaa

• revert [SPARK-43752] and add test

  Show description for 5d491f6
  cloud-fan

  committed
  5d491f6

  Copy full SHA for 5d491f6

• [SPARK-56333][SQL] Use multiset intersection for NATURAL JOIN column matching

  Show description for 6d2840a
  

  stefankandic

  authored and

  cloud-fan

  committed
  6d2840a

  Copy full SHA for 6d2840a

• [SPARK-56467][SQL] Route scalar subquery partition filters into DSv2 runtime filtering

  Show description for 66a5a89
  

  anton5798

  authored and

  cloud-fan

  committed
  66a5a89

  Copy full SHA for 66a5a89