Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 23, 2026

• [SPARK-56569] Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037

  Show description for 438c880
  

  pnikic-db

  authored and

  cloud-fan

  committed
  438c880

  Copy full SHA for 438c880

Commits on Apr 22, 2026

• [SPARK-31561][SQL] Add QUALIFY Clause

  Show description for 7caa5f0
  viirya

  committed
  7caa5f0

  Copy full SHA for 7caa5f0

• [SPARK-56410][SQL][CORE] Add bounded k-way merge support in UnsafeExternalSorter to reduce OOM risk

  Show description for e837167
  

  ivoson

  authored and

  LuciferYang

  committed
  e837167

  Copy full SHA for e837167

Commits on Apr 21, 2026

• [SPARK-56501] SET PATH syntax

  Show description for 345b856
  

  srielau

  authored and

  dtenedor

  committed
  345b856

  Copy full SHA for 345b856

Commits on Apr 20, 2026

• [SPARK-56402][SS] Apply rangeScan API in stream-stream join format version 4

  Show description for 25e29fc
  HeartSaVioR

  committed
  25e29fc

  Copy full SHA for 25e29fc

Commits on Apr 18, 2026

• [SPARK-56532][CORE] Add `closeQuietly(AutoCloseable)` overload to `SparkErrorUtils`

  Show description for 225f61f
  dongjoon-hyun

  committed
  225f61f

  Copy full SHA for 225f61f

Commits on Apr 16, 2026

• [SPARK-56492][CORE][SQL] Support `digestToHexString/md5Hex/sha256Hex` in `JavaUtils`

  Show description for 22d63c7
  dongjoon-hyun

  committed
  22d63c7

  Copy full SHA for 22d63c7

Commits on Apr 15, 2026

• [SPARK-56438][SQL][CORE] Optimize `VectorizedPlainValuesReader.readBinary` for direct ByteBuffer by eliminating intermediate byte[] copy

  Show description for 2449275
  LuciferYang

  committed
  2449275

  Copy full SHA for 2449275

Commits on Apr 12, 2026

• [SPARK-56253][PYTHON][CONNECT][FOLLOW-UP] Reject multi-column DataFrame input in spark.read.json

  Show description for 638ca41
  

  Yicong-Huang

  authored and

  HyukjinKwon

  committed
  638ca41

  Copy full SHA for 638ca41

Commits on Apr 9, 2026

• [SPARK-56253][PYTHON][CONNECT] Make spark.read.json accept DataFrame input

  Show description for 21ada68
  

  Yicong-Huang

  authored and

  HyukjinKwon

  committed
  21ada68

  Copy full SHA for 21ada68

Commits on Apr 8, 2026

• [SPARK-56092][SS][CONNECT] Fix NPE in StreamingQueryException.toString() when cause is null

  Show description for 163abe5
  

  xiaoxuandev

  authored and

  HeartSaVioR

  committed
  163abe5

  Copy full SHA for 163abe5

Commits on Apr 7, 2026

• [SPARK-56364][BUILD][TESTS] Generate Scala-based test JARs dynamically instead of storing pre-built binaries

  Show description for 491add8
  sarutak

  committed
  491add8

  Copy full SHA for 491add8

Commits on Apr 6, 2026

• [SPARK-56207][SQL] Replace legacy error codes with named errors in DSv2 connector API

  Show description for 5bb6271
  

  dbtsai

  authored and

  viirya

  committed
  5bb6271

  Copy full SHA for 5bb6271

• [SPARK-56361][SS] Provide better error with logging on NPE in stream-stream join

  Show description for f184c25
  HeartSaVioR

  committed
  f184c25

  Copy full SHA for f184c25

• [SPARK-56353][BUILD][TESTS] Generate Java-based test JARs dynamically instead of storing pre-built binaries

  Show description for 5beaa5b
  

  sarutak

  authored and

  pan3793

  committed
  5beaa5b

  Copy full SHA for 5beaa5b

Commits on Apr 5, 2026

• [SPARK-56007][CONNECT] Fix ArrowDeserializer to use positional binding for rows

  Show description for 1ea48e4
  

  hvanhovell

  authored and

  HyukjinKwon

  committed
  1ea48e4

  Copy full SHA for 1ea48e4

Commits on Apr 1, 2026

• [SPARK-56001][SQL] Add INSERT INTO ... REPLACE ON/USING syntax

  Show description for 3e7e126
  

  longvu-db

  authored and

  cloud-fan

  committed
  3e7e126

  Copy full SHA for 3e7e126

Commits on Mar 30, 2026

• [SPARK-56279][CORE] Enable zero-copy sendfile for FileRegion in native Netty transports

  Show description for 15ffa54
  LuciferYang

  committed
  15ffa54

  Copy full SHA for 15ffa54

Commits on Mar 26, 2026

• [SPARK-56221][SQL][PYTHON] Feature parity between spark.catalog.* vs DDL commands

  Show description for 91d62ce
  HyukjinKwon

  committed
  91d62ce

  Copy full SHA for 91d62ce

• [SPARK-56225][SQL] Improve View WITH SCHEMA EVOLUTION error message

  Show description for c72f33e
  

  szehon-ho

  authored and

  cloud-fan

  committed
  c72f33e

  Copy full SHA for c72f33e

Commits on Mar 25, 2026

• [SPARK-54808] Qualified session view

  Show description for 4c981ae
  

  2 peopleauthored and

  gengliangwang

  committed
  4c981ae

  Copy full SHA for 4c981ae

• [SPARK-56205][SS] Validate base state store checkpoint ID before committing microbatch

  Show description for a17e434
  

  ericm-db

  authored and

  anishshri-db

  committed
  a17e434

  Copy full SHA for a17e434

• [SPARK-55448][CONNECT] Fix query events loss when session closes during query execution

  Show description for 2facd67
  

  biruktesf-db

  authored and

  hvanhovell

  committed
  2facd67

  Copy full SHA for 2facd67

• [SPARK-55866][SQL] Rename _LEGACY_ERROR_TEMP_2145 to OPTION_VALUE_EXCEEDS_ONE_CHARACTER

  Show description for 7fbf6ba
  

  mikhailnik-db

  authored and

  cloud-fan

  committed
  7fbf6ba

  Copy full SHA for 7fbf6ba

• [SPARK-55862][SQL] Rename _LEGACY_ERROR_TEMP_2027 to UNEXPECTED_OPERATOR_IN_CORRELATED_SUBQUERY

  Show description for 4d4f504
  

  mikhailnik-db

  authored and

  cloud-fan

  committed
  4d4f504

  Copy full SHA for 4d4f504

• [SPARK-55861][SQL] Rename _LEGACY_ERROR_TEMP_2045 to UNSUPPORTED_TABLE_CHANGE

  Show description for 92bab5c
  

  mikhailnik-db

  authored and

  cloud-fan

  committed
  92bab5c

  Copy full SHA for 92bab5c

• [SPARK-56184][SQL] Replace `assert` with proper `SparkRuntimeException` in partition column parsing

  Show description for 0ecbe8b
  

  ilicmarkodb

  authored and

  cloud-fan

  committed
  0ecbe8b

  Copy full SHA for 0ecbe8b

Commits on Mar 24, 2026

• [SPARK-55865][SQL] Rename _LEGACY_ERROR_TEMP_1266 to CANNOT_TRUNCATE_EXTERNAL_TABLE

  Show description for 34ac927
  

  mikhailnik-db

  authored and

  cloud-fan

  committed
  34ac927

  Copy full SHA for 34ac927

Commits on Mar 21, 2026

• [SPARK-56046][SQL] Typed SPJ partition key `Reducer`s

  Show description for 595a802
  peter-toth

  committed
  595a802

  Copy full SHA for 595a802

Commits on Mar 18, 2026

• [SPARK-55948][SQL] Add DSv2 CDC connector API, analyzer resolution, and SQL CHANGES clause

  Show description for 9683519
  gengliangwang

  committed
  9683519

  Copy full SHA for 9683519

Commits on Mar 17, 2026

• [SPARK-55983][SQL] New single-pass analyzer functionality and bugfixes

  Show description for d06d086
  

  mihailotim-db

  authored and

  dtenedor

  committed
  d06d086

  Copy full SHA for d06d086

• [SPARK-55996][CORE] Remove default `jdk.reflect.useDirectMethodHandle=false`

  Show description for f64a7df
  pan3793

  committed
  f64a7df

  Copy full SHA for f64a7df

Commits on Mar 16, 2026

• [SPARK-55690] Schema evolution in DSv2 AppendData, OverwriteByExpression, OverwritePartitionsDynamic

  Show description for 73dd6ed
  

  johanl-db

  authored and

  aokolnychyi

  committed
  73dd6ed

  Copy full SHA for 73dd6ed

Commits on Mar 12, 2026

• [SPARK-55275] Add InvalidPlanInput sql states for sql/connect

  Show description for c1f4d11
  

  garlandz-db

  authored and

  hvanhovell

  committed
  c1f4d11

  Copy full SHA for c1f4d11

• [SPARK-55928][SQL] New linter for config effectiveness in views and UDFs

  Show description for 320ece1
  

  mihailotim-db

  authored and

  cloud-fan

  committed
  320ece1

  Copy full SHA for 320ece1