Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 23, 2026

• [SPARK-34914][CORE] Local mode supports Hadoop Delegation Token

  Show description for b403bd2
  

  pan3793

  and

  ulysses-you

  committed
  b403bd2

  Copy full SHA for b403bd2

Commits on Apr 22, 2026

• [SPARK-56410][SQL][CORE] Add bounded k-way merge support in UnsafeExternalSorter to reduce OOM risk

  Show description for e837167
  

  ivoson

  authored and

  LuciferYang

  committed
  e837167

  Copy full SHA for e837167

Commits on Apr 21, 2026

• [SPARK-56560][SQL][TESTS] Replace SQLTestUtils/SQLTestUtilsBase with QueryTest/QueryTestBase

  Show description for 276295a
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  276295a

  Copy full SHA for 276295a

• [SPARK-56496][CORE] Unify stage retry limit checks into canRetryStage helper in DAGScheduler

  Show description for 54294ae
  jiangxb1987

  committed
  54294ae

  Copy full SHA for 54294ae

Commits on Apr 20, 2026

• [SPARK-56499][CORE] Deduplicate RDD graph BFS traversal pattern in DAGScheduler

  Show description for 5365b3f
  jiangxb1987

  committed
  5365b3f

  Copy full SHA for 5365b3f

• [SPARK-56511][CORE][TESTS][FOLLOWUP] Disable off-heap memory in ShuffleExternalSorter cleanupResources test

  Show description for fd472f1
  viirya

  committed
  fd472f1

  Copy full SHA for fd472f1

Commits on Apr 19, 2026

• [SPARK-56528][CORE] Make Jetty SniHostCheck configurable

  Show description for 1f4994d
  dongjoon-hyun

  committed
  1f4994d

  Copy full SHA for 1f4994d

Commits on Apr 17, 2026

• [SPARK-56527][CORE] Rename internal config name `spark.ui.(jettyS -> jetty.s)topTimeout`

  Show description for a2efe5f
  dongjoon-hyun

  committed
  a2efe5f

  Copy full SHA for a2efe5f

• [SPARK-56511][CORE] Fix NPE in ShuffleInMemorySorter.getMemoryUsage after failed reset

  Show description for e65018a
  

  timlee0119

  authored and

  jiangxb1987

  committed
  e65018a

  Copy full SHA for e65018a

• [SPARK-56512][CORE] Avoid redundant BlockId parsing in ShuffleBlockFetcherIterator

  Show description for 132de08
  LuciferYang

  committed
  132de08

  Copy full SHA for 132de08

Commits on Apr 16, 2026

• [SPARK-56480][TESTS] Fix flaky SparkLauncherSuite due to race conditions in cleanup

  Show description for aa2e1af
  dbtsai

  committed
  aa2e1af

  Copy full SHA for aa2e1af

• [SPARK-56502][CORE] Fix integer overflow in DirectByteBufferOutputStream capacity check

  Show description for 6969962
  

  timlee0119

  authored and

  jiangxb1987

  committed
  6969962

  Copy full SHA for 6969962

• [SPARK-56326][SS][CORE] Include streaming query and batch ids in scheduling logs

  Show description for ea8b6d6
  

  BrooksWalls

  authored and

  HeartSaVioR

  committed
  ea8b6d6

  Copy full SHA for ea8b6d6

Commits on Apr 15, 2026

• [SPARK-56491][CORE] Add `ReadOnlySparkConf.getAllAsJavaMap`

  Show description for 3323592
  dongjoon-hyun

  committed
  3323592

  Copy full SHA for 3323592

• [SPARK-55715][SQL] Keep `outputOrdering` when `GroupPartitionsExec` coalesces partitions

  Show description for f8f4813
  peter-toth

  committed
  f8f4813

  Copy full SHA for f8f4813

• [SPARK-56438][SQL][CORE] Optimize `VectorizedPlainValuesReader.readBinary` for direct ByteBuffer by eliminating intermediate byte[] copy

  Show description for 2449275
  LuciferYang

  committed
  2449275

  Copy full SHA for 2449275

Commits on Apr 13, 2026

• [SPARK-56456] Improve checkError() diagnostics

  Show description for 804e069
  

  srielau

  authored and

  allisonwang-db

  committed
  804e069

  Copy full SHA for 804e069

Commits on Apr 12, 2026

• [SPARK-56330][CORE][FOLLOWUP] Use dedicated loop for TaskInterruptListeners to avoid blocking completion listeners

  Show description for 4db309d
  

  cloud-fan

  authored and

  HyukjinKwon

  committed
  4db309d

  Copy full SHA for 4db309d

• [SPARK-56411][SQL] Register Decimal in KryoSerializer so cached-batch spill works

  Show description for c3473e4
  LuciferYang

  committed
  c3473e4

  Copy full SHA for c3473e4

Commits on Apr 11, 2026

• [SPARK-56441][BUILD] Upgrade `lz4-java` to 1.11.0

  Show description for 3215ca7
  

  dongjoon-hyun

  authored and

  pan3793

  committed
  3215ca7

  Copy full SHA for 3215ca7

• [SPARK-56354][WEBUI] Lazy-load vis-timeline resources only on pages that use timeline views

  Show description for 1788a34
  sarutak

  committed
  1788a34

  Copy full SHA for 1788a34

Commits on Apr 10, 2026

• [SPARK-54774][CORE] Submit failed should keep same exit code with app exit code in K8s mode

  Show description for f9bb48c
  

  AngersZhuuuu

  authored and

  pan3793

  committed
  f9bb48c

  Copy full SHA for f9bb48c

Commits on Apr 9, 2026

• [SPARK-56302][CORE] Free task result memory eagerly during serialization on executor

  Show description for 3851cb5
  

  ivoson

  authored and

  LuciferYang

  committed
  3851cb5

  Copy full SHA for 3851cb5

Commits on Apr 8, 2026

• [SPARK-56330][CORE] Add TaskInterruptListener to TaskContext for interrupt notifications

  Show description for a7fb5bb
  

  Ivan Sadikov

  authored and

  HyukjinKwon

  committed
  a7fb5bb

  Copy full SHA for a7fb5bb

Commits on Apr 7, 2026

• [MINOR][CORE][TESTS] Fix flaky DAGSchedulerSuite test for push-based shuffle

  Show description for c7c78e0
  dbtsai

  committed
  c7c78e0

  Copy full SHA for c7c78e0

• [SPARK-56364][BUILD][TESTS] Generate Scala-based test JARs dynamically instead of storing pre-built binaries

  Show description for 491add8
  sarutak

  committed
  491add8

  Copy full SHA for 491add8

Commits on Apr 6, 2026

• [SPARK-56353][BUILD][TESTS] Generate Java-based test JARs dynamically instead of storing pre-built binaries

  Show description for 5beaa5b
  

  sarutak

  authored and

  pan3793

  committed
  5beaa5b

  Copy full SHA for 5beaa5b

Commits on Mar 31, 2026

• [SPARK-51988][SS] Do file checksum verification on read for RocksDB zip file

  Show description for e6feb27
  

  gnanda-db

  authored and

  anishshri-db

  committed
  e6feb27

  Copy full SHA for e6feb27

• [SPARK-56235][CORE] Add reverse index in TaskSetManager to avoid O(N) scans in executorLost

  Show description for e7eceb7
  

  DenineLu

  authored and

  sunchao

  committed
  e7eceb7

  Copy full SHA for e7eceb7

• [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and AM

  Show description for 6e8c690
  

  jzhuge

  authored and

  pan3793

  committed
  6e8c690

  Copy full SHA for 6e8c690

• [SPARK-56298] Enable `spark.master.rest.virtualThread.enabled` by default

  Show description for 765ae10
  dongjoon-hyun

  committed
  765ae10

  Copy full SHA for 765ae10

Commits on Mar 30, 2026

• [SPARK-56234][CORE] Support disabling log directory scanning by path pattern in SHS

  Show description for 4a34ba8
  

  sarutak

  authored and

  dongjoon-hyun

  committed
  4a34ba8

  Copy full SHA for 4a34ba8

• [SPARK-56279][CORE] Enable zero-copy sendfile for FileRegion in native Netty transports

  Show description for 15ffa54
  LuciferYang

  committed
  15ffa54

  Copy full SHA for 15ffa54

• [SPARK-56278][CORE] Populate accurate metadata immediately during on-demand loading in SHS

  Show description for 2addccb
  sarutak

  committed
  2addccb

  Copy full SHA for 2addccb

Commits on Mar 28, 2026

• [SPARK-56258][SQL] Make MetricUtils.stringValue lenient for unknown metric types

  Show description for 1ac73b9
  yaooqinn

  committed
  1ac73b9

  Copy full SHA for 1ac73b9