Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Jul 25, 2023

• [SPARK-44509][PYTHON][CONNECT] Add job cancellation API set in Spark Connect Python client

  Show description for 5ee462d
  HyukjinKwon

  committed
  5ee462d

  Copy full SHA for 5ee462d

Commits on Jul 20, 2023

• [SPARK-44481][CONNECT][PYTHON] Make pyspark.sql.is_remote an API

  Show description for 11e2e42
  HyukjinKwon

  committed
  11e2e42

  Copy full SHA for 11e2e42

Commits on Jul 10, 2023

• [SPARK-44131][SQL] Add call_function and deprecate call_udf for Scala API

  Show description for 46dd3aa
  

  beliefer

  authored and

  zhengruifeng

  committed
  46dd3aa

  Copy full SHA for 46dd3aa

• [SPARK-44329][CONNECT][PYTHON] Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

  Show description for ea6bacf
  

  panbingkun

  authored and

  zhengruifeng

  committed
  ea6bacf

  Copy full SHA for ea6bacf

• [SPARK-44331][CONNECT][PYTHON] Add bitmap functions to Scala and Python

  Show description for 32d170f
  

  panbingkun

  authored and

  zhengruifeng

  committed
  32d170f

  Copy full SHA for 32d170f

Commits on Jun 30, 2023

• [SPARK-43926][CONNECT][PYTHON] Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

  Show description for de8ec74
  

  2 peopleauthored and

  zhengruifeng

  committed
  de8ec74

  Copy full SHA for de8ec74

Commits on Jun 26, 2023

• [SPARK-43924][CONNECT][PYTHON] Add misc functions to Scala and Python

  Show description for 6a0ae19
  

  panbingkun

  authored and

  zhengruifeng

  committed
  6a0ae19

  Copy full SHA for 6a0ae19

Commits on Jun 23, 2023

• [SPARK-44135][PYTHON][CONNECT][DOCS] Document Spark Connect only API in PySpark

  Show description for 8eda2d8
  HyukjinKwon

  committed
  8eda2d8

  Copy full SHA for 8eda2d8

Commits on Jun 20, 2023

• [SPARK-43939][CONNECT][PYTHON] Add try_* functions to Scala and Python

  Show description for 68b3005
  

  panbingkun

  authored and

  zhengruifeng

  committed
  68b3005

  Copy full SHA for 68b3005

• [SPARK-43929][SPARK-44073][SQL][PYTHON][CONNECT][FOLLOWUP] Add extract, date_part, datepart to Scala, Python and Connect API

  Show description for 8dc0286
  

  beliefer

  authored and

  zhengruifeng

  committed
  8dc0286

  Copy full SHA for 8dc0286

• [SPARK-44073][SQL][PYTHON][CONNECT] Add date time functions to Scala, Python and Connect - part 2

  Show description for 7a8f2ec
  

  beliefer

  authored and

  zhengruifeng

  committed
  7a8f2ec

  Copy full SHA for 7a8f2ec

Commits on Jun 19, 2023

• [SPARK-43942][CONNECT][PYTHON] Add string functions to Scala and Python - part 1

  Show description for 476c58e
  

  panbingkun

  authored and

  zhengruifeng

  committed
  476c58e

  Copy full SHA for 476c58e

• [SPARK-43929][SQL][PYTHON][CONNECT] Add date time functions to Scala, Python and Connect API - part 1

  Show description for 25a14c3
  

  beliefer

  authored and

  zhengruifeng

  committed
  25a14c3

  Copy full SHA for 25a14c3

Commits on Jun 18, 2023

• [SPARK-43944][CONNECT][PYTHON] Add string functions to Scala and Python - part 2

  Show description for 4503efc
  

  panbingkun

  authored and

  zhengruifeng

  committed
  4503efc

  Copy full SHA for 4503efc

Commits on Jun 17, 2023

• [SPARK-43928][SQL][PYTHON][CONNECT] Add bit operations to Scala, Python and Connect API

  Show description for 02beb50
  

  beliefer

  authored and

  zhengruifeng

  committed
  02beb50

  Copy full SHA for 02beb50

Commits on Jun 16, 2023

• [SPARK-43925][SQL][PYTHON][CONNECT] Add some, bool_or,bool_and,every to Scala, Python and Connect

  Show description for 1b12094
  

  beliefer

  authored and

  zhengruifeng

  committed
  1b12094

  Copy full SHA for 1b12094

• [SPARK-43937][CONNECT][PYTHON] Add ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

  Show description for 06b2b1a
  

  panbingkun

  authored and

  zhengruifeng

  committed
  06b2b1a

  Copy full SHA for 06b2b1a

Commits on Jun 15, 2023

• [SPARK-43941][SQL][PYTHON][CONNECT] Add any_value, approx_percentile, count_if, first_value, histogram_numeric, last_value, reduce to Scala, Python and Connect API

  Show description for 79100ce
  

  beliefer

  authored and

  zhengruifeng

  committed
  79100ce

  Copy full SHA for 79100ce

Commits on Jun 14, 2023

• [SPARK-43931][SQL][PYTHON][CONNECT] Add make_* functions to Scala and Python

  Show description for a6567fe
  

  panbingkun

  authored and

  zhengruifeng

  committed
  a6567fe

  Copy full SHA for a6567fe

• [SPARK-43932][SQL][PYTHON][CONNECT] Add `current` like functions to Scala and Python

  Show description for d8c9acf
  zhengruifeng

  committed
  d8c9acf

  Copy full SHA for d8c9acf

• [SPARK-43934][SQL][PYTHON][CONNECT] Add regexp_* functions to Scala and Python

  Show description for 0086f54
  

  beliefer

  authored and

  zhengruifeng

  committed
  0086f54

  Copy full SHA for 0086f54

Commits on Jun 13, 2023

• [SPARK-43798][SQL][PYTHON] Support Python user-defined table functions

  Show description for 37ab190
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  37ab190

  Copy full SHA for 37ab190

Commits on Jun 12, 2023

• [SPARK-43938][CONNECT][PYTHON] Add to_* functions to Scala and Python

  Show description for 4da9348
  

  panbingkun

  authored and

  zhengruifeng

  committed
  4da9348

  Copy full SHA for 4da9348

Commits on Jun 8, 2023

• [SPARK-43943][SQL][PYTHON][CONNECT] Add SQL math functions to Scala and Python

  Show description for f1cca85
  zhengruifeng

  committed
  f1cca85

  Copy full SHA for f1cca85

• [SPARK-43916][SQL][PYTHON][CONNECT] Add percentile to Scala and Python API

  Show description for 4ddf83f
  

  beliefer

  authored and

  zhengruifeng

  committed
  4ddf83f

  Copy full SHA for 4ddf83f

• [SPARK-43935][SQL][PYTHON][CONNECT] Add xpath_* functions to Scala and Python

  Show description for bd27083
  

  panbingkun

  authored and

  zhengruifeng

  committed
  bd27083

  Copy full SHA for bd27083

Commits on Jun 7, 2023

• [SPARK-43933][SQL][PYTHON][CONNECT] Add linear regression aggregate functions to Scala and Python

  Show description for 2057eb7
  

  beliefer

  authored and

  zhengruifeng

  committed
  2057eb7

  Copy full SHA for 2057eb7

• [SPARK-43930][SQL][PYTHON][CONNECT] Add unix_* functions to Scala and Python

  Show description for 747db66
  

  panbingkun

  authored and

  zhengruifeng

  committed
  747db66

  Copy full SHA for 747db66

Commits on May 2, 2023

• [SPARK-16484][SQL] Add support for Datasketches HllSketch

  Show description for 007c459
  

  2 peopleauthored and

  HyukjinKwon

  committed
  007c459

  Copy full SHA for 007c459

Commits on Apr 21, 2023

• [SPARK-43213][PYTHON] Add `DataFrame.offset` to vanilla PySpark

  Show description for 7f724c3
  zhengruifeng

  committed
  7f724c3

  Copy full SHA for 7f724c3

Commits on Apr 8, 2023

• [SPARK-42931][SS] Introduce dropDuplicatesWithinWatermark

  Show description for 0e9e34c
  HeartSaVioR

  committed
  0e9e34c

  Copy full SHA for 0e9e34c

Commits on Mar 29, 2023

• [SPARK-42954][PYTHON][CONNECT] Add `YearMonthIntervalType` to PySpark and Spark Connect Python Client

  Show description for f532d22
  zhengruifeng

  committed
  f532d22

  Copy full SHA for f532d22

Commits on Mar 20, 2023

• [SPARK-41233][SQL][PYTHON] Add `array_prepend` function

  Show description for 1e7e47d
  

  navinvishy

  authored and

  zhengruifeng

  committed
  1e7e47d

  Copy full SHA for 1e7e47d

Commits on Mar 16, 2023

• Revert "[SPARK-41233][SQL][PYTHON] Add `array_prepend` function"

  Show description for baf9020
  HyukjinKwon

  committed
  baf9020

  Copy full SHA for baf9020

• [SPARK-41233][SQL][PYTHON] Add `array_prepend` function

  Show description for 3dd6296
  

  navinvishy

  authored and

  zhengruifeng

  committed
  3dd6296

  Copy full SHA for 3dd6296