Commits

Commit history

1. Commits on Apr 7, 2026

   • [SPARK-55450][SS][PYTHON][DOCS] Document admission control in PySpark streaming data sources

     Show description for 98cdaee
     

     jiteshsoni

     authored and

     HeartSaVioR

     committed
     98cdaeeView commit details

     Copy full SHA for 98cdaee

     View code at this pointBrowse repository at this point
2. Commits on Apr 3, 2026

   • [SPARK-56341][PYTHON][DOCS] Fix outdated PyArrow minimum version in arrow_pandas.rst

     Show description for cba5705
     

     Yicong-Huang

     authored and

     zhengruifeng

     committed
     cba5705View commit details

     Copy full SHA for cba5705

     View code at this pointBrowse repository at this point
3. Commits on Feb 13, 2026

   • [SPARK-55416][SS][PYTHON] Streaming Python Data Source memory leak when end-offset is not updated

     Show description for 7542473
     

     vinodkc

     authored and

     HeartSaVioR

     committed
     7542473View commit details

     Copy full SHA for 7542473

     View code at this pointBrowse repository at this point
4. Commits on Dec 10, 2025

   • [SPARK-54604][PYTHON][DOCS] Fix grammar issues in python_data_source.rst

     Show description for 179ade2
     

     Yicong-Huang

     authored and

     HyukjinKwon

     committed
     179ade2View commit details

     Copy full SHA for 179ade2

     View code at this pointBrowse repository at this point
5. Commits on Dec 3, 2025

   • [SPARK-54555][PYTHON][TESTS][FOLLOW-UP] Doc build

     Show description for bbe8315
     

     asl3

     authored and

     LuciferYang

     committed
     bbe8315View commit details

     Copy full SHA for bbe8315

     View code at this pointBrowse repository at this point
6. Commits on Dec 2, 2025

   • [SPARK-54555][PYTHON] Enable Arrow-optimized Python UDFs and Arrow-based PySpark IPC by default

     Show description for ea0a35e
     

     asl3

     authored and

     dbtsai

     committed
     ea0a35eView commit details

     Copy full SHA for ea0a35e

     View code at this pointBrowse repository at this point
7. Commits on Nov 26, 2025

   • [SPARK-54519][DOCS] Reformat tutorial comments so it's easier to read on the website

     Show description for c022e0e
     

     gaogaotiantian

     authored and

     HyukjinKwon

     committed
     c022e0eView commit details

     Copy full SHA for c022e0e

     View code at this pointBrowse repository at this point
8. Commits on Oct 20, 2025

   • [SPARK-53696][PYTHON][CONNECT][SQL] Default to bytes for BinaryType in PySpark

     Show description for 57b4cd2
     

     xianzhe-databricks

     and

     HyukjinKwon

     committed
     57b4cd2View commit details

     Copy full SHA for 57b4cd2

     View code at this pointBrowse repository at this point
9. Commits on Sep 24, 2025

   • [SPARK-53356][PYTHON][DOCS] Small improvements to python data source docs

     Show description for f3a69b2
     sryza

     committed
     f3a69b2View commit details

     Copy full SHA for f3a69b2

     View code at this pointBrowse repository at this point
10. Commits on Sep 22, 2025

    • [SPARK-53641][DOCS] Add PARTITION BY support in Arrow Python UDTF docs

      Show description for 71c67b0
      

      allisonwang-db

      authored and

      zhengruifeng

      committed
      71c67b0View commit details

      Copy full SHA for 71c67b0

      View code at this pointBrowse repository at this point
11. Commits on Aug 25, 2025

    • [SPARK-53344][DOCS] Add user guide for Arrow Python UDTFs

      Show description for 50a2ebe
      

      allisonwang-db

      authored and

      zhengruifeng

      committed
      50a2ebeView commit details

      Copy full SHA for 50a2ebe

      View code at this pointBrowse repository at this point
12. Commits on Aug 22, 2025

    • [SPARK-53265][PYTHON][DOCS] Add Arrow Python UDF Type Coercion Tables in Arrow Python UDF Docs

      Show description for f0e8999
      

      asl3

      authored and

      zhengruifeng

      committed
      f0e8999View commit details

      Copy full SHA for f0e8999

      View code at this pointBrowse repository at this point
13. Commits on Aug 13, 2025

    • Revert "[SPARK-53265][PYTHON][DOCS] Add Arrow Python UDF Type Coercion Tables in Arrow Python UDF Docs"

      Show description for 2d4f7c3
      zhengruifeng

      committed
      2d4f7c3View commit details

      Copy full SHA for 2d4f7c3

      View code at this pointBrowse repository at this point

    • [SPARK-53265][PYTHON][DOCS] Add Arrow Python UDF Type Coercion Tables in Arrow Python UDF Docs

      Show description for 5c52a00
      

      asl3

      authored and

      zhengruifeng

      committed
      5c52a00View commit details

      Copy full SHA for 5c52a00

      View code at this pointBrowse repository at this point
14. Commits on Jul 17, 2025

    • [SPARK-52840][PYTHON][DOCS] Increase Pandas minimum version to 2.2.0

      Show description for a9da24c
      zhengruifeng

      committed
      a9da24cView commit details

      Copy full SHA for a9da24c

      View code at this pointBrowse repository at this point
15. Commits on Jul 8, 2025

    • [SPARK-51919][PYTHON] Allow overwriting statically registered Python Data Source

      Show description for 6cfe303
      

      wengh

      authored and

      allisonwang-db

      committed
      6cfe303View commit details

      Copy full SHA for 6cfe303

      View code at this pointBrowse repository at this point
16. Commits on Apr 29, 2025

    • [SPARK-51802][PYTHON][DOCS] OSS PySpark User Guide Docs

      Show description for 02faae5
      

      asl3

      authored and

      HyukjinKwon

      committed
      02faae5View commit details

      Copy full SHA for 02faae5

      View code at this pointBrowse repository at this point
17. Loading