Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 17, 2026

• remove list_prefix deprecated method (#37587)

  derrickaw

  authored
  c69e8a1

  Copy full SHA for c69e8a1

Commits on Oct 22, 2025

• Fix the soft-delete check and emit soft-delete log warning at most once per bucket. (#36585)

  Show description for 8bd92b5
  tvalentyn

  authored
  8bd92b5

  Copy full SHA for 8bd92b5

Commits on May 10, 2025

• use blob.exists to check the GCS file (#34818)

  Show description for 1f31eb0
  liferoad

  authored
  1f31eb0

  Copy full SHA for 1f31eb0

Commits on May 5, 2025

• use batch delete for GCS IO (#34835)

  Show description for 6f2f960
  liferoad

  authored
  6f2f960

  Copy full SHA for 6f2f960

Commits on Feb 27, 2025

• Allow users to specify custom audit entries in pipeline options. (#34062)

  Show description for bc33a33
  shunping

  authored
  bc33a33

  Copy full SHA for bc33a33

Commits on Feb 5, 2025

• sdks/python: enable recursive deletion for GCSFileSystem Paths (#33611)

  Show description for 75cf1cb
  mohamedawnallah

  authored
  75cf1cb

  Copy full SHA for 75cf1cb

Commits on Jan 10, 2025

• Add retry logic to each batch method of the GCS IO (#33539)

  Show description for e5defdd
  sadovnychyi

  authored
  e5defdd

  Copy full SHA for e5defdd

Commits on Jan 9, 2025

• Fix TextIO not fully reading a GCS file when decompressive transcoding happens (#33384)

  Show description for 1392cc8
  shunping

  authored
  1392cc8

  Copy full SHA for 1392cc8

Commits on Oct 22, 2024

• Modernize python type hints for apache_beam.

  Show description for 10689f2
  robertwb

  committed
  10689f2

  Copy full SHA for 10689f2

Commits on Sep 18, 2024

• Add throttling counter in gcsio and refactor retrying (#32428)

  Show description for eb8639b
  shunping

  authored
  eb8639b

  Copy full SHA for eb8639b

Commits on Aug 30, 2024

• Fix formatting issues (again)

  iht

  committed
  aac398d

  Copy full SHA for aac398d

Commits on Aug 29, 2024

• Fix formatting issues

  iht

  committed
  b0caa79

  Copy full SHA for b0caa79

• The GCS options are in GoogleCloudOptions, not generic PipelineOptions

  iht

  committed
  8fe3386

  Copy full SHA for 8fe3386

• Avoid parsing all options just to grab an option that is already parsed.

  Show description for 66bc071
  iht

  committed
  66bc071

  Copy full SHA for 66bc071

Commits on Jun 19, 2024

• Feature add metrics counting the number of bytes read/written from/to GCS bucket per job (#31466)

  Show description for 0a392e9
  alxd112

  authored
  0a392e9

  Copy full SHA for 0a392e9

Commits on Jun 14, 2024

• Fix internal test failure caused by PR 31550 (#31602)

  shunping

  authored
  ffaa20c

  Copy full SHA for ffaa20c

Commits on Jun 10, 2024

• [Python] Add warning to temp_location and staging_location when the bucket has soft delete enabled (#31550)

  Show description for 500ca17
  shunping

  authored
  500ca17

  Copy full SHA for 500ca17

Commits on Jun 1, 2024

• Set retry policy to DEFAULT_RETRY when initializing BlobWriter. (#31468)

  Show description for 51525d3
  shunping

  authored
  51525d3

  Copy full SHA for 51525d3

Commits on May 21, 2024

• [Python] Disable soft delete policy when creating new default bucket. (#31344)

  Show description for c5b6475
  shunping

  authored
  c5b6475

  Copy full SHA for c5b6475

Commits on May 16, 2024

• [Python] Add job name to GCS custom audit info (#31300)

  Show description for 999f7de
  shunping

  authored
  999f7de

  Copy full SHA for 999f7de

Commits on Feb 15, 2024

• Fix post-commit failure after pr/30205. (#30331)

  shunping

  authored
  52eedb2

  Copy full SHA for 52eedb2

Commits on Feb 7, 2024

• gcsio: reduce number of get requests in function calls (#30205)

  Show description for 4645a76
  shunping

  authored
  4645a76

  Copy full SHA for 4645a76

Commits on Feb 1, 2024

• Support dict as the input of delete_batch (#30188)

  Show description for 1a5466b
  shunping

  authored
  1a5466b

  Copy full SHA for 1a5466b

Commits on Dec 14, 2023

• Add user-agent string for Beam in the GCS request header. (#29765)

  shunping

  authored
  1ce707c

  Copy full SHA for 1ce707c

Commits on Nov 21, 2023

• Revert the value of MAX_BATCH_OPERATION_SIZE in gcsio (#29503)

  Show description for 392a4a1
  shunping

  authored
  392a4a1

  Copy full SHA for 392a4a1

Commits on Nov 16, 2023

• Gcsio migration (#29360)

  Show description for 8ac8b20
  

  shunping

  and

  BjornPrime

  authored
  8ac8b20

  Copy full SHA for 8ac8b20

Commits on Sep 28, 2023

• Revert "Replace StorageV1 client with GCS client (#28079)" (#28721)

  Show description for 56b1259
  damccorm

  authored
  56b1259

  Copy full SHA for 56b1259

Commits on Sep 26, 2023

• Replace StorageV1 client with GCS client (#28079)

  BjornPrime

  authored
  94812c0

  Copy full SHA for 94812c0

Commits on Sep 15, 2023

• gcsio.py use RuntimeError with exc chaining instead of overwriting previous exception (#28470)

  Show description for 108680a
  cozos

  authored
  108680a

  Copy full SHA for 108680a

Commits on Aug 11, 2023

• Revert #27878 (#27968)

  Show description for 8cfd308
  damccorm

  authored
  8cfd308

  Copy full SHA for 8cfd308

Commits on Aug 8, 2023

• Replace StorageV1 client with GCS client (#27878)

  BjornPrime

  authored
  014a193

  Copy full SHA for 014a193

Commits on Jul 18, 2023

• Show the proper error message if a GCS exception is thrown without a .message. (#27538)

  Show description for 62a8087
  psobot

  authored
  62a8087

  Copy full SHA for 62a8087

Commits on Jul 7, 2023

• Revert "Replace StorageV1 client with GCS client (#25965)" (#27388)

  Show description for 7ce2d00
  damccorm

  authored
  7ce2d00

  Copy full SHA for 7ce2d00

Commits on Jun 30, 2023

• Replace StorageV1 client with GCS client (#25965)

  BjornPrime

  authored
  34a1796

  Copy full SHA for 34a1796

Commits on Jun 22, 2023

• Add (GPN:Beam) to the user-agent string of Python GCS SDKs. (#27211)

  Show description for af010c9
  

  Shunping Huang

  authored
  af010c9

  Copy full SHA for af010c9