Skip to content

Fix #37736: Allow composite transforms to use implicit input chaining #37861

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
liferoad merged 11 commits into from
Mar 21, 2026
Merged

Fix #37736: Allow composite transforms to use implicit input chaining #37861

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
733b665
Fix #37736: Allow composite transforms to use implicit input chaining
liferoad Mar 14, 2026
ce2103f
Fix line-too-long lint error in yaml_transform.py
liferoad Mar 15, 2026
69b0d56
Fix yapf formatting in yaml_transform.py
liferoad Mar 15, 2026
1d74b2a
Fix composite implicit input chaining logic
liferoad Mar 15, 2026
7b6585c
Fix composite implicit input chaining - delete empty input from spec
liferoad Mar 16, 2026
3abf34b
Fix composite implicit input - reference pipeline input directly
liferoad Mar 16, 2026
ceb0ac1
Fix composite implicit input - reference pipeline input
liferoad Mar 16, 2026
c416e7c
Revert "Fix composite implicit input - reference pipeline input"
liferoad Mar 17, 2026
1f05824
Fix composite implicit input chaining from pipeline input
liferoad Mar 17, 2026
1ce56b9
Apply yapf formatting and fix pylint line length issues
liferoad Mar 17, 2026
5a3350c
Address review: revert unnecessary variable assignment
liferoad Mar 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix composite implicit input - reference pipeline input directly
  • Loading branch information
@liferoad
liferoad committed Mar 16, 2026
commit 3abf34b0fec59d25eef7a8ab3d4dfd63695e34e9
7 changes: 3 additions & 4 deletions sdks/python/apache_beam/yaml/yaml_transform.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -809,10 +809,9 @@ def expand_composite_transform(spec, scope):
if is_explicitly_empty(composite_input):
transform['input'] = composite_input
elif is_empty(composite_input):
# No explicit input - will use the pipeline input.
# Remove from spec so Scope doesn't try to use it.
if 'input' in spec:
del spec['input']
# No explicit input - the composite input IS the pipeline input.
# Reference the 'input' key from the Scope's inputs.
transform['input'] = 'input'
else:
transform['input'] = {key: key for key in composite_input.keys()}
else:
Expand Down
Loading