Skip to content

Add EMR streaming job launcher - #1065

Merged
feast-ci-bot merged 1 commit into
feast-dev:masterfrom
oavdeev:emr-streaming-launcher
Oct 19, 2020
Merged

Add EMR streaming job launcher#1065
feast-ci-bot merged 1 commit into
feast-dev:masterfrom
oavdeev:emr-streaming-launcher

Conversation

@oavdeev

@oavdeev oavdeev commented Oct 16, 2020

Copy link
Copy Markdown
Collaborator

What this PR does / why we need it:
Add streaming ingestion job support to the EMR launcher and the launcher interface

Does this PR introduce a user-facing change?:

NONE

@oavdeev

oavdeev commented Oct 16, 2020

Copy link
Copy Markdown
Collaborator Author

/kind feature

@feast-ci-bot feast-ci-bot added kind/feature New feature or request and removed needs-kind labels Oct 16, 2020
@oavdeev
oavdeev force-pushed the emr-streaming-launcher branch from feff127 to 6cc2565 Compare October 19, 2020 07:11
Comment thread sdk/python/feast/pyspark/launcher.py Outdated

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

option_field here was unused anyway after #1049

@woop woop changed the title emr streaming job launcher Add EMR streaming job launcher Oct 19, 2020
Comment thread sdk/python/feast/pyspark/launchers/aws/emr.py Outdated
Signed-off-by: Oleg Avdeev <oleg.v.avdeev@gmail.com>
@oavdeev
oavdeev force-pushed the emr-streaming-launcher branch from 6cc2565 to 167c522 Compare October 19, 2020 08:31
@pyalex

pyalex commented Oct 19, 2020

Copy link
Copy Markdown
Collaborator

/retest

@pyalex

pyalex commented Oct 19, 2020

Copy link
Copy Markdown
Collaborator

/test test-end-to-end-auth

@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: oavdeev, pyalex

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@pyalex

pyalex commented Oct 19, 2020

Copy link
Copy Markdown
Collaborator

/lgtm

@pyalex

pyalex commented Oct 19, 2020

Copy link
Copy Markdown
Collaborator

/test test-end-to-end-redis-cluster

@feast-ci-bot
feast-ci-bot merged commit 112e94d into feast-dev:master Oct 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants