Skip to content

allow https url for spark ingestion jar - #1266

Merged
jklegar merged 2 commits into
feast-dev:masterfrom
jklegar:jacob_https_jar
Jan 18, 2021
Merged

allow https url for spark ingestion jar#1266
jklegar merged 2 commits into
feast-dev:masterfrom
jklegar:jacob_https_jar

Conversation

@jklegar

@jklegar jklegar commented Jan 14, 2021

Copy link
Copy Markdown
Collaborator

Signed-off-by: Jacob Klegar jacob@tecton.ai

What this PR does / why we need it: previously if the spark ingestion jar was a https url (which is the default), ingestion would fail because Feast would try to read and upload the jar as if the url were a local path

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

NONE

@woop

woop commented Jan 14, 2021

Copy link
Copy Markdown
Member

@jklegar so this change doesn't apply to dataproc?

@jklegar

jklegar commented Jan 14, 2021

Copy link
Copy Markdown
Collaborator Author

I believe on dataproc https should already work due to

if not os.path.isfile(file_path):

@oavdeev

oavdeev commented Jan 15, 2021

Copy link
Copy Markdown
Collaborator

/retest

@oavdeev

oavdeev commented Jan 16, 2021

Copy link
Copy Markdown
Collaborator

/test test-end-to-end-aws

Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
@jklegar

jklegar commented Jan 18, 2021

Copy link
Copy Markdown
Collaborator Author

/test test-end-to-end-aws

@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: jklegar, oavdeev
To complete the pull request process, please assign zhilingc after the PR has been reviewed.
You can assign the PR to them by writing /assign @zhilingc in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants