Skip to content

demo notebook fixes for EMR - #1093

Closed
oavdeev wants to merge 1 commit into
feast-dev:masterfrom
oavdeev:notebook-emr-fixes
Closed

demo notebook fixes for EMR#1093
oavdeev wants to merge 1 commit into
feast-dev:masterfrom
oavdeev:notebook-emr-fixes

Conversation

@oavdeev

@oavdeev oavdeev commented Oct 22, 2020

Copy link
Copy Markdown
Collaborator

What this PR does / why we need it:
A few tweaks to the demo notebook to make it work on EMR, while hopefully not breaking GCP support either

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

NONE

Signed-off-by: Oleg Avdeev <oleg.v.avdeev@gmail.com>
@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: oavdeev
To complete the pull request process, please assign davidheryanto
You can assign the PR to them by writing /assign @davidheryanto in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@oavdeev

oavdeev commented Oct 22, 2020

Copy link
Copy Markdown
Collaborator Author

/kind housekeeping

@feast-ci-bot

Copy link
Copy Markdown
Collaborator

@oavdeev: The following test failed, say /retest to rerun them all:

Test name Commit Details Rerun command
test-end-to-end-redis-cluster aefbb4c link /test test-end-to-end-redis-cluster

Full PR test history

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

"outputs": [],
"source": [
"KAFKA_BROKER = \"kafka:9092\""
"KAFKA_BROKER = os.getenv(\"DEMO_KAFKA_BROKERS\", \"kafka:9092\")"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it make sense to hoist these variables to the top so that we know which env vars to set outside the notebook?

"SERVING_HOST = os.getenv(\"DEMO_FEAST_ONLINE_SERVING_SERVICE_HOST\", \"localhost\")\n",
"REDIS_HOST = os.getenv('DEMO_REDIS_MASTER_SERVICE_HOST', 'localhost')\n",
"REDIS_HOST = os.getenv('DEMO_REDIS_MASTER_SERVICE_HOST', os.getenv('FEAST_REDIS_HOST'))\n",
"DEMO_DATA_LOCATION = os.getenv(\"DEMO_DATA_LOCATION\")\n",

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we rename this from demo to something more generic? demo seems specific to our demos whereas this notebook is version controlled for use as a tutorial.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have already moved the demo variable in #1086.

So perhaps we can #1086 merged first?

@oavdeev

oavdeev commented Oct 23, 2020

Copy link
Copy Markdown
Collaborator Author

I'm gonna close this and open a new PR, it was easier to create a new branch than rebase this

@oavdeev oavdeev closed this Oct 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants