Skip to content

Historical feature retrieval e2e test - #1067

Merged
pyalex merged 2 commits into
feast-dev:masterfrom
khorshuheng:historical-retrieval-e2e-test
Oct 22, 2020
Merged

Historical feature retrieval e2e test#1067
pyalex merged 2 commits into
feast-dev:masterfrom
khorshuheng:historical-retrieval-e2e-test

Conversation

@khorshuheng

Copy link
Copy Markdown
Collaborator

Signed-off-by: Khor Shu Heng khor.heng@gojek.com

What this PR does / why we need it:
This PR add end to end test for historical feature retrieval. The new test has been tested locally against a local spark cluster, but at the moment it will fail during the CI as the corresponding test infrastructure has not been set up yet.

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

NONE

@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: khorshuheng

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Comment thread tests/e2e/test_historical_features.py Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we need to change the file source to have named arguments and not positional, even if they are required. The only positional argument should be the path, and it should come first. Otherwise its hard to understand what is being defined here.

Comment thread tests/e2e/test_historical_features.py Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please set a fixed seed.

Comment thread tests/e2e/test_historical_features.py Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you at all testing the as_of join functionality? Looks like you just have one timestamp in the range?

Signed-off-by: Khor Shu Heng <khor.heng@gojek.com>
@khorshuheng
khorshuheng force-pushed the historical-retrieval-e2e-test branch from 0f7dc51 to 342c49d Compare October 22, 2020 08:08
@khorshuheng khorshuheng changed the title Historical feature retrieval e2e test (WIP) Historical feature retrieval e2e test Oct 22, 2020
Signed-off-by: Khor Shu Heng <khor.heng@gojek.com>
@feast-ci-bot

Copy link
Copy Markdown
Collaborator

@khorshuheng: The following tests failed, say /retest to rerun them all:

Test name Commit Details Rerun command
test-end-to-end-auth ea397da link /test test-end-to-end-auth
test-end-to-end ea397da link /test test-end-to-end
test-end-to-end-redis-cluster ea397da link /test test-end-to-end-redis-cluster

Full PR test history

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@pyalex
pyalex merged commit de62865 into feast-dev:master Oct 22, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants