Skip to content

Implement materialize method - #1379

Merged
feast-ci-bot merged 12 commits into
feast-dev:masterfrom
jklegar:jacob_ingest_firestore
Mar 22, 2021
Merged

Implement materialize method#1379
feast-ci-bot merged 12 commits into
feast-dev:masterfrom
jklegar:jacob_ingest_firestore

Conversation

@jklegar

@jklegar jklegar commented Mar 11, 2021

Copy link
Copy Markdown
Collaborator

What this PR does / why we need it: Implements ingestion into Firestore, which will be part of the python-based ingestion flow

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

Adds materialize method to FeatureStore class to load data from the offline store into the online store for a specified time interval.

@jklegar

jklegar commented Mar 11, 2021

Copy link
Copy Markdown
Collaborator Author

Note this is stacked on #1366

@jklegar jklegar changed the title Jacob ingest firestore WIP Ingest into Firestore Mar 11, 2021
@jklegar
jklegar force-pushed the jacob_ingest_firestore branch from e8aa700 to 0b6f95b Compare March 15, 2021 23:50
@jklegar jklegar changed the title WIP Ingest into Firestore WIP materialize() Mar 15, 2021
@jklegar
jklegar force-pushed the jacob_ingest_firestore branch from 0b6f95b to 59303c5 Compare March 16, 2021 17:30
@jklegar jklegar changed the title WIP materialize() Implement materialize method Mar 16, 2021
@jklegar
jklegar force-pushed the jacob_ingest_firestore branch from 3a2ddf6 to 1abd497 Compare March 16, 2021 23:43
@jklegar

jklegar commented Mar 17, 2021

Copy link
Copy Markdown
Collaborator Author

/test test-telemetry

@jklegar
jklegar requested a review from oavdeev March 17, 2021 00:22
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/infra/gcp.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/offline_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/tests/test_bigquery_ingestion.py Outdated
Comment thread sdk/python/tests/test_bigquery_ingestion.py Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not clear to me how or why timestamp_mapped occurs twice. Is that supposed to work?

Comment thread sdk/python/tests/test_bigquery_ingestion.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
Comment thread sdk/python/feast/feature_store.py Outdated
jklegar added 11 commits March 22, 2021 10:51
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
Comment thread sdk/python/feast/offline_store.py
Signed-off-by: Jacob Klegar <jacob@tecton.ai>
@jklegar

jklegar commented Mar 22, 2021

Copy link
Copy Markdown
Collaborator Author

/kind feature

@feast-ci-bot feast-ci-bot added kind/feature New feature or request and removed needs-kind labels Mar 22, 2021
@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jklegar, woop

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@woop

woop commented Mar 22, 2021

Copy link
Copy Markdown
Member

/lgtm

@feast-ci-bot
feast-ci-bot merged commit cc00315 into feast-dev:master Mar 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants