Skip to content

Add support for on demand transforms using the Python FTS#40

Merged
felixwang9817 merged 16 commits into
feast-dev:masterfrom
felixwang9817:support_on_demand_transforms_with_python_fts
Oct 21, 2021
Merged

Add support for on demand transforms using the Python FTS#40
felixwang9817 merged 16 commits into
feast-dev:masterfrom
felixwang9817:support_on_demand_transforms_with_python_fts

Conversation

@felixwang9817

@felixwang9817 felixwang9817 commented Oct 18, 2021

Copy link
Copy Markdown
Contributor

This PR adds support for on demand transformations by calling into the Python feature transformation server. See this PR for more details on the Python FTS.

I have tested this by initializing a new feature repo, adding ODFVs, starting the Python FTS, starting the Java feature server, and then confirming that the Java feature server returns the ODFVs as expected.

Signed-off-by: Felix Wang wangfelix98@gmail.com

Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>

@adchia adchia left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great stuff! general comment on refactoring that big method into submethods

Comment thread common/src/main/java/feast/common/models/FeatureV2.java
Comment thread serving/src/main/java/feast/serving/registry/LocalRegistryRepo.java Outdated
Comment thread serving/src/main/java/feast/serving/specs/CoreFeatureSpecRetriever.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
@adchia

adchia commented Oct 20, 2021

Copy link
Copy Markdown
Contributor

/lgtm

Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Comment thread .gitmodules
path = deps/feast
url = https://github.com/feast-dev/feast
branch = v0.9-branch
branch = master

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should be a specific version (probably 0.13 i guess)

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah but aren't the transformation server protos only on master right now?

Comment thread serving/src/main/java/feast/serving/config/FeastProperties.java Outdated
Comment thread serving/src/main/java/feast/serving/registry/LocalRegistryRepo.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: Felix Wang <wangfelix98@gmail.com>
@felixwang9817 felixwang9817 assigned achals and unassigned adchia Oct 21, 2021
Comment thread serving/src/main/java/feast/serving/service/OnlineServingServiceV2.java Outdated
Signed-off-by: Felix Wang <wangfelix98@gmail.com>

@achals achals left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

Signed-off-by: Felix Wang <wangfelix98@gmail.com>
@felixwang9817
felixwang9817 merged commit eb58e01 into feast-dev:master Oct 21, 2021
@felixwang9817
felixwang9817 deleted the support_on_demand_transforms_with_python_fts branch October 21, 2021 22:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants