Skip to content

Add streaming sources to the FeatureView API #1664

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
feast-ci-bot merged 9 commits into from
Jun 28, 2021
Merged

Add streaming sources to the FeatureView API #1664

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
2e0892b
Add a streaming source to the FeatureView API
achals Jun 23, 2021
4096979
remove stuff from rebase
achals Jun 23, 2021
286b619
make format
achals Jun 23, 2021
df447b3
Update protos
achals Jun 25, 2021
62a6431
lint
achals Jun 25, 2021
ac1dbfa
format
achals Jun 25, 2021
81d6d41
CR
achals Jun 28, 2021
6d40063
fix test
achals Jun 28, 2021
dcfa59a
lint
achals Jun 28, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix test 
Signed-off-by: Achal Shah <achals@gmail.com>
  • Loading branch information
@achals
achals committed Jun 28, 2021
commit 6d4006341d37ac77766ddb397d6d04189dcae0d0
11 changes: 6 additions & 5 deletions sdk/python/feast/feature_view.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -175,6 +175,8 @@ def to_proto(self) -> FeatureViewProto:
ttl_duration = Duration()
ttl_duration.FromTimedelta(self.ttl)

print(f"Stream soruce: {self.stream_source}, {type(self.stream_source)}")

spec = FeatureViewSpecProto(
name=self.name,
entities=self.entities,
Expand Down Expand Up @@ -205,6 +207,9 @@ def from_proto(cls, feature_view_proto: FeatureViewProto):
"""

_input = DataSource.from_proto(feature_view_proto.spec.batch_source)
stream_source = DataSource.from_proto(feature_view_proto.spec.stream_source)\
if feature_view_proto.spec.HasField("stream_source") \
else None
feature_view = cls(
name=feature_view_proto.spec.name,
entities=[entity for entity in feature_view_proto.spec.entities],
Expand All @@ -226,11 +231,7 @@ def from_proto(cls, feature_view_proto: FeatureViewProto):
),
input=_input,
batch_source=_input,
stream_source=(
feature_view_proto.spec.stream_source
if feature_view_proto.spec.stream_source is not None
else None
),
stream_source=stream_source,
)

feature_view.created_timestamp = feature_view_proto.meta.created_timestamp
Expand Down