You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: module_1/README.md
+16Lines changed: 16 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,6 +24,8 @@ In this module, we focus on building features for online serving, and keeping th
24
24
-[A note on Feast feature servers + push servers](#a-note-on-feast-feature-servers--push-servers)
25
25
-[Conclusion](#conclusion)
26
26
-[FAQ](#faq)
27
+
-[How do you synchronize materialized features with pushed features from streaming?](#how-do-you-synchronize-materialized-features-with-pushed-features-from-streaming)
28
+
-[Does Feast allow pushing features to the offline store?](#does-feast-allow-pushing-features-to-the-offline-store)
27
29
-[Can feature / push servers refresh their registry in response to an event? e.g. after a PR merges and `feast apply` is run?](#can-feature--push-servers-refresh-their-registry-in-response-to-an-event-eg-after-a-pr-merges-and-feast-apply-is-run)
28
30
-[How do I speed up or scale up materialization?](#how-do-i-speed-up-or-scale-up-materialization)
29
31
@@ -245,6 +247,20 @@ By the end of this module, you will have learned how to build streaming features
245
247
246
248
# FAQ
247
249
250
+
### How do you synchronize materialized features with pushed features from streaming?
251
+
This relies on individual online store implementations. The existing Redis online store implementation for example will check timestamps of incoming events and prefer the latest version.
252
+
253
+
Doing this event timestamp checking is expensive though and slows down writes. In many cases, this is not preferred. Databases often support storing multiple versions of the same value, so you can leverage that (+ TTLs) to query the most recent version at read time.
254
+
255
+
### Does Feast allow pushing features to the offline store?
256
+
Not yet! See more details at https://github.com/feast-dev/feast/issues/2732
257
+
258
+
Many users have asked for this functionality as a quick way to get started, but often users work with two flows:
259
+
- To power the online store, using stream processing to generate fresh features and pushing to the online store
260
+
- To power the offline store, using some ETL / ELT pipelines that process and clean the raw data.
261
+
262
+
Though this is more complex, one key advantage of this is that you can construct new features based on the data while iterating on model training. If you rely on streaming features to generate historical feature values, then you need to rely on a log-and-wait approach, which can slow down model iteration.
263
+
248
264
### Can feature / push servers refresh their registry in response to an event? e.g. after a PR merges and `feast apply` is run?
249
265
Unfortunately, currently the servers don't support this. Feel free to contribute a PR though to enable this! The tricky part here is that Feast would need to keep track of these servers in the registry (or in some other way), which is not the way Feast is currently designed.
0 commit comments