Skip to content

Commit 983d608

Browse files
committed
add point on to_bigquery()
Signed-off-by: Danny Chiao <danny@tecton.ai>
1 parent 762ae13 commit 983d608

File tree

1 file changed

+17
-18
lines changed

1 file changed

+17
-18
lines changed

module_0/README.md

Lines changed: 17 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -120,24 +120,7 @@ Additionally, users will often want to have a dev/staging environment that's sep
120120
├── driver_repo.py
121121
└── feature_store.yaml
122122
```
123-
124-
## 2b. Data scientists
125-
Data scientists will be using or authoring features in Feast.
126-
127-
There are two ways they can use Feast:
128-
- Use Feast primarily as a way of pulling production ready features.
129-
- See the `client/` folder for an example of how users can pull features by only having a `feature_store.yaml`
130-
- This is **not recommended** since data scientists cannot register feature services to indicate they depend on certain features in production.
131-
- **[Recommended]** Have a local copy of the feature repository (e.g. `git clone`) and author / iterate / re-use features.
132-
- Data scientist can:
133-
1. iterate on features locally
134-
2. apply features to their own dev project with a local registry & experiment
135-
3. build feature services in preparation for production
136-
4. submit PRs to include features that should be used in production (including A/B experiments, or model training iterations)
137-
138-
Data scientists can also investigate other models and their dependent features / data sources / on demand transformations through the repository or through the Web UI (by running `feast ui`)
139-
140-
## 2c. ML engineers
123+
## 2b. ML engineers
141124

142125
Data scientists or ML engineers can use the defined `FeatureService` (corresponding to model versions) and schedule regular jobs that generate batch predictions (or regularly retrain).
143126

@@ -183,6 +166,22 @@ path = store.get_historical_features(
183166
# Continue with distributed training or batch predictions from the BigQuery dataset.
184167
```
185168

169+
## 2c. Data scientists
170+
Data scientists will be using or authoring features in Feast. They can similarly handle larger datasets with methods like `RetrievalJob#to_bigquery()` as described above.
171+
172+
There are two ways they can use Feast:
173+
- Use Feast primarily as a way of pulling production ready features.
174+
- See the `client/` folder for an example of how users can pull features by only having a `feature_store.yaml`
175+
- This is **not recommended** since data scientists cannot register feature services to indicate they depend on certain features in production.
176+
- **[Recommended]** Have a local copy of the feature repository (e.g. `git clone`) and author / iterate / re-use features.
177+
- Data scientist can:
178+
1. iterate on features locally
179+
2. apply features to their own dev project with a local registry & experiment
180+
3. build feature services in preparation for production
181+
4. submit PRs to include features that should be used in production (including A/B experiments, or model training iterations)
182+
183+
Data scientists can also investigate other models and their dependent features / data sources / on demand transformations through the repository or through the Web UI (by running `feast ui`)
184+
186185
# Conclusion
187186
As a result:
188187
- You have file sources (possibly remote) and a remote registry (e.g. in S3)

0 commit comments

Comments
 (0)