Expected Behavior
"Dataset" that was meant on the sdk is a collection of features selected by the user. While this term is also used in BigQuery, the SDK should not create a dataset whenever this function is called, rather just create a view in the feast dataset.
Current Behavior
It creates a new BigQuery Dataset.
Steps to reproduce
Use the quickstart:
feature_set = FeatureSet(entity="ride",
features=["ride.log_trip_duration",
"ride.distance_haversine",
"ride.distance_dummy_manhattan",
"ride.direction",
"ride.month",
"ride.day_of_month",
"ride.hour",
"ride.day_of_week",
"ride.vi_1",
"ride.vi_2",
"ride.sf_n",
"ride.sf_y"])
dataset_info = fs.create_dataset(feature_set, "2016-06-01", "2016-08-01")
dataset = fs.download_dataset_to_df(dataset_info, staging_location=STAGING_LOCATION)
dataset.head()
Specifications
Possible Solution
- Fix
create_dataset to create view in feast dataset instead
- Write down dataset definition
- Change to
create_view?
Expected Behavior
"Dataset" that was meant on the sdk is a collection of features selected by the user. While this term is also used in BigQuery, the SDK should not create a dataset whenever this function is called, rather just create a view in the feast dataset.
Current Behavior
It creates a new BigQuery Dataset.
Steps to reproduce
Use the quickstart:
Specifications
Possible Solution
create_datasetto create view in feast dataset insteadcreate_view?