Skip to content

fix: Fix push sources and add docs / tests pushing via the python feature server #2561

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
feast-ci-bot merged 18 commits into from
Apr 19, 2022
Merged

fix: Fix push sources and add docs / tests pushing via the python feature server #2561

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
93b165e
bug: Fixing push API endpoint to include a way to specify whether the…
adchia Apr 17, 2022
ddba206
fix
adchia Apr 17, 2022
23c9989
prune out unneeded fields in push source
adchia Apr 18, 2022
315f2d8
prune out unneeded fields in push source
adchia Apr 18, 2022
ec3d5c2
prune out unneeded fields in push source
adchia Apr 18, 2022
de905af
fix comment
adchia Apr 18, 2022
e6df1c3
fix comment
adchia Apr 18, 2022
ffc7436
fix comment
adchia Apr 18, 2022
42f6e27
fix comment
adchia Apr 18, 2022
5b37bb6
fix generator
adchia Apr 18, 2022
cf39fc3
add data source creator teardown
adchia Apr 18, 2022
ea6aaed
add data source creator teardown
adchia Apr 18, 2022
22dc1a4
update push source to alpha
adchia Apr 18, 2022
47c1697
lint
adchia Apr 18, 2022
1e3e5ff
lint
adchia Apr 18, 2022
152686e
lint
adchia Apr 18, 2022
05bc6a6
lint
adchia Apr 18, 2022
3964921
lint
adchia Apr 18, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
lint 
Signed-off-by: Danny Chiao <danny@tecton.ai>
  • Loading branch information
@adchia
adchia committed Apr 18, 2022
commit 1e3e5fff558921cf9a48f213fc61127a7b87ecf3
32 changes: 15 additions & 17 deletions docs/reference/feature-servers/python-feature-server.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -171,27 +171,25 @@ curl -X POST "http://localhost:6566/push" -d '{

or equivalently from Python:
```python
import json
import requests
import pandas as pd
from datetime import datetime

event_df = pd.DataFrame.from_dict(
{
"driver_id": [1001],
"event_timestamp": [datetime(2021, 5, 13, 10, 59, 42),],
"created": [datetime(2021, 5, 13, 10, 59, 42),],
"conv_rate": [1.0],
"acc_rate": [1.0],
"avg_daily_trips": [1000],
"string_feature": "test2",
}
)
event_df['event_timestamp'] = event_df['event_timestamp'].astype(str)
event_df['created'] = event_df['created'].astype(str)
event_dict = {
"driver_id": [1001],
"event_timestamp": [str(datetime(2021, 5, 13, 10, 59, 42))],
"created": [str(datetime(2021, 5, 13, 10, 59, 42))],
"conv_rate": [1.0],
"acc_rate": [1.0],
"avg_daily_trips": [1000],
"string_feature": "test2",
}
push_data = {
"push_source_name":"driver_stats_push_source",
"df":event_dict
}
requests.post(
"http://localhost:6566/push",
json={
"push_source_name":"driver_stats_push_source",
"df":event_df.to_dict()
})
data=json.dumps(push_data))
```
5 changes: 3 additions & 2 deletions sdk/python/tests/integration/e2e/test_python_feature_server.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
import contextlib
import json
from datetime import datetime
from typing import List

import pytest
Expand Down Expand Up @@ -72,8 +73,8 @@ def test_push():
"df": {
"location_id": [1],
"temperature": [initial_temp * 100],
"event_timestamp": ["2022-05-13 10:59:42"],
"created": ["2022-05-13 10:59:42"],
"event_timestamp": [str(datetime.utcnow())],
"created": [str(datetime.utcnow())],
},
}
)
Expand Down