Skip to content

feat: Add online_read_async for dynamodb #4244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
franciscojavierarceo merged 16 commits into from
Jun 5, 2024
Merged

feat: Add online_read_async for dynamodb #4244

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
bb0a4fb
add aiobotocore and online_read_async to dynamo read
May 31, 2024
6b178bb
format
May 31, 2024
a19d46d
update test to run on dynamo
May 31, 2024
d7a982f
duck type the table
May 31, 2024
3db88cb
Merge pull request #5 from robhowley/rh-async-dynamo
robhowley May 31, 2024
ee0b634
Merge branch 'feast-dev:master' into master
robhowley May 31, 2024
0217149
update requirements files
May 31, 2024
eeb3929
fix: gotta await
May 31, 2024
c4ba283
just pass full method, not client
May 31, 2024
8c164c3
chore: allow for some duplication to make await cleaner/more obvious
May 31, 2024
a7488e3
fix: client vs resource payloads
May 31, 2024
a1d1ada
fix resource vs client response handling
May 31, 2024
6bd29f7
deserialize client response so that it looks like the table resource …
May 31, 2024
159259b
temp disable due to flakiness in tests
Jun 2, 2024
fc9e603
run linter
Jun 2, 2024
42e98d2
relax to >2,<3
Jun 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: gotta await 
Signed-off-by: robhowley <rhowley@seatgeek.com>
  • Loading branch information
robhowley committed May 31, 2024
commit eeb3929852a4bbf159bf1034b9ba4e1badc49a1c
8 changes: 4 additions & 4 deletions sdk/python/feast/infra/online_stores/dynamodb.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -209,7 +209,7 @@ def online_write_batch(
self._write_batch_non_duplicates(table_instance, data, progress, config)

def _read_batches(
self, online_config, entity_ids, table_name, table_client
self, online_config, entity_ids, table_name, batch_get_item
) -> List[Tuple[Optional[datetime], Optional[Dict[str, ValueProto]]]]:
result: List[Tuple[Optional[datetime], Optional[Dict[str, ValueProto]]]] = []

Expand All @@ -229,7 +229,7 @@ def _read_batches(
"ConsistentRead": online_config.consistent_reads,
}
}
response = table_client.batch_get_item(
response = batch_get_item.batch_get_item(
RequestItems=batch_entity_ids,
)
response = response.get("Responses")
Expand Down Expand Up @@ -297,7 +297,7 @@ def online_read(
online_config,
entity_ids,
table_instance.name,
dynamodb_resource,
dynamodb_resource.batch_get_item,
)

async def online_read_async(
Expand Down Expand Up @@ -337,7 +337,7 @@ async def online_read_async(
online_config,
entity_ids,
_get_table_name(online_config, config, table),
client,
lambda **kwargs: (await client(**kwargs)),
)

def _get_aioboto_session(self):
Expand Down