Skip to content

perf: Parallelize DynamoDB batch reads in sync online_read #6024

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ntkathole merged 6 commits into from
Mar 4, 2026
Merged

perf: Parallelize DynamoDB batch reads in sync online_read #6024

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
6e65f4d
perf: Parallelize DynamoDB batch reads in sync online_read
abhijeet-dhumal Feb 25, 2026
c694ed9
test: add unit tests for DynamoDB parallel batch reads
abhijeet-dhumal Feb 25, 2026
e4a5202
fix: address thread-safety and max_workers issues in parallel DynamoD…
abhijeet-dhumal Feb 25, 2026
342587d
fix: Improve DynamoDB parallel reads: shared client, configurable wor…
abhijeet-dhumal Mar 2, 2026
2dce44b
docs: add max_read_workers config documentation for DynamoDB online s…
abhijeet-dhumal Mar 2, 2026
8ead314
docs: Fix default max worker count in docs
abhijeet-dhumal Mar 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
docs: add max_read_workers config documentation for DynamoDB online s… 
…tore

Signed-off-by: abhijeet-dhumal <abhijeetdhumal652@gmail.com>
  • Loading branch information
@abhijeet-dhumal
abhijeet-dhumal committed Mar 4, 2026
commit 2dce44b4faf42bcd5a1b72f57edda30a1a1e3b82
41 changes: 41 additions & 0 deletions docs/reference/online-stores/dynamodb.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,47 @@ online_store:

The full set of configuration options is available in [DynamoDBOnlineStoreConfig](https://rtd.feast.dev/en/master/#feast.infra.online_stores.dynamodb.DynamoDBOnlineStoreConfig).

## Configuration

Below is a example with performance tuning options:

{% code title="feature_store.yaml" %}
```yaml
project: my_feature_repo
registry: data/registry.db
provider: aws
online_store:
type: dynamodb
region: us-west-2
batch_size: 100
max_read_workers: 10
consistent_reads: false
```
{% endcode %}

### Configuration Options

| Option | Type | Default | Description |
| ------ | ---- | ------- | ----------- |
| `region` | string | | AWS region for DynamoDB |
| `table_name_template` | string | `{project}.{table_name}` | Template for table names |
| `batch_size` | int | `40` | Number of items per BatchGetItem/BatchWriteItem request (max 100) |
Comment thread
devin-ai-integration[bot] marked this conversation as resolved.
Outdated
| `max_read_workers` | int | `10` | Maximum parallel threads for batch read operations. Higher values improve throughput for large batch reads but increase resource usage |
| `consistent_reads` | bool | `false` | Whether to use strongly consistent reads (higher latency, guaranteed latest data) |
| `tags` | dict | `null` | AWS resource tags added to each table |
| `session_based_auth` | bool | `false` | Use AWS session-based client authentication |

### Performance Tuning

**Parallel Batch Reads**: When reading features for many entities, DynamoDB's BatchGetItem is limited to 100 items per request. For 500 entities, this requires 5 batch requests. The `max_read_workers` option controls how many of these batches execute in parallel:

- **Sequential (old behavior)**: 5 batches × 10ms = 50ms total
- **Parallel (with `max_read_workers: 10`)**: 5 batches in parallel ≈ 10ms total

For high-throughput workloads with large entity counts, increase `max_read_workers` (up to 20-30) based on your DynamoDB capacity and network conditions.

**Batch Size**: Increase `batch_size` up to 100 to reduce the number of API calls. However, larger batches may hit DynamoDB's 16MB response limit for tables with large feature values.

## Permissions

Feast requires the following permissions in order to execute commands for DynamoDB online store:
Expand Down