Skip to content

feat: Add OnlineStore for MongoDB #6025

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ntkathole merged 47 commits into from
Mar 10, 2026
+8,296 −89
Merged

feat: Add OnlineStore for MongoDB #6025

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
47 commits
Select commit Hold shift + click to select a range
67d79f7
Initial commit on INTPYTHON-297-MongoDB-Feast-Integration
caseyclements Jan 20, 2026
4d0f066
Added mongodb to project.optional-dependencies in pyproject.toml. Now…
caseyclements Jan 20, 2026
18b16b9
Checkpoint. Passing tests.unit.online_store.test_online_writes.TestOn…
caseyclements Feb 12, 2026
a066a99
Handle Nan in dfs for test_online_writes.py. Now all tests in the mod…
caseyclements Feb 13, 2026
7c17759
Removed suffix of implementation: mongodb_openai -> mongodb
caseyclements Feb 13, 2026
c463f4a
Moved MongoDBOnlineStore to feast.infra.online_store.contrib
caseyclements Feb 19, 2026
a6db5c7
Formatting
caseyclements Feb 19, 2026
9ed89f0
Refactor online_read that converts bson to proto. Left two methods fo…
caseyclements Feb 19, 2026
40e5ea5
Remove file added early during discovery
caseyclements Feb 19, 2026
67f2c99
Formatting
caseyclements Feb 19, 2026
35b66f0
Added version of test that uses testcontainers mongodb instead of ass…
caseyclements Feb 20, 2026
a526a0c
Create Make target for universal tests
caseyclements Feb 20, 2026
b0d57f5
Cleanup
caseyclements Feb 20, 2026
5a94a11
Removed temporary integration tests requiring one to spin up own mong…
caseyclements Feb 20, 2026
46898b5
Format
caseyclements Feb 20, 2026
0356261
Typing
caseyclements Feb 20, 2026
960881d
Implemented ASync API and Tests
caseyclements Feb 21, 2026
52948a2
Removed offline store stubs. The first PR will only contain the Onlin…
caseyclements Feb 23, 2026
f2e5dff
Moved mongodb_online_store out of cobtrib package.
caseyclements Feb 23, 2026
7f5a192
Add documentation.
caseyclements Feb 24, 2026
619fdd3
Cleanups and docstrings
caseyclements Feb 24, 2026
1f46d8e
Fixed another reference to contrib dir
caseyclements Feb 24, 2026
de6b103
Typos
caseyclements Feb 25, 2026
7e2a80d
Made _convert_raw_docs_to_proto staticmethods private
caseyclements Feb 25, 2026
8a82e74
After benchmarking two alogithm for conevrting read results from bson…
caseyclements Feb 25, 2026
f09faa0
Add extra unit tests
caseyclements Feb 25, 2026
0ba503c
Formatting
caseyclements Feb 25, 2026
6b96c0e
Fixes in pyproject.toml
caseyclements Feb 27, 2026
7c3874b
Fixed Detect secrets false positives.
caseyclements Mar 2, 2026
49022e3
Update sdk/python/feast/infra/online_stores/mongodb_online_store/mong…
caseyclements Mar 2, 2026
a2c493e
Fix CI: guard pymongo imports and skip test module when pymongo unava…
caseyclements Mar 3, 2026
dcb9072
Fix: return (None, None) when entity doc exists but feature view was …
caseyclements Mar 3, 2026
bcb63aa
Update pixi.lock after adding mongodb optional dependency to pyprojec…
caseyclements Mar 3, 2026
1cb84dc
fix: catch FeastExtrasDependencyImportError in doctest runner
caseyclements Mar 4, 2026
c02eebf
fix: update PYTEST_PLUGINS path for mongodb online store tests
caseyclements Mar 4, 2026
3eb6107
fix: broaden import exception handling in doctest runner to catch Typ…
caseyclements Mar 4, 2026
01d2e4c
fix: pass onerror to pkgutil.walk_packages to suppress non-ImportErro…
caseyclements Mar 4, 2026
156f17b
fix: update stale tests.integration.feature_repos imports to tests.un…
caseyclements Mar 4, 2026
762d17b
feat: add mongodb to ValidOnlineStoreDBStorePersistenceTypes in feast…
caseyclements Mar 5, 2026
6147c87
feat: add Feast driver metadata to MongoDB client instantiations
caseyclements Mar 5, 2026
1492a1e
docs: update MongoDB online store status from alpha to preview
caseyclements Mar 5, 2026
0d80772
fix: add mongodb to kubebuilder Enum annotations for OnlineStoreDBSto…
caseyclements Mar 5, 2026
7563f11
Update +GOLANGCI_LINT_VERSION to fix upstream issue golang/go#74462
caseyclements Mar 6, 2026
26ad3bb
fix: raise ValueError in _get_client_async for invalid config type, c…
caseyclements Mar 6, 2026
2f92af9
fix: Added mongodb to operator yamls
ntkathole Mar 9, 2026
577f2a7
Small change suggested by ntkathole
caseyclements Mar 9, 2026
e761e10
Factor out write logic into utility function making sync/async essent…
caseyclements Mar 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
156 changes: 78 additions & 78 deletions .secrets.baseline
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -934,7 +934,7 @@
"filename": "infra/feast-operator/api/v1/featurestore_types.go",
"hashed_secret": "44e17306b837162269a410204daaa5ecee4ec22c",
"is_verified": false,
"line_number": 725
"line_number": 726
}
],
"infra/feast-operator/api/v1/zz_generated.deepcopy.go": [
Expand Down Expand Up @@ -966,7 +966,7 @@
"filename": "infra/feast-operator/api/v1alpha1/featurestore_types.go",
"hashed_secret": "44e17306b837162269a410204daaa5ecee4ec22c",
"is_verified": false,
"line_number": 646
"line_number": 647
}
],
"infra/feast-operator/api/v1alpha1/zz_generated.deepcopy.go": [
Expand Down Expand Up @@ -1311,81 +1311,6 @@
"line_number": 1
}
],
"sdk/python/tests/universal/feature_repos/repo_configuration.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/repo_configuration.py",
"hashed_secret": "d90e76ef629fb00c95f4e84fec29fbda111e2392",
"is_verified": false,
"line_number": 452
},
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/repo_configuration.py",
"hashed_secret": "5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8",
"is_verified": false,
"line_number": 454
}
],
"sdk/python/tests/universal/feature_repos/universal/data_sources/file.py": [
{
"type": "Base64 High Entropy String",
"filename": "sdk/python/tests/universal/feature_repos/universal/data_sources/file.py",
"hashed_secret": "d70eab08607a4d05faa2d0d6647206599e9abc65",
"is_verified": false,
"line_number": 257
},
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/data_sources/file.py",
"hashed_secret": "d70eab08607a4d05faa2d0d6647206599e9abc65",
"is_verified": false,
"line_number": 257
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/couchbase.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/couchbase.py",
"hashed_secret": "5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8",
"is_verified": false,
"line_number": 29
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/mysql.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/mysql.py",
"hashed_secret": "a94a8fe5ccb19ba61c4c0873d391e987982fbbd3",
"is_verified": false,
"line_number": 27
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/postgres.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/postgres.py",
"hashed_secret": "95433727ea51026e1e0dc8deadaabd4a3baaaaf4",
"is_verified": false,
"line_number": 19
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/singlestore.py": [
{
"type": "Base64 High Entropy String",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/singlestore.py",
"hashed_secret": "6f7c6dea79de6f298be425ade30f5afbbb6f8047",
"is_verified": false,
"line_number": 24
},
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/singlestore.py",
"hashed_secret": "a94a8fe5ccb19ba61c4c0873d391e987982fbbd3",
"is_verified": false,
"line_number": 37
}
],
"sdk/python/tests/integration/offline_store/test_s3_custom_endpoint.py": [
{
"type": "AWS Access Key",
Expand Down Expand Up @@ -1529,6 +1454,81 @@
"line_number": 31
}
],
"sdk/python/tests/universal/feature_repos/repo_configuration.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/repo_configuration.py",
"hashed_secret": "d90e76ef629fb00c95f4e84fec29fbda111e2392",
"is_verified": false,
"line_number": 452
},
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/repo_configuration.py",
"hashed_secret": "5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8",
"is_verified": false,
"line_number": 454
}
],
"sdk/python/tests/universal/feature_repos/universal/data_sources/file.py": [
{
"type": "Base64 High Entropy String",
"filename": "sdk/python/tests/universal/feature_repos/universal/data_sources/file.py",
"hashed_secret": "d70eab08607a4d05faa2d0d6647206599e9abc65",
"is_verified": false,
"line_number": 257
},
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/data_sources/file.py",
"hashed_secret": "d70eab08607a4d05faa2d0d6647206599e9abc65",
"is_verified": false,
"line_number": 257
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/couchbase.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/couchbase.py",
"hashed_secret": "5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8",
"is_verified": false,
"line_number": 29
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/mysql.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/mysql.py",
"hashed_secret": "a94a8fe5ccb19ba61c4c0873d391e987982fbbd3",
"is_verified": false,
"line_number": 27
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/postgres.py": [
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/postgres.py",
"hashed_secret": "95433727ea51026e1e0dc8deadaabd4a3baaaaf4",
"is_verified": false,
"line_number": 19
}
],
"sdk/python/tests/universal/feature_repos/universal/online_store/singlestore.py": [
{
"type": "Base64 High Entropy String",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/singlestore.py",
"hashed_secret": "6f7c6dea79de6f298be425ade30f5afbbb6f8047",
"is_verified": false,
"line_number": 24
},
{
"type": "Secret Keyword",
"filename": "sdk/python/tests/universal/feature_repos/universal/online_store/singlestore.py",
"hashed_secret": "a94a8fe5ccb19ba61c4c0873d391e987982fbbd3",
"is_verified": false,
"line_number": 37
}
],
"sdk/python/tests/utils/auth_permissions_util.py": [
{
"type": "Secret Keyword",
Expand All @@ -1539,5 +1539,5 @@
}
]
},
"generated_at": "2026-03-03T05:01:02Z"
"generated_at": "2026-03-05T15:25:10Z"
}
19 changes: 19 additions & 0 deletions Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -535,6 +535,25 @@ test-python-universal-elasticsearch-online: ## Run Python Elasticsearch online s
not test_snowflake" \
sdk/python/tests

test-python-universal-mongodb-online: ## Run Python MongoDB online store integration tests
PYTHONPATH='.' \
FULL_REPO_CONFIGS_MODULE=sdk.python.feast.infra.online_stores.mongodb_online_store.mongodb_repo_configuration \
PYTEST_PLUGINS=sdk.python.tests.universal.feature_repos.universal.online_store.mongodb \
python -m pytest -n 8 --integration \
-k "not test_universal_cli and \
not test_go_feature_server and \
not test_feature_logging and \
not test_reorder_columns and \
not test_logged_features_validation and \
not test_lambda_materialization_consistency and \
not test_offline_write and \
not test_push_features_to_offline_store and \
not gcs_registry and \
not s3_registry and \
not test_universal_types and \
not test_snowflake" \
sdk/python/tests

test-python-universal-milvus-online: ## Run Python Milvus online store integration tests
PYTHONPATH='.' \
FULL_REPO_CONFIGS_MODULE=sdk.python.feast.infra.online_stores.milvus_online_store.milvus_repo_configuration \
Expand Down
1 change: 1 addition & 0 deletions docs/SUMMARY.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,7 @@
* [ScyllaDB](reference/online-stores/scylladb.md)
* [SingleStore](reference/online-stores/singlestore.md)
* [Milvus](reference/online-stores/milvus.md)
* [MongoDB](reference/online-stores/mongodb.md)
* [Registries](reference/registries/README.md)
* [Local](reference/registries/local.md)
* [S3](reference/registries/s3.md)
Expand Down
4 changes: 4 additions & 0 deletions docs/reference/online-stores/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,10 @@ Please see [Online Store](../../getting-started/components/online-store.md) for
[mysql.md](mysql.md)
{% endcontent-ref %}

{% content-ref url="mongodb.md" %}
[mongodb.md](mongodb.md)
{% endcontent-ref %}

{% content-ref url="hazelcast.md" %}
[hazelcast.md](hazelcast.md)
{% endcontent-ref %}
Expand Down
Loading
Loading