Skip to content

feat: Clickhouse offline store #4725

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
franciscojavierarceo merged 25 commits into from
Mar 12, 2025
Merged

feat: Clickhouse offline store #4725

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
aa2c839
Clickhouse offline store - initial working version
iamhatesz Oct 31, 2024
1d0417e
Remove untested `pull_all_from_table_or_query`
iamhatesz Oct 31, 2024
3af1889
Reorder functions
iamhatesz Oct 31, 2024
5d7f173
Remove commented line
iamhatesz Oct 31, 2024
9d9d24a
Fix frozen mypy errors
iamhatesz Oct 31, 2024
8207c44
mypy fixes; remove online source creator
iamhatesz Oct 31, 2024
7aa45d6
Remove commented code
iamhatesz Oct 31, 2024
803752f
Added docs
iamhatesz Oct 31, 2024
7fffc15
Python 3.9 deps
iamhatesz Oct 31, 2024
6e35db8
Python 3.10 deps
iamhatesz Oct 31, 2024
ca9d795
Python 3.11 deps (updated)
iamhatesz Oct 31, 2024
f8a8356
Remove unused ClickhouseOnlineStoreConfig
iamhatesz Oct 31, 2024
a8aa40b
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Feb 11, 2025
7ce7db1
Regenerate requirements.txt files
iamhatesz Feb 11, 2025
bcb90ca
Lint & format fixes
iamhatesz Feb 11, 2025
27a1e6f
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Mar 6, 2025
80bf5d7
Regenerate requirements.txt files
iamhatesz Mar 6, 2025
53839a8
Add clickhouse to pyproject.toml
iamhatesz Mar 7, 2025
9872944
Fix dependencies
iamhatesz Mar 7, 2025
e8e65b1
Simplify names
iamhatesz Mar 7, 2025
c0f19b2
Skip problematic Clickhouse tests
iamhatesz Mar 7, 2025
2d69427
format & lint
iamhatesz Mar 7, 2025
d5c5083
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Mar 12, 2025
3258903
Post-merge `make lock-python-dependencies-all`
iamhatesz Mar 12, 2025
df6ad54
Pin torch to 2.2.2
iamhatesz Mar 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of… 
…fline-store

# Conflicts:
#	sdk/python/docs/source/feast.infra.online_stores.contrib.rst
#	sdk/python/requirements/py3.10-ci-requirements.txt
#	sdk/python/requirements/py3.10-requirements.txt
#	sdk/python/requirements/py3.11-ci-requirements.txt
#	sdk/python/requirements/py3.11-requirements.txt
#	sdk/python/requirements/py3.9-ci-requirements.txt
#	sdk/python/requirements/py3.9-requirements.txt
#	setup.py
  • Loading branch information
@iamhatesz
iamhatesz committed Feb 11, 2025
commit a8aa40b30a056e28a46938d8b2723988e4c5c171
30 changes: 11 additions & 19 deletions sdk/python/docs/source/feast.infra.online_stores.contrib.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,10 +49,18 @@ feast.infra.online\_stores.contrib.elasticsearch\_repo\_configuration module
:undoc-members:
:show-inheritance:

feast.infra.online\_stores.contrib.faiss\_online\_store module
--------------------------------------------------------------
feast.infra.online\_stores.contrib.qdrant module
-------------------------------------------------------

.. automodule:: feast.infra.online_stores.contrib.faiss_online_store
.. automodule:: feast.infra.online_stores.qdrant_online_store
:members:
:undoc-members:
:show-inheritance:

feast.infra.online\_stores.contrib.qdrant\_repo\_configuration module
----------------------------------------------------------------------------

.. automodule:: feast.infra.online_stores.qdrant_online_store.qdrant_repo_configuration
:members:
:undoc-members:
:show-inheritance:
Expand Down Expand Up @@ -105,22 +113,6 @@ feast.infra.online\_stores.contrib.postgres\_repo\_configuration module
:undoc-members:
:show-inheritance:

feast.infra.online\_stores.contrib.qdrant module
------------------------------------------------

.. automodule:: feast.infra.online_stores.contrib.qdrant
:members:
:undoc-members:
:show-inheritance:

feast.infra.online\_stores.contrib.qdrant\_repo\_configuration module
---------------------------------------------------------------------

.. automodule:: feast.infra.online_stores.contrib.qdrant_repo_configuration
:members:
:undoc-members:
:show-inheritance:

feast.infra.online\_stores.contrib.singlestore\_repo\_configuration module
--------------------------------------------------------------------------

Expand Down
56 changes: 41 additions & 15 deletions sdk/python/requirements/py3.10-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.10-ci-requirements.txt
aiobotocore==2.15.2
# uv pip compile -p 3.10 --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.10-ci-requirements.txt
aiobotocore==2.19.0
# via feast (setup.py)
aiohappyeyeballs==2.4.4
# via aiohttp
Expand Down Expand Up @@ -42,7 +42,11 @@ async-lru==2.0.4
# via jupyterlab
async-property==0.2.2
# via python-keycloak
atpublic==5.0
async-timeout==5.0.1
# via
# aiohttp
# redis
atpublic==5.1
# via ibis-framework
attrs==25.1.0
# via
Expand Down Expand Up @@ -88,7 +92,6 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# elastic-transport
# httpcore
# httpx
Expand All @@ -115,9 +118,7 @@ click==8.1.8
# great-expectations
# pip-tools
# uvicorn
clickhouse-connect==0.8.5
# via feast (setup.py)
cloudpickle==3.1.0
cloudpickle==3.1.1
# via dask
colorama==0.4.6
# via
Expand Down Expand Up @@ -177,6 +178,13 @@ elasticsearch==8.17.1
# via feast (setup.py)
entrypoints==0.4
# via altair
environs==9.5.0
# via pymilvus
exceptiongroup==1.2.2
# via
# anyio
# ipython
# pytest
execnet==2.1.1
# via pytest-xdist
executing==2.2.0
Expand Down Expand Up @@ -329,8 +337,10 @@ idna==3.10
# yarl
imagesize==1.4.1
# via sphinx
importlib-metadata==8.5.0
# via dask
importlib-metadata==8.6.1
# via
# build
# dask
iniconfig==2.0.0
# via pytest
ipykernel==6.29.5
Expand Down Expand Up @@ -425,8 +435,8 @@ kubernetes==20.13.0
# via feast (setup.py)
locket==1.0.0
# via partd
lz4==4.3.3
# via clickhouse-connect
lz4==4.4.3
# via trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -753,7 +763,6 @@ python-keycloak==4.2.2
# via feast (setup.py)
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -919,6 +928,16 @@ tinycss2==1.4.0
# via bleach
toml==0.10.2
# via feast (setup.py)
tomli==2.2.1
# via
# build
# coverage
# jupyterlab
# mypy
# pip-tools
# pytest
# pytest-env
# singlestoredb
tomlkit==0.13.2
# via snowflake-connector-python
toolz==0.12.1
Expand Down Expand Up @@ -991,6 +1010,8 @@ types-urllib3==1.26.25.14
# via types-requests
typing-extensions==4.12.2
# via
# anyio
# async-lru
# azure-core
# azure-identity
# azure-storage-blob
Expand All @@ -1000,16 +1021,22 @@ typing-extensions==4.12.2
# ibis-framework
# ipython
# jwcrypto
# minio
# mistune
# multidict
# mypy
# psycopg
# psycopg-pool
# pydantic
# pydantic-core
# referencing
# rich
# snowflake-connector-python
# sqlalchemy
# testcontainers
# typeguard
tzdata==2024.2
# uvicorn
tzdata==2025.1
# via pandas
tzlocal==5.2
# via
Expand All @@ -1024,7 +1051,6 @@ urllib3==2.3.0
# feast (setup.py)
# aiobotocore
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1081,4 +1107,4 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via clickhouse-connect
# via trino
12 changes: 9 additions & 3 deletions sdk/python/requirements/py3.10-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --system --no-strip-extras setup.py --output-file sdk/python/requirements/py3.10-requirements.txt
# uv pip compile -p 3.10 --system --no-strip-extras setup.py --output-file sdk/python/requirements/py3.10-requirements.txt
annotated-types==0.7.0
# via pydantic
anyio==4.8.0
Expand Down Expand Up @@ -29,7 +29,9 @@ dask[dataframe]==2025.1.0
# via feast (setup.py)
dill==0.3.9
# via feast (setup.py)
fastapi==0.115.3
exceptiongroup==1.2.2
# via anyio
fastapi==0.115.8
# via feast (setup.py)
fsspec==2025.2.0
# via dask
Expand Down Expand Up @@ -133,6 +135,8 @@ tenacity==8.5.0
# via feast (setup.py)
toml==0.10.2
# via feast (setup.py)
tomli==2.2.1
# via mypy
toolz==1.0.0
# via
# dask
Expand All @@ -143,14 +147,16 @@ typeguard==4.4.1
# via feast (setup.py)
typing-extensions==4.12.2
# via
# anyio
# fastapi
# mypy
# pydantic
# pydantic-core
# referencing
# sqlalchemy
# typeguard
tzdata==2024.2
# uvicorn
tzdata==2025.1
# via pandas
urllib3==2.3.0
# via requests
Expand Down
26 changes: 14 additions & 12 deletions sdk/python/requirements/py3.11-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.11-ci-requirements.txt
aiobotocore==2.15.2
# uv pip compile -p 3.11 --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.11-ci-requirements.txt
aiobotocore==2.19.0
# via feast (setup.py)
aiohappyeyeballs==2.4.4
# via aiohttp
Expand Down Expand Up @@ -42,7 +42,9 @@ async-lru==2.0.4
# via jupyterlab
async-property==0.2.2
# via python-keycloak
atpublic==5.0
async-timeout==5.0.1
# via redis
atpublic==5.1
# via ibis-framework
attrs==25.1.0
# via
Expand Down Expand Up @@ -88,7 +90,6 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# elastic-transport
# httpcore
# httpx
Expand All @@ -115,9 +116,7 @@ click==8.1.8
# great-expectations
# pip-tools
# uvicorn
clickhouse-connect==0.8.5
# via feast (setup.py)
cloudpickle==3.1.0
cloudpickle==3.1.1
# via dask
colorama==0.4.6
# via
Expand Down Expand Up @@ -331,6 +330,8 @@ idna==3.10
# yarl
imagesize==1.4.1
# via sphinx
importlib-metadata==8.6.1
# via dask
iniconfig==2.0.0
# via pytest
ipykernel==6.29.5
Expand Down Expand Up @@ -425,8 +426,8 @@ kubernetes==20.13.0
# via feast (setup.py)
locket==1.0.0
# via partd
lz4==4.3.3
# via clickhouse-connect
lz4==4.4.3
# via trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -753,7 +754,6 @@ python-keycloak==4.2.2
# via feast (setup.py)
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -999,6 +999,7 @@ typing-extensions==4.12.2
# fastapi
# great-expectations
# ibis-framework
# ipython
# jwcrypto
# minio
# mypy
Expand Down Expand Up @@ -1026,7 +1027,6 @@ urllib3==2.3.0
# feast (setup.py)
# aiobotocore
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1080,5 +1080,7 @@ xmltodict==0.14.2
# via moto
yarl==1.18.3
# via aiohttp
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via clickhouse-connect
# via trino
8 changes: 6 additions & 2 deletions sdk/python/requirements/py3.11-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --system --no-strip-extras setup.py --output-file sdk/python/requirements/py3.11-requirements.txt
# uv pip compile -p 3.11 --system --no-strip-extras setup.py --output-file sdk/python/requirements/py3.11-requirements.txt
annotated-types==0.7.0
# via pydantic
anyio==4.8.0
Expand Down Expand Up @@ -45,7 +45,9 @@ idna==3.10
# via
# anyio
# requests
jinja2==3.1.4
importlib-metadata==8.6.1
# via dask
jinja2==3.1.5
# via feast (setup.py)
jsonschema==4.23.0
# via feast (setup.py)
Expand Down Expand Up @@ -165,3 +167,5 @@ watchfiles==1.0.4
# via uvicorn
websockets==14.2
# via uvicorn
zipp==3.21.0
# via importlib-metadata
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.