Skip to content

feat: Clickhouse offline store #4725

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
franciscojavierarceo merged 25 commits into from
Mar 12, 2025
Merged

feat: Clickhouse offline store #4725

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
aa2c839
Clickhouse offline store - initial working version
iamhatesz Oct 31, 2024
1d0417e
Remove untested `pull_all_from_table_or_query`
iamhatesz Oct 31, 2024
3af1889
Reorder functions
iamhatesz Oct 31, 2024
5d7f173
Remove commented line
iamhatesz Oct 31, 2024
9d9d24a
Fix frozen mypy errors
iamhatesz Oct 31, 2024
8207c44
mypy fixes; remove online source creator
iamhatesz Oct 31, 2024
7aa45d6
Remove commented code
iamhatesz Oct 31, 2024
803752f
Added docs
iamhatesz Oct 31, 2024
7fffc15
Python 3.9 deps
iamhatesz Oct 31, 2024
6e35db8
Python 3.10 deps
iamhatesz Oct 31, 2024
ca9d795
Python 3.11 deps (updated)
iamhatesz Oct 31, 2024
f8a8356
Remove unused ClickhouseOnlineStoreConfig
iamhatesz Oct 31, 2024
a8aa40b
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Feb 11, 2025
7ce7db1
Regenerate requirements.txt files
iamhatesz Feb 11, 2025
bcb90ca
Lint & format fixes
iamhatesz Feb 11, 2025
27a1e6f
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Mar 6, 2025
80bf5d7
Regenerate requirements.txt files
iamhatesz Mar 6, 2025
53839a8
Add clickhouse to pyproject.toml
iamhatesz Mar 7, 2025
9872944
Fix dependencies
iamhatesz Mar 7, 2025
e8e65b1
Simplify names
iamhatesz Mar 7, 2025
c0f19b2
Skip problematic Clickhouse tests
iamhatesz Mar 7, 2025
2d69427
format & lint
iamhatesz Mar 7, 2025
d5c5083
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Mar 12, 2025
3258903
Post-merge `make lock-python-dependencies-all`
iamhatesz Mar 12, 2025
df6ad54
Pin torch to 2.2.2
iamhatesz Mar 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Regenerate requirements.txt files 
Signed-off-by: Tomasz Wrona <tomasz@cast.ai>
  • Loading branch information
@iamhatesz
iamhatesz committed Feb 11, 2025
commit 7ce7db130df55ad32f30085e5cf76d73431be20c
29 changes: 19 additions & 10 deletions sdk/python/requirements/py3.10-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# uv pip compile -p 3.10 --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.10-ci-requirements.txt
aiobotocore==2.19.0
# via feast (setup.py)
aiohappyeyeballs==2.4.4
aiohappyeyeballs==2.4.6
# via aiohttp
aiohttp==3.11.12
# via aiobotocore
Expand Down Expand Up @@ -67,7 +67,7 @@ babel==2.17.0
# sphinx
beautifulsoup4==4.13.3
# via nbconvert
bigtree==0.23.1
bigtree==0.24.0
# via feast (setup.py)
bleach[css]==6.2.0
# via nbconvert
Expand All @@ -92,6 +92,7 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# elastic-transport
# httpcore
# httpx
Expand All @@ -118,6 +119,8 @@ click==8.1.8
# great-expectations
# pip-tools
# uvicorn
clickhouse-connect==0.8.15
# via feast (setup.py)
cloudpickle==3.1.1
# via dask
colorama==0.4.6
Expand All @@ -130,7 +133,7 @@ comm==0.2.2
# ipywidgets
couchbase==4.3.2
# via feast (setup.py)
coverage[toml]==7.6.10
coverage[toml]==7.6.12
# via pytest-cov
cryptography==43.0.3
# via
Expand All @@ -146,7 +149,7 @@ cryptography==43.0.3
# snowflake-connector-python
# types-pyopenssl
# types-redis
cython==3.0.11
cython==3.0.12
# via thriftpy2
dask[dataframe]==2025.1.0
# via feast (setup.py)
Expand Down Expand Up @@ -325,7 +328,7 @@ ibis-framework[duckdb]==9.5.0
# ibis-substrait
ibis-substrait==4.0.1
# via feast (setup.py)
identify==2.6.6
identify==2.6.7
# via pre-commit
idna==3.10
# via
Expand Down Expand Up @@ -436,7 +439,9 @@ kubernetes==20.13.0
locket==1.0.0
# via partd
lz4==4.4.3
# via trino
# via
# clickhouse-connect
# trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -573,7 +578,7 @@ pbr==6.1.1
# via mock
pexpect==4.9.0
# via ipython
pip==25.0
pip==25.0.1
# via pip-tools
pip-tools==7.4.1
# via feast (setup.py)
Expand Down Expand Up @@ -763,6 +768,7 @@ python-keycloak==4.2.2
# via feast (setup.py)
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -843,7 +849,7 @@ ruamel-yaml==0.17.40
# via great-expectations
ruamel-yaml-clib==0.2.12
# via ruamel-yaml
ruff==0.9.5
ruff==0.9.6
# via feast (setup.py)
s3transfer==0.11.2
# via boto3
Expand Down Expand Up @@ -1000,7 +1006,7 @@ types-redis==4.6.0.20241004
# via feast (setup.py)
types-requests==2.30.0.0
# via feast (setup.py)
types-setuptools==75.8.0.20250110
types-setuptools==75.8.0.20250210
# via
# feast (setup.py)
# types-cffi
Expand Down Expand Up @@ -1051,6 +1057,7 @@ urllib3==2.3.0
# feast (setup.py)
# aiobotocore
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1107,4 +1114,6 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via trino
# via
# clickhouse-connect
# trino
2 changes: 1 addition & 1 deletion sdk/python/requirements/py3.10-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ attrs==25.1.0
# via
# jsonschema
# referencing
bigtree==0.23.1
bigtree==0.24.0
# via feast (setup.py)
certifi==2025.1.31
# via requests
Expand Down
29 changes: 19 additions & 10 deletions sdk/python/requirements/py3.11-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# uv pip compile -p 3.11 --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.11-ci-requirements.txt
aiobotocore==2.19.0
# via feast (setup.py)
aiohappyeyeballs==2.4.4
aiohappyeyeballs==2.4.6
# via aiohttp
aiohttp==3.11.12
# via aiobotocore
Expand Down Expand Up @@ -65,7 +65,7 @@ babel==2.17.0
# sphinx
beautifulsoup4==4.13.3
# via nbconvert
bigtree==0.23.1
bigtree==0.24.0
# via feast (setup.py)
bleach[css]==6.2.0
# via nbconvert
Expand All @@ -90,6 +90,7 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# elastic-transport
# httpcore
# httpx
Expand All @@ -116,6 +117,8 @@ click==8.1.8
# great-expectations
# pip-tools
# uvicorn
clickhouse-connect==0.8.15
# via feast (setup.py)
cloudpickle==3.1.1
# via dask
colorama==0.4.6
Expand All @@ -128,7 +131,7 @@ comm==0.2.2
# ipywidgets
couchbase==4.3.2
# via feast (setup.py)
coverage[toml]==7.6.10
coverage[toml]==7.6.12
# via pytest-cov
cryptography==43.0.3
# via
Expand All @@ -144,7 +147,7 @@ cryptography==43.0.3
# snowflake-connector-python
# types-pyopenssl
# types-redis
cython==3.0.11
cython==3.0.12
# via thriftpy2
dask[dataframe]==2025.1.0
# via feast (setup.py)
Expand Down Expand Up @@ -318,7 +321,7 @@ ibis-framework[duckdb]==9.5.0
# ibis-substrait
ibis-substrait==4.0.1
# via feast (setup.py)
identify==2.6.6
identify==2.6.7
# via pre-commit
idna==3.10
# via
Expand Down Expand Up @@ -427,7 +430,9 @@ kubernetes==20.13.0
locket==1.0.0
# via partd
lz4==4.4.3
# via trino
# via
# clickhouse-connect
# trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -564,7 +569,7 @@ pbr==6.1.1
# via mock
pexpect==4.9.0
# via ipython
pip==25.0
pip==25.0.1
# via pip-tools
pip-tools==7.4.1
# via feast (setup.py)
Expand Down Expand Up @@ -754,6 +759,7 @@ python-keycloak==4.2.2
# via feast (setup.py)
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -834,7 +840,7 @@ ruamel-yaml==0.17.40
# via great-expectations
ruamel-yaml-clib==0.2.12
# via ruamel-yaml
ruff==0.9.5
ruff==0.9.6
# via feast (setup.py)
s3transfer==0.11.2
# via boto3
Expand Down Expand Up @@ -981,7 +987,7 @@ types-redis==4.6.0.20241004
# via feast (setup.py)
types-requests==2.30.0.0
# via feast (setup.py)
types-setuptools==75.8.0.20250110
types-setuptools==75.8.0.20250210
# via
# feast (setup.py)
# types-cffi
Expand Down Expand Up @@ -1027,6 +1033,7 @@ urllib3==2.3.0
# feast (setup.py)
# aiobotocore
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1083,4 +1090,6 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via trino
# via
# clickhouse-connect
# trino
2 changes: 1 addition & 1 deletion sdk/python/requirements/py3.11-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ attrs==25.1.0
# via
# jsonschema
# referencing
bigtree==0.23.1
bigtree==0.24.0
# via feast (setup.py)
certifi==2025.1.31
# via requests
Expand Down
29 changes: 19 additions & 10 deletions sdk/python/requirements/py3.9-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# uv pip compile -p 3.9 --system --no-strip-extras setup.py --extra ci --output-file sdk/python/requirements/py3.9-ci-requirements.txt
aiobotocore==2.19.0
# via feast (setup.py)
aiohappyeyeballs==2.4.4
aiohappyeyeballs==2.4.6
# via aiohttp
aiohttp==3.11.12
# via aiobotocore
Expand Down Expand Up @@ -69,7 +69,7 @@ beautifulsoup4==4.13.3
# via nbconvert
bidict==0.23.1
# via ibis-framework
bigtree==0.23.1
bigtree==0.24.0
# via feast (setup.py)
bleach[css]==6.2.0
# via nbconvert
Expand All @@ -94,6 +94,7 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# elastic-transport
# httpcore
# httpx
Expand All @@ -120,6 +121,8 @@ click==8.1.8
# great-expectations
# pip-tools
# uvicorn
clickhouse-connect==0.8.15
# via feast (setup.py)
cloudpickle==3.1.1
# via dask
colorama==0.4.6
Expand All @@ -132,7 +135,7 @@ comm==0.2.2
# ipywidgets
couchbase==4.3.2
# via feast (setup.py)
coverage[toml]==7.6.10
coverage[toml]==7.6.12
# via pytest-cov
cryptography==43.0.3
# via
Expand All @@ -148,7 +151,7 @@ cryptography==43.0.3
# snowflake-connector-python
# types-pyopenssl
# types-redis
cython==3.0.11
cython==3.0.12
# via thriftpy2
dask[dataframe]==2024.8.0
# via
Expand Down Expand Up @@ -331,7 +334,7 @@ ibis-framework[duckdb]==9.0.0
# ibis-substrait
ibis-substrait==4.0.1
# via feast (setup.py)
identify==2.6.6
identify==2.6.7
# via pre-commit
idna==3.10
# via
Expand Down Expand Up @@ -449,7 +452,9 @@ kubernetes==20.13.0
locket==1.0.0
# via partd
lz4==4.4.3
# via trino
# via
# clickhouse-connect
# trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -586,7 +591,7 @@ pbr==6.1.1
# via mock
pexpect==4.9.0
# via ipython
pip==25.0
pip==25.0.1
# via pip-tools
pip-tools==7.4.1
# via feast (setup.py)
Expand Down Expand Up @@ -776,6 +781,7 @@ python-keycloak==4.2.2
# via feast (setup.py)
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -856,7 +862,7 @@ ruamel-yaml==0.17.40
# via great-expectations
ruamel-yaml-clib==0.2.12
# via ruamel-yaml
ruff==0.9.5
ruff==0.9.6
# via feast (setup.py)
s3transfer==0.11.2
# via boto3
Expand Down Expand Up @@ -1013,7 +1019,7 @@ types-redis==4.6.0.20241004
# via feast (setup.py)
types-requests==2.30.0.0
# via feast (setup.py)
types-setuptools==75.8.0.20250110
types-setuptools==75.8.0.20250210
# via
# feast (setup.py)
# types-cffi
Expand Down Expand Up @@ -1067,6 +1073,7 @@ urllib3==1.26.20
# feast (setup.py)
# aiobotocore
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1124,4 +1131,6 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via trino
# via
# clickhouse-connect
# trino
2 changes: 1 addition & 1 deletion sdk/python/requirements/py3.9-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ attrs==25.1.0
# via
# jsonschema
# referencing
bigtree==0.23.1
bigtree==0.24.0
# via feast (setup.py)
certifi==2025.1.31
# via requests
Expand Down