Skip to content

chore: Update python dependencies and use the latest pip #3519

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
feast-ci-bot merged 3 commits into from
Mar 4, 2023
Merged

chore: Update python dependencies and use the latest pip #3519

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
453622b
chore: Update python dependencies and use the latest pip
achals Mar 3, 2023
14067ae
rebase
achals Mar 3, 2023
a628a64
dynamodb2 -> dynamodb
achals Mar 3, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/java_master_only.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ jobs:
go-version: 1.18.0
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/java_pr.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ jobs:
go-version: 1.18.0
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/linter.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ jobs:
go-version: 1.18.0
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down Expand Up @@ -70,7 +70,7 @@ jobs:
python-version: "3.8"
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Install apache-arrow on ubuntu
run: |
sudo apt update
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/master_only.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@ jobs:
run: aws sts get-caller-identity
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/nightly-ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -164,7 +164,7 @@ jobs:
run: aws sts get-caller-identity
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/pr_integration_tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -140,7 +140,7 @@ jobs:
run: aws sts get-caller-identity
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/pr_local_integration_tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ jobs:
architecture: x64
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=21.3.1,<22.1"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/unit_tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ jobs:
PATH=$PATH:/usr/local/mysql/bin
- name: Upgrade pip version
run: |
pip install --upgrade "pip>=22.1,<23"
pip install --upgrade pip
- name: Get pip cache dir
id: pip-cache
run: |
Expand Down
11 changes: 7 additions & 4 deletions sdk/python/requirements/py3.10-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,10 @@ anyio==3.6.2
# watchfiles
appdirs==1.4.4
# via fissix
appnope==0.1.3
# via
# ipykernel
# ipython
argon2-cffi==21.3.0
# via
# jupyter-server
Expand Down Expand Up @@ -456,8 +460,8 @@ makefun==1.15.1
markupsafe==2.1.2
# via
# jinja2
# moto
# nbconvert
# werkzeug
marshmallow==3.19.0
# via great-expectations
matplotlib-inline==0.1.6
Expand All @@ -478,7 +482,7 @@ mock==2.0.0
# via feast (setup.py)
moreorless==0.4.0
# via bowler
moto==3.1.18
moto==4.1.3
# via feast (setup.py)
msal==1.21.0
# via
Expand Down Expand Up @@ -759,7 +763,6 @@ python-json-logger==2.0.7
pytz==2022.7.1
# via
# great-expectations
# moto
# pandas
# snowflake-connector-python
# trino
Expand Down Expand Up @@ -1040,7 +1043,7 @@ websocket-client==1.5.1
# kubernetes
websockets==10.4
# via uvicorn
werkzeug==2.1.2
werkzeug==2.2.3
# via moto
wheel==0.38.4
# via pip-tools
Expand Down
11 changes: 7 additions & 4 deletions sdk/python/requirements/py3.8-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,10 @@ anyio==3.6.2
# watchfiles
appdirs==1.4.4
# via fissix
appnope==0.1.3
# via
# ipykernel
# ipython
argon2-cffi==21.3.0
# via
# jupyter-server
Expand Down Expand Up @@ -466,8 +470,8 @@ makefun==1.15.1
markupsafe==2.1.2
# via
# jinja2
# moto
# nbconvert
# werkzeug
marshmallow==3.19.0
# via great-expectations
matplotlib-inline==0.1.6
Expand All @@ -488,7 +492,7 @@ mock==2.0.0
# via feast (setup.py)
moreorless==0.4.0
# via bowler
moto==3.1.18
moto==4.1.3
# via feast (setup.py)
msal==1.21.0
# via
Expand Down Expand Up @@ -772,7 +776,6 @@ pytz==2022.7.1
# via
# babel
# great-expectations
# moto
# pandas
# snowflake-connector-python
# trino
Expand Down Expand Up @@ -1058,7 +1061,7 @@ websocket-client==1.5.1
# kubernetes
websockets==10.4
# via uvicorn
werkzeug==2.1.2
werkzeug==2.2.3
# via moto
wheel==0.38.4
# via pip-tools
Expand Down
11 changes: 7 additions & 4 deletions sdk/python/requirements/py3.9-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,10 @@ anyio==3.6.2
# watchfiles
appdirs==1.4.4
# via fissix
appnope==0.1.3
# via
# ipykernel
# ipython
argon2-cffi==21.3.0
# via
# jupyter-server
Expand Down Expand Up @@ -460,8 +464,8 @@ makefun==1.15.1
markupsafe==2.1.2
# via
# jinja2
# moto
# nbconvert
# werkzeug
marshmallow==3.19.0
# via great-expectations
matplotlib-inline==0.1.6
Expand All @@ -482,7 +486,7 @@ mock==2.0.0
# via feast (setup.py)
moreorless==0.4.0
# via bowler
moto==3.1.18
moto==4.1.3
# via feast (setup.py)
msal==1.21.0
# via
Expand Down Expand Up @@ -763,7 +767,6 @@ python-json-logger==2.0.7
pytz==2022.7.1
# via
# great-expectations
# moto
# pandas
# snowflake-connector-python
# trino
Expand Down Expand Up @@ -1049,7 +1052,7 @@ websocket-client==1.5.1
# kubernetes
websockets==10.4
# via uvicorn
werkzeug==2.1.2
werkzeug==2.2.3
# via moto
wheel==0.38.4
# via pip-tools
Expand Down
16 changes: 8 additions & 8 deletions sdk/python/tests/unit/infra/online_store/test_dynamodb_online_store.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

import boto3
import pytest
from moto import mock_dynamodb2
from moto import mock_dynamodb

from feast.infra.offline_stores.file import FileOfflineStoreConfig
from feast.infra.online_stores.dynamodb import (
Expand Down Expand Up @@ -159,7 +159,7 @@ def test_dynamodb_table_dynamodb_resource():
assert dynamodb_resource.meta.client.meta.endpoint_url == endpoint_url


@mock_dynamodb2
@mock_dynamodb
@pytest.mark.parametrize("n_samples", [5, 50, 100])
def test_dynamodb_online_store_online_read(
repo_config, dynamodb_online_store, n_samples
Expand All @@ -180,7 +180,7 @@ def test_dynamodb_online_store_online_read(
assert [item[1] for item in returned_items] == list(features)


@mock_dynamodb2
@mock_dynamodb
@pytest.mark.parametrize("n_samples", [5, 50, 100])
def test_dynamodb_online_store_online_write_batch(
repo_config, dynamodb_online_store, n_samples
Expand All @@ -207,7 +207,7 @@ def test_dynamodb_online_store_online_write_batch(
assert [item[1] for item in stored_items] == list(features)


@mock_dynamodb2
@mock_dynamodb
def test_dynamodb_online_store_update(repo_config, dynamodb_online_store):
"""Test DynamoDBOnlineStore update method."""
# create dummy table to keep
Expand Down Expand Up @@ -236,7 +236,7 @@ def test_dynamodb_online_store_update(repo_config, dynamodb_online_store):
assert existing_tables[0] == f"test_aws.{db_table_keep_name}"


@mock_dynamodb2
@mock_dynamodb
def test_dynamodb_online_store_teardown(repo_config, dynamodb_online_store):
"""Test DynamoDBOnlineStore teardown method."""
db_table_delete_name_one = f"{TABLE_NAME}_delete_teardown_1"
Expand All @@ -262,7 +262,7 @@ def test_dynamodb_online_store_teardown(repo_config, dynamodb_online_store):
assert len(existing_tables) == 0


@mock_dynamodb2
@mock_dynamodb
def test_dynamodb_online_store_online_read_unknown_entity(
repo_config, dynamodb_online_store
):
Expand Down Expand Up @@ -301,7 +301,7 @@ def test_dynamodb_online_store_online_read_unknown_entity(
assert returned_items[pos] == (None, None)


@mock_dynamodb2
@mock_dynamodb
def test_write_batch_non_duplicates(repo_config, dynamodb_online_store):
"""Test DynamoDBOnline Store deduplicate write batch request items."""
dynamodb_tbl = f"{TABLE_NAME}_batch_non_duplicates"
Expand All @@ -321,7 +321,7 @@ def test_write_batch_non_duplicates(repo_config, dynamodb_online_store):
assert len(returned_items) == len(data)


@mock_dynamodb2
@mock_dynamodb
def test_dynamodb_online_store_online_read_unknown_entity_end_of_batch(
repo_config, dynamodb_online_store
):
Expand Down
2 changes: 1 addition & 1 deletion setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -156,7 +156,7 @@
"grpcio-testing>=1.47.0",
"minio==7.1.0",
"mock==2.0.0",
"moto<4",
"moto",
"mypy>=0.981,<0.990",
"mypy-protobuf==3.1",
"avro==1.10.0",
Expand Down