Skip to content

Feast 0.3 Continuous Integration (CI) Update #271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
feast-ci-bot merged 25 commits into from
Oct 28, 2019
Merged

Feast 0.3 Continuous Integration (CI) Update #271

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
c768acf
Update prow config and test script so it works for Feast 0.3
davidheryanto Oct 24, 2019
4e747ef
Update CI test script for golang to use correct path
davidheryanto Oct 24, 2019
eac9d8f
Set pipefail option so test exit code is correct
davidheryanto Oct 24, 2019
f05be18
Update group id and version grpc-spring-boot-starter dependency
davidheryanto Oct 24, 2019
5bece03
Add JVM heap settings for Maven surefire
davidheryanto Oct 24, 2019
cf71297
Fix potential setup/teardown error when running ImportJobTest
davidheryanto Oct 24, 2019
ce6d554
Update remote URI to download cached Maven packages
davidheryanto Oct 24, 2019
ca70a9d
Fix path to logs artifacts
davidheryanto Oct 24, 2019
7341925
Merge branch '0.3-dev' into feast-prow-update
davidheryanto Oct 24, 2019
d79dfc0
Update maven enforcer rule for Maven and JDK versions
davidheryanto Oct 24, 2019
df5a47d
Use batch mode when initializing Maven for cleaner build log
davidheryanto Oct 24, 2019
dabd984
Skip maven enforcer when running test for specific project
davidheryanto Oct 24, 2019
66d2f6f
Fix incorrect order for java-sdk test script
davidheryanto Oct 24, 2019
42c8c5f
Install database and kafka dependencies for Feast end to end test
davidheryanto Oct 25, 2019
5bb25b3
Update Python SDK to not set source in FeatureSet when using default …
davidheryanto Oct 26, 2019
e33ae28
Merge branch '0.3-dev' into feast-prow-update
davidheryanto Oct 26, 2019
48a7139
Fix Python SDK type mapping
davidheryanto Oct 27, 2019
1756e68
Refactor prow scripts such that every test is defined in a separate s…
davidheryanto Oct 27, 2019
546b215
Remove reference to actual project id
davidheryanto Oct 27, 2019
85f3282
Log current stage in end to end test script
davidheryanto Oct 27, 2019
679ff12
Fix missing option to specify miniconda download target
davidheryanto Oct 27, 2019
5806366
Fix incorrect path to installing Python SDK
davidheryanto Oct 27, 2019
a958eda
Add small wait after ingestion, before validating the saved features,…
davidheryanto Oct 27, 2019
23bb84f
Increase wait time before checking, after applying feature set
davidheryanto Oct 27, 2019
675c32a
Make log cleaner
davidheryanto Oct 27, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Increase wait time before checking, after applying feature set
  • Loading branch information
@davidheryanto
davidheryanto committed Oct 27, 2019
commit 23bb84f380e8ecab7a76d792167bfad86d1a8f98
10 changes: 5 additions & 5 deletions .prow/scripts/test-end-to-end.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ echo "
Installing Postgres at localhost:5432
============================================================
"
apt-get -y install postgresql
apt-get -y install postgresql > /var/log/postgresql.install.log
service postgresql start
# Initialize with database: 'postgres', user: 'postgres', password: 'password'
cat <<EOF > /tmp/update-postgres-role.sh
Expand All @@ -57,10 +57,10 @@ wget -qO- https://www-eu.apache.org/dist/kafka/2.3.0/kafka_2.12-2.3.0.tgz | tar
mv kafka_2.12-2.3.0/ /tmp/kafka
nohup /tmp/kafka/bin/zookeeper-server-start.sh /tmp/kafka/config/zookeeper.properties &> /var/log/zookeeper.log 2>&1 &
sleep 5
tail -n20 /var/log/zookeeper.log
tail -n10 /var/log/zookeeper.log
nohup /tmp/kafka/bin/kafka-server-start.sh /tmp/kafka/config/server.properties &> /var/log/kafka.log 2>&1 &
sleep 5
tail -n20 /var/log/kafka.log
tail -n10 /var/log/kafka.log

echo "
============================================================
Expand Down Expand Up @@ -190,8 +190,8 @@ bash /tmp/miniconda.sh -b -p /root/miniconda -f
source ~/.bashrc

# Install Feast Python SDK and test requirements
pip install sdk/python
pip install -r tests/e2e/requirements.txt
pip install -q sdk/python
pip install -qr tests/e2e/requirements.txt

echo "
============================================================
Expand Down
6 changes: 3 additions & 3 deletions tests/e2e/test_e2e.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ def test_basic(client):

# Feast Core needs some time to fully commit the FeatureSet applied
# when there is no existing job yet for the Featureset
time.sleep(3)
time.sleep(15)
cust_trans_fs = client.get_feature_set(name="customer_transactions", version=1)

if cust_trans_fs is None:
Expand Down Expand Up @@ -168,7 +168,7 @@ def test_all_types(client):

# Feast Core needs some time to fully commit the FeatureSet applied
# when there is no existing job yet for the Featureset
time.sleep(3)
time.sleep(10)
all_types_fs = client.get_feature_set(name="all_types", version=1)

if all_types_fs is None:
Expand Down Expand Up @@ -297,7 +297,7 @@ def test_large_volume(client):

# Feast Core needs some time to fully commit the FeatureSet applied
# when there is no existing job yet for the Featureset
time.sleep(3)
time.sleep(10)
cust_trans_fs = client.get_feature_set(
name="customer_transactions_large", version=1
)
Expand Down