Skip to content

Switch from Travis CI to GitHub Actions #402

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mengxr merged 12 commits into from
Oct 14, 2021
Merged

Switch from Travis CI to GitHub Actions #402

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
e2608e6
gh workflows
mengxr Oct 14, 2021
273d55a
cross
mengxr Oct 14, 2021
1ce09c0
python ci
mengxr Oct 14, 2021
4848bfd
use ivy2 cache
mengxr Oct 14, 2021
0c6988b
add SPARK_HOME
mengxr Oct 14, 2021
01c0990
set envs
mengxr Oct 14, 2021
22ddbf0
wheel
mengxr Oct 14, 2021
b60091d
cov
mengxr Oct 14, 2021
de48f4b
downgrade scala so coverage works
mengxr Oct 14, 2021
3e4e6f9
remove travis
mengxr Oct 14, 2021
829b4a1
fix SPARK_HOME
mengxr Oct 14, 2021
435536d
py37 for spark 2.4
mengxr Oct 14, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
48 changes: 48 additions & 0 deletions .github/workflows/python-ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
name: Python CI
on: [push, pull_request]
jobs:
test:
strategy:
fail-fast: false
matrix:
include:
- spark-version: 3.1.2
scala-version: 2.12.12
python-version: 3.8
- spark-version: 3.0.3
scala-version: 2.12.12
python-version: 3.8
- spark-version: 2.4.8
scala-version: 2.11.12
python-version: 3.7
runs-on: ubuntu-20.04
env:
# define Java options for both official sbt and sbt-extras
JAVA_OPTS: -Xms2048M -Xmx2048M -Xss6M -XX:ReservedCodeCacheSize=256M -Dfile.encoding=UTF-8
JVM_OPTS: -Xms2048M -Xmx2048M -Xss6M -XX:ReservedCodeCacheSize=256M -Dfile.encoding=UTF-8
SPARK_VERSION: ${{ matrix.spark-version }}
SCALA_VERSION: ${{ matrix.scala-version }}
steps:
- uses: actions/checkout@v2
- uses: olafurpg/setup-scala@v11
with:
java-version: "zulu@1.8"
- uses: actions/cache@v2
with:
path: |
~/.ivy2/cache
key: sbt-ivy-cache-spark-${{ matrix.spark-version}}-scala-${{ matrix.scala-version }}
- name: Assembly
run: sbt -v ++${{ matrix.scala-version }} -Dspark.version=${{ matrix.spark-version }} "set test in assembly := {}" assembly
- uses: actions/setup-python@v2
with:
python-version: ${{ matrix.python-version }}
- name: Install Python depencencies
run: |
python -m pip install --upgrade pip wheel
pip install -r ./python/requirements.txt
pip install pyspark==${{ matrix.spark-version }}
- name: Test
run: |
export SPARK_HOME=$(python -c "import os; print(os.path.join(os.path.dirname(os.__file__), 'site-packages', 'pyspark'))")
./python/run-tests.sh
32 changes: 32 additions & 0 deletions .github/workflows/scala-ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: Scala CI
on: [push, pull_request]
jobs:
test:
strategy:
fail-fast: false
matrix:
include:
- spark-version: 3.1.2
scala-version: 2.12.12
- spark-version: 3.0.3
scala-version: 2.12.12
- spark-version: 2.4.8
scala-version: 2.11.12
runs-on: ubuntu-20.04
env:
# define Java options for both official sbt and sbt-extras
JAVA_OPTS: -Xms2048M -Xmx2048M -Xss6M -XX:ReservedCodeCacheSize=256M -Dfile.encoding=UTF-8
JVM_OPTS: -Xms2048M -Xmx2048M -Xss6M -XX:ReservedCodeCacheSize=256M -Dfile.encoding=UTF-8
steps:
- uses: actions/checkout@v2
- uses: olafurpg/setup-scala@v11
with:
java-version: "zulu@1.8"
- uses: actions/cache@v2
with:
path: |
~/.ivy2/cache
key: sbt-ivy-cache-spark-${{ matrix.spark-version}}-scala-${{ matrix.scala-version }}
- name: Build and Test
run: sbt -v ++${{ matrix.scala-version }} -Dspark.version=${{ matrix.spark-version }} coverage test coverageReport
- uses: codecov/codecov-action@v2
33 changes: 0 additions & 33 deletions .travis.yml
View file
Open in desktop

This file was deleted.