Skip to content

Commit b028e2b

Browse files
authored
Merge branch 'GoogleCloudPlatform:main' into main
2 parents 5edf841 + 9f81c77 commit b028e2b

File tree

5 files changed

+8
-8
lines changed

5 files changed

+8
-8
lines changed
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
Flask==2.0.2
22
gunicorn==20.1.0
3-
numpy==1.20.0; python_version >= '3.7'
3+
numpy==1.21.4; python_version >= '3.7'
44
numpy==1.19.5; python_version < '3.7'
55

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
Flask==2.0.2
22
gunicorn==20.1.0
33
imageio==2.10.5
4-
numpy==1.20.0; python_version >= '3.7'
4+
numpy==1.21.4; python_version >= '3.7'
55
numpy==1.19.5; python_version < '3.7'
66
pillow==8.4.0
7-
scipy==1.6.1; python_version >= '3.7'
7+
scipy==1.7.3; python_version >= '3.7'
88
scipy==1.5.4; python_version < '3.7'
Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
1-
# Data Science Onramp - Data cleaning
1+
# Data Science Onramp - Data processing
22

33
## Testing Data
44

55
- [Citibike trips](https://pantheon.corp.google.com/bigquery?p=bigquery-public-data&d=new_york_citibike&t=citibike_trips&project=data-science-onramp&folder=&organizationId=) from BigQuery public dataset
66
- Output of data ingestion code
77
- Differences from original dataset: the dataset was purposely made dirty so that it could be cleaned for a data science tutorial
8-
- License: Public Domain
8+
- License: Public Domain

data-science-onramp/data-processing/process.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -160,7 +160,7 @@ def compute_end_udf(duration, start, end):
160160
TABLE = sys.argv[2]
161161

162162
# Create a SparkSession, viewable via the Spark UI
163-
spark = SparkSession.builder.appName("data_cleaning").getOrCreate()
163+
spark = SparkSession.builder.appName("data_processing").getOrCreate()
164164

165165
# Load data into dataframe if table exists
166166
try:

run/idp-sql/requirements.txt

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,5 +2,5 @@ Flask==2.0.2
22
SQLAlchemy==1.4.27
33
pg8000==1.23.0
44
gunicorn==20.1.0
5-
firebase-admin==5.0.3
6-
structlog==21.4.0
5+
firebase-admin==5.1.0
6+
structlog==21.4.0

0 commit comments

Comments
 (0)