Skip to content

Commit 5754b74

Browse files
authored
make EMR jar uploader work the same as k8s one (#1284)
Signed-off-by: Oleg Avdeev <oleg.v.avdeev@gmail.com>
1 parent 8d5518d commit 5754b74

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

sdk/python/feast/pyspark/launchers/aws/emr_utils.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,11 @@ def _random_string(length) -> str:
8181

8282

8383
def _upload_jar(jar_s3_prefix: str, jar_path: str) -> str:
84-
if jar_path.startswith("https://"):
84+
if (
85+
jar_path.startswith("s3://")
86+
or jar_path.startswith("s3a://")
87+
or jar_path.startswith("https://")
88+
):
8589
return jar_path
8690
with open(jar_path, "rb") as f:
8791
uri = urlparse(os.path.join(jar_s3_prefix, os.path.basename(jar_path)))

0 commit comments

Comments
 (0)