Is your feature request related to a problem? Please describe.
I want to use my on-premise installment of s3 (minio in my case). For this I need a way to provide custom endpoint_url for boto3.client initialization.
Describe the solution you'd like
New configuration option like FEAST_S3_ENDPOINT_URL. And use it's value in feast.staging.storage_client.S3Client.__init__ when creating s3 client. Default None value will ensure backward compatibility.
To configure this option for spark jobs, #1168 can be implemented
Is your feature request related to a problem? Please describe.
I want to use my on-premise installment of s3 (minio in my case). For this I need a way to provide custom
endpoint_urlforboto3.clientinitialization.Describe the solution you'd like
New configuration option like
FEAST_S3_ENDPOINT_URL. And use it's value infeast.staging.storage_client.S3Client.__init__when creating s3 client. DefaultNonevalue will ensure backward compatibility.To configure this option for spark jobs, #1168 can be implemented