Runner option is currently hardcoded in deployment (specifically core's deployment). Some ingestion jobs might need to override those value without redeploying feast.
One way to do it is by adding runnerOptions field in the SubmitImportJobRequest as follow:
message SubmitImportJobRequest {
feast.specs.ImportSpec importSpec = 1;
string name = 2;
map<string, string> runnerOptions = 3; // NEW, optional
}
This runnerOptions is then used to override default runner option and then passed to the runner.
thought? @woop @zhilingc
Runner option is currently hardcoded in deployment (specifically core's deployment). Some ingestion jobs might need to override those value without redeploying feast.
One way to do it is by adding
runnerOptionsfield in theSubmitImportJobRequestas follow:This runnerOptions is then used to override default runner option and then passed to the runner.
thought? @woop @zhilingc