Skip to content

Ability to pass runner option during ingestion job submission #50

Description

@pradithya

Runner option is currently hardcoded in deployment (specifically core's deployment). Some ingestion jobs might need to override those value without redeploying feast.
One way to do it is by adding runnerOptions field in the SubmitImportJobRequest as follow:

 message SubmitImportJobRequest {
        feast.specs.ImportSpec importSpec = 1;
        string name = 2; 
        map<string, string> runnerOptions = 3; // NEW, optional
    }

This runnerOptions is then used to override default runner option and then passed to the runner.

thought? @woop @zhilingc

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions