Skip to content

Restart Ingestion Job on code version update#949

Merged
feast-ci-bot merged 7 commits into
feast-dev:masterfrom
pyalex:restart-on-version
Aug 14, 2020
Merged

Restart Ingestion Job on code version update#949
feast-ci-bot merged 7 commits into
feast-dev:masterfrom
pyalex:restart-on-version

Conversation

@pyalex

@pyalex pyalex commented Aug 14, 2020

Copy link
Copy Markdown
Collaborator

What this PR does / why we need it:

  1. Each Job can have individual labels that are being merged with common labels (see feast.jobs.runners.options.labels) before job created. Job labels are being generated & managed by JobCoordinator. Currently labels consists of feast.job.coordinator.jobSelector and feast version. Job labels overwrite common labels for the same keys.

  2. Added label feast_version that keeps version of feast code attached to the job. As soon as new version is being released - JobCoordinator automatically restarts jobs with older version in this label.

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:


Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this.currentVersion be a getter?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is private final property, not sure how getter could be useful?

@pyalex pyalex force-pushed the restart-on-version branch 2 times, most recently from bf8d785 to f5e5a9e Compare August 14, 2020 07:36
@pyalex pyalex force-pushed the restart-on-version branch from f5e5a9e to 631bff1 Compare August 14, 2020 08:03
@pyalex

pyalex commented Aug 14, 2020

Copy link
Copy Markdown
Collaborator Author

/test test-end-to-end

@pyalex pyalex force-pushed the restart-on-version branch from edbeea8 to 209a65d Compare August 14, 2020 09:06
@pyalex

pyalex commented Aug 14, 2020

Copy link
Copy Markdown
Collaborator Author

/test test-end-to-end-batch

@woop

woop commented Aug 14, 2020

Copy link
Copy Markdown
Member

/lgtm

@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: pyalex, woop

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@pyalex pyalex added the kind/feature New feature or request label Aug 14, 2020
@feast-ci-bot feast-ci-bot merged commit b02191f into feast-dev:master Aug 14, 2020
zhangchi1 pushed a commit to Cimpress-MCP/feast that referenced this pull request Aug 19, 2020
* blacklist -> whitelist

* add whitelisted property

* coordinator properties in e2e tests

* move labels to job & jobcoordinator

* it test for version update

* version label constant

* fix version label
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants