Skip to content

Change error store to be part of configuration instead - #39

Merged
feast-ci-bot merged 9 commits into
feast-dev:masterfrom
zhilingc:error-store-fix
Jan 9, 2019
Merged

Change error store to be part of configuration instead#39
feast-ci-bot merged 9 commits into
feast-dev:masterfrom
zhilingc:error-store-fix

Conversation

@zhilingc

@zhilingc zhilingc commented Jan 5, 2019

Copy link
Copy Markdown
Collaborator

Fixes #27.

This change requires core to be deployed with the following additional configuration:

  • feast.jobs.errorsStoreType
  • feast.jobs.errorsStoreOptions

which define where (and how) to write the error logs of each ingestion job. These options are passed in as flags to the ingestion jar when a job is run. Internally to ingestion a storage spec is still used.

@zhilingc
zhilingc requested a review from tims January 5, 2019 01:45
Comment thread ingestion/src/main/java/feast/storage/service/ErrorsStoreService.java Outdated
Comment thread ingestion/src/main/java/feast/ingestion/boot/ImportJobModule.java Outdated
@tims

tims commented Jan 6, 2019

Copy link
Copy Markdown
Contributor

We could change the [Error|Serving|Warehouse]Store classes to have factory in the name if that makes them make more sense. I just found it very verbose.

@zhilingc

zhilingc commented Jan 8, 2019

Copy link
Copy Markdown
Collaborator Author

/retest

@zhilingc

zhilingc commented Jan 8, 2019

Copy link
Copy Markdown
Collaborator Author

/retest

@zhilingc

zhilingc commented Jan 8, 2019

Copy link
Copy Markdown
Collaborator Author

@tims

public static List<ErrorsStore> getAll() {
return Lists.newArrayList(
Iterators.concat(manuallyRegistered.iterator(), serviceLoader.iterator()));
Iterators.concat(manuallyRegistered.iterator(), serviceLoader.iterator()));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is weird, are you using the google-java-format plugin or the imported googles styles xml?
https://github.com/google/styleguide/blob/gh-pages/intellij-java-google-style.xml

The imports don't get rearranged for me either.

@tims

tims commented Jan 9, 2019

Copy link
Copy Markdown
Contributor

Looks good except for formatting and import org, which need the google styles applied.
i.e: https://google.github.io/styleguide/javaguide.html#s3.3.3-import-ordering-and-spacing

If the google-java-format plugin neglects to org imports correctly. So instead, import the intellij styles.
https://github.com/google/styleguide/blob/gh-pages/intellij-java-google-style.xml

@tims

tims commented Jan 9, 2019

Copy link
Copy Markdown
Contributor

We should definitely merge this one before I merge this one before PR #52

Comment thread ingestion/src/main/java/feast/ingestion/options/ImportJobOptions.java Outdated
@zhilingc

zhilingc commented Jan 9, 2019

Copy link
Copy Markdown
Collaborator Author

/assign pradithya

@tims

tims commented Jan 9, 2019

Copy link
Copy Markdown
Contributor

/approve

@feast-ci-bot

Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tims

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@pradithya

Copy link
Copy Markdown
Collaborator

/lgtm

@feast-ci-bot
feast-ci-bot merged commit 5ac4b9c into feast-dev:master Jan 9, 2019
@zhilingc
zhilingc deleted the error-store-fix branch January 14, 2019 09:42
Yanson pushed a commit to Yanson/feast that referenced this pull request Jul 29, 2020
dmartinol added a commit to dmartinol/feast that referenced this pull request Jul 10, 2024
Adding registry server (UT to be completed)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants