Python SDK Ingestion and schema inference updates - #307
Conversation
woop
commented
Nov 15, 2019
- Refactor ingestion to use Confluent Kafka Client and to be easier to understand
- Removed bugs in ingestion that caused broken pipes
- Add add_fields_from_dataframe method instead of update_from_dataset
- Refactor loaders module
* Refactor ingestion to use Confluent Kafka Client * Add add_fields_from_dataframe method instead of update_from_dataset * Refactor loaders module
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: woop The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
* Add auto update of feature sets during ingestion * Add "infer_fields_from_df" method with additional flags for control * Update e2e tests to make them more modular
|
/retest |
|
/retest |
|
/retest |
|
/retest |
|
@zhilingc @davidheryanto merging this in so that we can cut a release. Would still be nice if you could have a look at the submission to see if it makes sense. |
|
@woop: The following test failed, say
DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here. |
…68318-rhoai-3.4 fix: Separate CronJob and feature-server ServiceAccounts