Skip to content

feat: automatic multiprocessing - #15

Merged
william-silversmith merged 5 commits into
masterfrom
wms_multiprocessing
Feb 22, 2019
Merged

william-silversmith merged 5 commits into
masterfrom
wms_multiprocessing

Conversation

@william-silversmith

@william-silversmith william-silversmith commented Feb 21, 2019 •

Copy link
Copy Markdown
Contributor
  • Fixes bug where StopIteration triggers a RuntimeError
  • Adds tq.insert_all(..., parallel=N)
  • Uses pathos for multiprocessing to allow more creative data structures to pass through.
  • Collect errors in multiprocessing and raise them at the end.
  • Refactor insert_all to remove duplicate code.

Prevent StopIteration from being converted into a RuntimeError
by using break instead of raising directly.
@william-silversmith
william-silversmith merged commit d99dff7 into master Feb 22, 2019
@william-silversmith
william-silversmith deleted the wms_multiprocessing branch February 22, 2019 07:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant