Skip to content
This repository was archived by the owner on Sep 9, 2026. It is now read-only.
This repository was archived by the owner on Sep 9, 2026. It is now read-only.

Map and apply with multiprocessing #1173

Closed
#1187
Closed
Map and apply with multiprocessing#1173
#1187
Assignees
anna-charlotte

Description

@samsja
samsja
opened on Feb 24, 2023

Context

we want to

da.apply(lambda x : x, num_worker=4 )

This will be different from doing

for doc in da:
    doc = f(doc)

map(f,a)

Is that we will leverage multiprocessing. (Need to be extra careful and add good test to check that nothing is going wrong)

  • benchmarking

We need to choose between Map or Apply but we need only of them.

Activity

  1. samsja
    added this to DocArray backlogon Feb 24, 2023
  2. samsja
    converted this from a draft issue on Feb 24, 2023
  3. samsja
    assigned
    anna-charlotte
    on Feb 24, 2023
  4. anna-charlotte
    moved this from Todo to In Progress in DocArray backlogon Feb 27, 2023
  5. anna-charlotte
    linked a pull request that will close this issuefeat: add map function #1187on Feb 28, 2023
  6. JohannesMessner
    moved this from In Progress to Done in DocArray backlogon Mar 7, 2023
  7. samsja
    closed this as completedon Mar 13, 2023
  8. jupyterjazz
    moved this from Done to In Progress in DocArray backlogon Mar 14, 2023
  9. jupyterjazz
    moved this from In Progress to Done in DocArray backlogon Mar 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions