Skip to content

ggml: allow input async copies - #30685

Draft
am17an wants to merge 1 commit into
masterfrom
aman/sched-host-async
Draft

am17an wants to merge 1 commit into
masterfrom
aman/sched-host-async

Conversation

@am17an

@am17an am17an commented Oct 16, 2026

Copy link
Copy Markdown
Contributor

Overview

This is most simple version of the notorious async host input copying stuff. It may also be DoA, but after the refactor it seems like it this is relatively simple to do. The only edge-cases are the pipeline parallel and props.integrated (if ever plan to enable it). cc @aendk @JohannesGaessler

Additional information

Requirements

@github-actions github-actions Bot added the ggml changes relating to the ggml tensor library for machine learning label Oct 16, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant