fix(embed): respect physical batch limits for non-causal embeddings - #2387

fix(embed): respect physical batch limits for non-causal embeddings#2387

original4422 wants to merge 2 commits into

abetlen:mainabetlen/llama-cpp-python:mainfrom

original4422:fix/noncausal-embedding-microbatchesoriginal4422/llama-cpp-python:fix/noncausal-embedding-microbatchesCopy head branch name to clipboard