-
Notifications
You must be signed in to change notification settings - Fork 0
Comparing changes
Open a pull request
base repository: FennelFetish/llama-cpp-python
base: main
head repository: JamePeng/llama-cpp-python
compare: main
- 19 commits
- 9 files changed
- 1 contributor
Commits on Jul 14, 2026
-
Update Submodule vendor/llama.cpp e3546c7..7f575c3
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 1762647 - Browse repository at this point
Copy the full SHA 1762647View commit details -
refactor(mtmd): cache Generic MTMD chat template resolution
- Refactor MTMD chat template handling to resolve and analyze the chat template only once per handler instance instead of on every request. - Add template initialization state, cache parsed media placeholder tags, and support explicit chat template overrides through a dedicated field. Improve lifecycle cleanup by resetting cached template state and MTMD resources during handler close. - This keeps runtime processing focused on message rendering and media tokenization while avoiding repeated chat template resolution overhead. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 9d6e598 - Browse repository at this point
Copy the full SHA 9d6e598View commit details
Commits on Jul 15, 2026
-
Update Submodule vendor/llama.cpp 7f575c3..aff6eb6
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 5334cb9 - Browse repository at this point
Copy the full SHA 5334cb9View commit details -
refactor(embedding): rename llama_cpp import alias to llama_cpp_lib
Rename the 'llama_cpp.llama_cpp' import alias to 'llama_cpp_lib' to avoid potential namespace conflicts with the local '.llama_cpp' imports. Update all affected call sites in llama_embedding.py. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 859a99d - Browse repository at this point
Copy the full SHA 859a99dView commit details -
feat(ctypes): support ABI-compatible symbol aliases
- Allow ctypes_function_for_shared_library to accept either a single symbol name or an ordered iterable of ABI-compatible aliases. - Resolve aliases in order and bind the first exported symbol found while preserving the selected symbol name for runtime diagnostics. Also improve error reporting for empty alias lists and missing symbols. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 849f02a - Browse repository at this point
Copy the full SHA 849f02aView commit details
Commits on Jul 16, 2026
-
Update Submodule vendor/llama.cpp aff6eb6..79bba02
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 142c58d - Browse repository at this point
Copy the full SHA 142c58dView commit details -
fix(mtmd): preserve subclass chat format during MTMD initialization
- Ensure MTMDChatHandler initialization remains compatible with specialized chat handlers that define their own chat_format before calling super().__init__(). - Initialize chat_format only when it is not already provided by the subclass, then apply chat_format_override or fallback to the built-in MTMD template. This prevents AttributeError during inherited handler initialization while keeping template override behavior unchanged. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for a804dc2 - Browse repository at this point
Copy the full SHA a804dc2View commit details -
feat(ctypes): handle missing optional symbols gracefully
- Allow ctypes bindings to mark symbols as optional through the `required` flag. - Missing symbols caused by ABI naming differences, API changes, or experimental extensions will no longer break library loading. Optional APIs emit diagnostic warnings and provide runtime unavailable stubs instead. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for afafdd5 - Browse repository at this point
Copy the full SHA afafdd5View commit details -
Update Submodule vendor/llama.cpp 79bba02..e8f19cc
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 083c4b5 - Browse repository at this point
Copy the full SHA 083c4b5View commit details -
fix(ctypes): validate argument types before binding shared library fu…
…nctions - Add explicit validation for ctypes function argument declarations before assigning them to the loaded shared library function. - This provides clearer error messages when invalid Python types are passed to `argtypes`, instead of exposing the internal ctypes error about missing `from_param()` methods. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 6c163c2 - Browse repository at this point
Copy the full SHA 6c163c2View commit details -
feat(llama_ext): support optional llama-ext.h API bindings
- Add Python ctypes bindings for the experimental APIs exposed by llama-ext.h, including NextN/MTP embeddings, and model metadata extraction. - Extension symbols are loaded optionally to handle ABI changes, renamed symbols, and builds that do not export experimental APIs without breaking the main Python bindings. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 978ff32 - Browse repository at this point
Copy the full SHA 978ff32View commit details
Commits on Jul 17, 2026
-
Update Submodule vendor/llama.cpp e8f19cc..86d86ed
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 3df6144 - Browse repository at this point
Copy the full SHA 3df6144View commit details -
patch(Gemma4ChatHandler): Synchronize huggingface gemma4 latest chat …
…template - fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation - https://huggingface.co/google/gemma-4-31B-it/commit/68abe48010cbe15293462fa11e901a60639a44e5 Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for a641283 - Browse repository at this point
Copy the full SHA a641283View commit details -
- This release focuses on improving compatibility with the rapidly evolving llama.cpp ecosystem, especially around experimental APIs, ABI changes, MTMD processing, and latest model integrations. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for caa72e2 - Browse repository at this point
Copy the full SHA caa72e2View commit details
Commits on Jul 20, 2026
-
Update Submodule vendor/llama.cpp 86d86ed..91d2fc3
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 79b8b5d - Browse repository at this point
Copy the full SHA 79b8b5dView commit details -
fix(ggml): preload bundled OpenMP runtime before loading ggml-base
- Preload the packaged libomp140.x86_64.dll on Windows before initializing ggml-base to ensure CPU backend DLLs can resolve their OpenMP runtime dependency. - This only applies to Windows builds with llama-cpp-python >= 0.3.39 and uses the bundled runtime from the package lib directory, avoiding the need for users to configure system PATH or install additional OpenMP runtimes. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for 0eb2615 - Browse repository at this point
Copy the full SHA 0eb2615View commit details
Commits on Jul 21, 2026
-
Update Submodule vendor/llama.cpp 91d2fc3..846e991
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for db460e0 - Browse repository at this point
Copy the full SHA db460e0View commit details -
- This release is a small but important maintenance update focused on improving Windows dynamic library loading reliability. Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for ebf6099 - Browse repository at this point
Copy the full SHA ebf6099View commit details
Commits on Jul 22, 2026
-
Update Submodule vendor/llama.cpp 846e991..4310aa4
Signed-off-by: JamePeng <jame_peng@sina.com>
Configuration menu - View commit details
-
Copy full SHA for ffbd951 - Browse repository at this point
Copy the full SHA ffbd951View commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff main...main