New:
- Vulkan GPU inference (llama-vulkan)
- Auto GPU detection; automatic CPU fallback
Usage:
- Auto: --engine auto
- GPU: --engine llama-vulkan
- CPU: --engine llama-cpu
Linux setup:
- Loader/tools: libvulkan1 vulkan-tools
- Drivers: nvidia-vulkan-icd or mesa-vulkan-drivers
Validate:
- ldconfig -p | grep libvulkan.so.1
- vulkaninfo | head
Notes:
- CPU-only environments continue to work
- If Vulkan missing and GPU forced, startup may fail or warn, per config