Skip to content

v0.1.3

Latest

Choose a tag to compare

@rifkybujana rifkybujana released this 16 Oct 13:57
· 37 commits to main since this release
ee3f41c

New:

  • Vulkan GPU inference (llama-vulkan)
  • Auto GPU detection; automatic CPU fallback

Usage:

  • Auto: --engine auto
  • GPU: --engine llama-vulkan
  • CPU: --engine llama-cpu

Linux setup:

  • Loader/tools: libvulkan1 vulkan-tools
  • Drivers: nvidia-vulkan-icd or mesa-vulkan-drivers

Validate:

  • ldconfig -p | grep libvulkan.so.1
  • vulkaninfo | head

Notes:

  • CPU-only environments continue to work
  • If Vulkan missing and GPU forced, startup may fail or warn, per config