Thank you for taking the time to read this documentation of Xllama!
Xllama is a fork of Ollama that is geared directly for "no frills" and "extreme privacy".
Currently, Ollama has many back-door connections, hidden remote servers, and many other aspects of the system that are far from "local only" model running. Xllama (stands for Ex-Ollama) aims to remedy this farce that Ollama peddles to their users.
Far from secure, Ollama enacts many hidden and not-made-public aspects of their program that hinders a user's ability to guide and run an LLM AI model to the point or aspect that they desire. This project aims at taking back control for the user, ensuring there are no Automated-Updates, Remote-connections, and no other aspects that could possibly cause a local-only runtime from affecting the user of this project.
TODO: Please wait for updates, they are on their way.
xllama has a REST API for running and managing models.
- llama.cpp project founded by Georgi Gerganov.