What is Ava PLS?

Ava is an open‑source desktop application for running language models locally on your computer. It provides a batteries‑included GUI built on llama.cpp, enabling users to deploy models without external dependencies. Ava supports both GUI and headless modes, making it suitable for developers, data scientists, and hobbyists.

The core is written in Zig and C++ with SQLite, while the front‑end uses Preact and Tailwind CSS for a lightweight interface. It is distributed under the MIT license and available as pre‑built artifacts or compiled from source with `zig build`. Users can use Ava for local inference, privacy‑focused experimentation, and rapid prototyping of language‑model applications.

Ava PLS user reviews

Would you recommend Ava PLS?

Recommend this tool?

Ava PLS's key features

Runs language models locally
Batteries-included GUI interface
Supports headless mode operation
Built with Zig and C++
Utilizes SQLite for data storage
Front-end uses Preact and Tailwind

Ava PLS use cases

Prototype a privacy‑centric chatbot for internal support with Ava’s local inference, avoiding cloud dependencies and ensuring sensitive data stays on the device
Develop and test new fine‑tuning recipes on a local SQLite‑backed model, iterating quickly without internet latency or external API costs
Create an offline educational tool that allows students to experiment with LLM prompts in a secure, GUI‑based environment without exposing personal information