14 Llama.cpp Alternatives & Competitors
Tool
Pricing
Rating
Popularity
Compare
#2
Exllama
Efficiently execute Hugging Face transformers on GPUs with low memory usage
Free
100%
1 review
Open source
#3
local.ai
Run local language models, stream AI answers on CPU
Freemium
No reviews yet
9 popularity
▼ -8.8% MoM
#4
Ollama.ai
Run custom and local AI models privately
Free
74.1%
27 reviews
22 popularity
▼ -36.9% MoM
AI inference API: high-throughput, energy-efficient, OpenAI-compatible deployment
Freemium
No reviews yet
21 popularity
▼ -29.6% MoM
#7
Little-Coder
Local AI coding agent for on-device code generation and benchmarking
Free
100%
1 review
Open source
AI-driven code snippet indexing and collaboration
Freemium
from $8/mo
100%
2 reviews
11 popularity
▲ +40.0% MoM
AI-driven line-level code reviews preserving privacy with precise comments
Free
100%
2 reviews
10 popularity
Open source
#10
LLMWare.ai
Securely deploy, manage, and run AI models locally on PCs
Freemium
100%
1 review
9 popularity
▼ -4.8% MoM
Run and manage local AI language and multimodal models
Free
100%
1 review
Open source
#13
LLMule
Run AI models locally for private, decentralized collaboration.
Free
No reviews yet
4 popularity
▲ +490.0% MoM
#14
HyperMink
Run AI models locally, preserving privacy, with modular inference server.
Freemium
No reviews yet
Frequently Asked Questions
Based on user reviews, the highest-rated Llama.cpp alternatives are
Ollama.ai (74.1%).
Yes, 14 of the 14 alternatives listed here offer a free plan, including Vllm, Exllama, local.ai.
Yes, Vllm, Exllama, KoboldCPP are open-source Llama.cpp alternatives.
LLMule is the fastest-growing Llama.cpp alternative here, with traffic up 490% month over month.