14 Llama.cpp Alternatives & Competitors
Tool
Pricing
Rating
Popularity
Compare
#2
Exllama
Efficiently execute Hugging Face transformers on GPUs with low memory usage
Free
100%
1 review
Open source
#3
local.ai
Run local language models, stream AI answers on CPU
Freemium
No reviews yet
8 popularity
▼ -12.8% MoM
#5
Ollama.ai
Run custom and local AI models privately
Free
74.1%
27 reviews
21 popularity
▼ -14.7% MoM
AI-driven line-level code reviews preserving privacy with precise comments
Free
100%
2 reviews
24 popularity
▲ +895.4% MoM
Open source
AI inference API: high-throughput, energy-efficient, OpenAI-compatible deployment
Freemium
No reviews yet
17 popularity
▼ -46.8% MoM
#8
Little-Coder
Local AI coding agent for on-device code generation and benchmarking
Free
100%
1 review
Open source
AI-driven code snippet indexing and collaboration
Freemium
from $8/mo
100%
2 reviews
14 popularity
▲ +52.4% MoM
#10
LLMWare.ai
Securely deploy, manage, and run AI models locally on PCs
Freemium
100%
1 review
8 popularity
▼ -16.0% MoM
Run and manage local AI language and multimodal models
Free
100%
1 review
Open source
#13
LLMule
Run AI models locally for private, decentralized collaboration.
Free
No reviews yet
4 popularity
▼ -100.0% MoM
#14
HyperMink
Run AI models locally, preserving privacy, with modular inference server.
Freemium
No reviews yet
Frequently Asked Questions
Based on user reviews, the highest-rated Llama.cpp alternatives are
Ollama.ai (74.1%).
Yes, 14 of the 14 alternatives listed here offer a free plan, including Vllm, Exllama, local.ai.
Yes, Vllm, Exllama, KoboldCPP are open-source Llama.cpp alternatives.
Open-codereview AI is the fastest-growing Llama.cpp alternative here, with traffic up 895% month over month.