Local Inference Cli

local.ai runs language models locally without GPUs. Its Rust backend keeps the binary under 10 MB and performs CPU inference with GGML quantization. A single‑click interface streams responses to a UI, while a model manager tracks, verifies, and resumes downloads.

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

OpenAI Codex CLI is a terminal-based, open-source coding agent that uses natural language to automate development tasks like code generation, testing, refactoring, and codebase understanding, with secure sandboxed execution and Git integration.

Cline CLI is an open-source, command-line AI agent that automates developer workflows like code reviews and batch changes. It runs locally or with cloud models, integrates with major editors, and works in both interactive and autonomous CI/CD modes.

OpenClaw is a personal AI assistant that automates email, calendar, task and chat workflows—clearing inboxes, composing and sending messages, scheduling events, checking reservations, integrating chats and cloud services, with persistent memory, background jobs and developer-friendly self-hosting an

Claude Code is an AI-powered coding assistant that operates within the terminal, automating tasks like editing files, fixing bugs, executing tests, and managing git workflows. It enhances developer productivity through natural language commands and real-time support.

Llama is a local AI tool that enables users to create customizable and efficient language models without relying on cloud-based platforms, available for download on MacOS, Windows, and Linux.

Interpreter is a desktop AI agent that lets users edit and create Word, Excel, PDF, and markdown files, instantly fill PDFs, extract data into Excel, convert receipts or transcripts, and run local or cloud models via OpenAI, Anthropic, Groq, or Ollama.

Groq is an inference platform that uses custom LPU silicon for low‑latency, high‑throughput AI workloads. It supports large language and multimodal models via an OpenAI‑compatible API, with modular deployment and predictable performance for NLP, vision, and recommendation tasks.

Unsloth Studio is a no-code web UI enabling local training, running, and exporting of open AI models like Qwen3.5 and NVIDIA Nemotron 3, simplifying experimentation for users without extensive technical expertise.

InstaText is an AI editing assistant that highlights suggestions for clarity, flow, word choice, and grammar. Users can accept or reject each change, select dialect, formality, or add custom terms. It works on Chrome, Gmail, Slack, Docs, Overleaf, and Word.

Aider is an AI-powered pair programming tool that helps developers collaborate with LLMs for editing, refactoring, and debugging code within Git repositories. It supports multiple languages and integrates with IDEs and editors for real-time updates.

LLMWare AI installs a lightweight client on PCs, providing instant access to 100+ AI models optimized for Intel and Qualcomm hardware. It supports RAG, auto‑tunes weights, runs locally without Wi‑Fi, and offers an admin console for monitoring, scaling, and audit logs.

UBIAI fine‑tunes LLMs with classifiers, retrievers, and reasoning. It automates PDF/DOCX labeling, synthetic data, and quality filtering; offers 15‑minute prompt‑level tuning or 2‑4 hour weight training; exports to GGUF, safetensors, or Hugging Face for API or custom deployment.

Inferless is a serverless platform for deploying machine learning models seamlessly. It offers automatic load balancing, custom runtime environments, and automated CI/CD workflows, minimizing infrastructure management while scaling efficiently from single to millions of requests.

InfraNodus visualizes text analysis by building knowledge graphs from PDFs, markdown, CSV, social media, and web data. It offers topic modeling, sentiment, keyword extraction, and API/browser‑extension/Obsidian integration to help researchers, marketers, and SEOs uncover relationships, gaps, and ide

Linfo.ai is an AI tool that summarizes articles, reports, and videos, generating structured insights and mind maps. It helps users quickly comprehend large volumes of information, enhancing productivity for students, researchers, and professionals.

InLinks analyzes website content to map key entities and relationships, clusters topics, identifies content gaps, and automates internal linking. It generates schema markup, provides content briefs, and offers AI‑assisted copy writing for scalable on‑page SEO.

Kel is an AI-powered CLI tool that simplifies repetitive tasks, maximizes productivity, and elevates intelligence in command line interactions. It integrates with leading Language Model services to optimize CLI experiences for smooth and smart operations.

Inline Help provides AI-powered, in-app contextual support by turning knowledge bases into guidance, offering no-code tooltips, an embeddable chatbot and ticket form, multilingual coverage, and analytics to reduce support tickets and improve product adoption.

Union.ai is a cloud‑native AI orchestration platform that lets data scientists and ML engineers build, test, and deploy high‑velocity, pure Python workflows. It supports dynamic branching, real‑time inference, automatic failure recovery, caching, versioning, and observability dashboards.

InfernoAI is a browser‑based chat tool supporting OpenAI, Anthropic, Gemini, and OpenRouter models. It lets users organize conversations with folders and tags, perform full‑text searches, tune model parameters, use TTS and DALL‑E 3, and stores all data locally.

Foundry Local runs AI models on-device using ONNX Runtime (CPU/GPU/NPU) to keep data local, offering an OpenAI-compatible API, Python/JS/C#/Rust SDKs, a model hub, and CLI tools for edge and enterprise deployments.

CloudCLI AI is a containerized remote development platform that provides persistent, cross-device coding sessions. It integrates AI coding agents, supports major IDEs, and offers team features for shared environments and configurations.

Liner.ai is a cross‑platform no‑code ML app that trains models locally in minutes on images, text, audio, or video. It auto‑selects algorithms, offers ready‑to‑use templates, and exports models for web, mobile, or edge deployment.

Informly’s Idea Validator evaluates business concepts with AI, producing detailed reports that include market analysis, target audience, business model, feasibility, competitive positioning, marketing, sales, and fundraising guidance. It automates research, surfaces blind spots, and delivers actiona

Athina lets teams build, test, and monitor AI features via a prompt editor and flow builder for any model. It offers dataset comparison, SQL queries, evaluation suites, human QA, code execution, observability, self‑hosted deployment, SOC‑2 compliance, and cloud integrations.

IntelliBar is a macOS‑native AI assistant that consolidates GPT‑4o, Claude 3.5, Gemini, and local models into a single interface. It lets you run identical prompts across multiple models simultaneously and compare results side‑by‑side, while keeping conversations local and private.

Ava is an open‑source desktop app that runs language models locally using llama.cpp, offering a GUI or headless mode. Built with Zig/C++ and SQLite, it enables rapid prototyping, privacy‑focused experimentation, and straightforward local deployment.

HyperMink AI is an open‑source, privacy‑centric platform offering a modular Node.js inference server, Inferenceable, powered by llama.cpp/llamafile. It supports local model deployment, plug‑in extensions, and community contributions via GitHub for developers.

PicoClaw is an ultra-lightweight AI assistant for local deployment on resource-constrained devices like Raspberry Pi. It integrates with multiple AI models and messaging platforms, offering chat, automation, and a REST API while keeping data local.

AIConsole is an open-source desktop editor featuring a console interface for local code execution. It optimizes workflow, excels in automation and precise task handling via advanced prompt engineering and RAG system support. Collaborative domain-specific AI solutions are facilitated through its ope

The AI-powered web3 tool analyzes data in decentralized networks using state-of-the-art algorithms and machine learning techniques to provide insights and facilitate informed decisions, collaboration, and the full potential of the network.

Get answers for CLI commands from GPT3 directly in the terminal using AI-powered CLI tool.

Inception Labs' diffusion-based large language models (dLLMs) offer faster, more efficient, and cost-effective text generation than traditional autoregressive models. With built-in error correction, multimodal support, and structured output control, they excel in function calling and complex data ge

A stable web UI for Diffusion with advanced features and ongoing development.

Cline is an autonomous coding agent integrated into your IDE, enhancing software development through precise file management, command execution, and web interaction with a focus on security and user oversight.

Pioneer automates retraining and deployment of open-source models, using live inference data for fine-tuning and one-shot adaptation. It manages adaptive inference, routing, RAG pipelines, agent workflows, synthetic data generation, monitoring, and automated checkpoint promotion.

HeyCLI converts natural language into Linux shell commands, letting users type simple descriptions instead of memorizing syntax. A preview is available on GitHub for testing and feedback, with email updates for new releases.

C·L·O·N·E·S creates AI clones that read and compose in a company’s language, using Retrieval‑Augmented Generation for accurate information retrieval. They integrate via the Model Context Protocol, support agent‑to‑agent coordination, and run securely on cloud or local systems.

Open-claw.org is a premium, subscription-based AI deployment platform that lets you launch powerful AI agents in one click

InfinipilotAI is a macOS AI co‑pilot that provides autocomplete, style and grammar fixes, real‑time translation, and code review. It supports OpenAI, Claude, Gemini, and local models with optional local processing, text‑to‑speech, and speech‑to‑text.

claude-dev.tools is a session analysis and debugging suite for Claude that reconstructs full session context and provides detailed token attribution across all components. It offers local and remote log inspection, execution trace visualization, and security monitoring through a self-hosted, open-so

little-coder is a Pi-based coding agent for running 5–25 GB local LLMs via llama.cpp or Ollama, offering Python/Node CLIs and TypeScript extensions, reproducible benchmarks, build/serve guides, and tools for local code generation, on-device development, and evaluation.

OpenHuman is an open-source personal AI framework for private, on‑premises deployments and local model execution, providing an agent framework, prompt management, local speech (Whisper/Piper), integrations, Docker/one‑click deployment, and developer tooling.

Enclave AI runs large language models on Mac and iPhone, keeping all text, voice, and document processing offline. It supports on‑device speech recognition, synthesis, and custom assistants, with local, encrypted conversation history and PDF summarization, ensuring privacy.

This is an image-to-text model that generates prompts based on input images.

ironclaw is a Rust-based, OpenAI-compatible self-hosted AI assistant framework emphasizing privacy and security, offering an embedded registry, WASM channels, multi-channel adapters (Signal, Telegram, Slack, Discord), hot-activate extensions, and containerized deployment tooling.

Mistral.rs is an efficient, versatile tool for high-speed large language model (LLM) inference, offering multi-device support and extensive quantization options for seamless deployment on diverse hardware setups.

KiloClaw is a hosted platform for deploying and managing OpenClaw AI agents. It provides managed infrastructure, access to 500+ models, and integrations with 50+ chat platforms and tools for automation.