Open Source Llms

LiteLLM is an open‑source gateway that unifies access to 100+ LLMs through a single OpenAI‑compatible API, enabling provider fallback, cost tracking, tag‑based budgeting, guardrails, observability, and on‑prem or cloud deployment with a lightweight SDK.

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

OpenLIT is an open‑source observability platform for large‑language‑model applications, offering distributed tracing, real‑time monitoring, model evaluation, prompt versioning, fleet telemetry, and a zero‑code Kubernetes operator to integrate with major LLM providers and vector databases.

LLMStack is an open‑source platform that lets developers build AI agents and workflows without coding, supports multiple model providers, imports data from web, PDFs, audio, cloud services, and offers a collaborative React UI with granular permissions.

Mistral AI offers developers a platform for building cutting-edge generative AI models with a focus on performance and customization. Their models excel in reasoning tasks and benchmarks, providing flexible deployment options across infrastructures.

LearnHouse is an open‑source LMS that lets educators create courses quickly with a block‑based editor. It supports self‑hosting, a REST API, payments, analytics, AI grading, multi‑tenancy, and integrations like YouTube and Google Analytics.

Open‑source AI code‑review platform that plugs into GitHub, GitLab, Bitbucket, and Azure DevOps at the pull‑request level. Model‑agnostic, it runs custom rule sets, tracks technical debt, and delivers real‑time metrics without storing source code.

Open Knowledge Maps is an AI search engine that visualizes scientific literature across disciplines, clustering related papers to reveal topic connections and trends. It supports varied document types, offers high‑quality metadata, multilingual browsing, and open‑source integration.

Portkey is an LLMOps platform offering a unified API and model catalog with observability, guardrails, RBAC, audit logs, prompt management, caching, routing and PII redaction to simplify multi-model integration, governance, monitoring, and cost optimization.

Llama Tutor is an open‑source AI tutoring platform using Llama 3.1 and Together AI. It creates custom lesson plans and explanations for users across education levels, supports many subjects, and offers real‑time dialogue with adaptive sequencing and instant feedback.

OpenManus is an open-source framework for building AI agents, offering flexibility and ease of use. It supports RL-based tuning methods like GRPO, allows LLM API configuration, and enables customizable AI-driven workflows with minimal setup, fostering community contributions.

LLM Selector filters open‑source large language models by use case—chatbots, content, code, summarization, research—while presenting benchmarks, training data, architecture, and deployment details. The interface updates regularly to aid researchers, developers, and product managers in data‑driven mo

OSS Chat delivers a single chat interface that connects users to open‑source project resources—docs, issue trackers, papers, and community Q&A. It uses ChatGPT and a vector database to provide quick, privacy‑compliant access to up‑to‑date knowledge across diverse tech domains.

LLM Pulse tracks brand visibility and search presence across LLMs (ChatGPT, Perplexity, Google AI), offering prompt tracking and suggestions, citation analysis, visibility scoring and competitor benchmarking, sentiment and response inspection, plus API and reporting exports.

LLMOps Space is a global community for LLM practitioners, offering curated content, discussion forums, event recordings, and resources on production deployment, fine‑tuning, observability, and search optimization, plus networking via Discord and newsletters.

Inception Labs' diffusion-based large language models (dLLMs) offer faster, more efficient, and cost-effective text generation than traditional autoregressive models. With built-in error correction, multimodal support, and structured output control, they excel in function calling and complex data ge

HumanLayer is an open-source IDE and orchestration layer for AI coding agents, managing parallel Claude Code sessions, multiclaude workflows, worktrees and remote workers, with context-engineering tools, session replay, workflow templates and GitHub-integrated code-review automation.

OpenAgents is an open-source framework for building and operating scalable, interoperable AI agent networks. It provides tools to launch, connect, and orchestrate agents with live monitoring, enabling collaborative applications and workflows.

ClassroomIO is an open‑source LMS that lets educators and businesses create branded, multi‑course environments with student portals for assignments and grades. It offers AI‑generated lesson outlines, planners, and video transcriptions, plus a forum community and team management.

Falcon is an open‑source LLM family by the Technology Innovation Institute, spanning 0.09‑180 B parameters. It offers efficient Falcon‑H1 series, Arabic variants, multimodal Falcon‑3, and Falcon‑Mamba 7B, all under permissive licenses.

Openkoda is an open‑source insurtech platform providing modular templates for claims, policy, and embedded insurance. It offers AI analytics, automated documents, role‑based access, multi‑tenant clustering, and API hooks for rapid, scalable development without vendor lock‑in.

OpenCode.ai is an open-source AI coding agent that runs directly in your terminal, IDE, or desktop. It connects to 75+ LLM providers, supports offline use, and enables multi-session collaboration for code review and debugging.

Unsloth Studio is a no-code web UI enabling local training, running, and exporting of open AI models like Qwen3.5 and NVIDIA Nemotron 3, simplifying experimentation for users without extensive technical expertise.

Upstage AI delivers enterprise LLMs and document-processing tools: low-latency and Japan-specific models, PDF/OCR parsing, structured information extraction, centralized search and Q&A with citations, REST/AWS/on‑prem deployment, and team collaboration for review.

Llama Family is an extensive AI platform featuring versatile llama models for multiple applications. It promotes open collaboration, democratizing AI access, with notable offerings including the popular Llama open-source model and Atom mega-model for enhanced Chinese language processing capabilitie

SurfSense is an open-source team collaboration tool built as an alternative to NotebookLM, connecting LLMs to internal knowledge sources for real-time chat, research, and workflow automation with cited answers.

Open‑Chat is a self‑hostable, decentralized chat platform that supports both proprietary and open‑source AI models. It provides a full chat API, runs LLMs on local GPUs, lowers latency, enhances privacy, and deploys easily on personal or cloud servers.

LightOn Enterprise Search is a secure on‑prem RAG platform that indexes text, images, PDFs, and scanned documents. It offers multimodal retrieval, a production‑ready API, white‑label interface, and compliance‑aware analytics for regulated industries.

Llama.cpp is an open-source tool for efficient inference of large language models. Run open source LLM models locally everywhere.

OpenL Translate converts text, PDFs, images, and audio into 100+ languages, supporting dialects and emojis. Fast mode delivers short translations; Advanced mode offers precision for legal documents. It handles 150k characters and 40 scanned PDFs daily, processing locally for privacy.

Llama is a local AI tool that enables users to create customizable and efficient language models without relying on cloud-based platforms, available for download on MacOS, Windows, and Linux.

Aleph Alpha offers specialized large language models built on EU infrastructure, trained on domain‑specific data for legal, administrative, industrial, and scientific use. It ensures data sovereignty, compliance, and real‑time workflow integration for secure AI in public, manufacturing, and defense

Lens by GitBook is an AI-enhanced internal knowledge base that facilitates Git-like collaboration, deep integrations, and content audits. It promotes effortless contribution, organized management, and real-time teamwork for current documentation.

VLLM is a high-throughput, memory-efficient inference engine for Large Language Models, enabling faster responses and effective memory management. It supports multi-node configurations for scalability and offers robust documentation for seamless integration into workflows.

Open Lovable is an open-source AI website builder that transforms existing websites into React/Next.js applications. It utilizes web scraping and AI models for analysis, enabling quick cloning and customization of production-ready components.

AI‑driven LMS that centralizes course creation, delivery, and automated reporting for internal and external learning. Supports gamified paths, SCORM/xAPI, HRIS and SSO integration, and meets FedRAMP/SOC 2 compliance for employee training, onboarding, and compliance.

LLMWare AI installs a lightweight client on PCs, providing instant access to 100+ AI models optimized for Intel and Qualcomm hardware. It supports RAG, auto‑tunes weights, runs locally without Wi‑Fi, and offers an admin console for monitoring, scaling, and audit logs.

Civitai is a community-driven hub for AI art and model sharing, offering a large gallery, model repository, and tools to create LoRA modules and Stable Diffusion checkpoints. Artists upload and remix images, while developers build and integrate custom models via API.

llmarena.ai offers side-by-side LLM comparisons across major providers, showing specs like context window, output capacity, modality and routing options. Filters and role-based categories help developers, ML engineers, product managers and researchers select suitable models.

BenchLLM evaluates language‑model applications via API or CLI, running JSON/YAML test suites with automated, interactive, or custom strategies. It supports OpenAI, LangChain, and any API, detecting regressions, generating reports, and visualizing results for continuous QA.

Velvet, part of Arize, is a developer gateway that links to Arize’s Unified Observability Platform for real‑time AI feature assessment. It supports open‑source LLM tracing, a LiteLLM gateway with 100+ models, fallback, spend tracking, and cloud or on‑premise deployment.

Unstract is an open‑source, no‑code platform that automates structured data extraction from unstructured documents using LLMs. It features reusable prompts, Human‑in‑the‑Loop verification, and dual‑LLM hallucination mitigation for secure, compliant use across finance, insurance, and healthcare.

Lunit delivers AI‑powered imaging analytics for breast cancer screening and chest X‑ray, offering real‑time risk scoring, patient tracking, and precision oncology modules for biomarker quantification and genotype prediction. The platform integrates seamlessly with clinical workflows and supports glo

LLM Price Check aggregates LLM API models and provider details into sortable tables and a cost calculator, showing context windows, input/output cost metrics, and quality indicators to help developers and teams evaluate cost–performance tradeoffs.

Acuration IQ transforms internal and open‑source data into market research, partner discovery, and proposal drafts using a context‑aware LLM. It delivers automated partner matching, data analysis, and instant PDF/Excel/Word/CSV/JSON reports, deployable locally or via LLMaaS.

Code Snippets AI indexes full codebases to deliver contextual insights, auto‑generated comments, and precise snippet recommendations. It tracks LLM usage, supports multi‑model chat, offers role‑based collaboration, and integrates with macOS and Windows via API.

LLMChat is an AI chat tool that offers a beta version experience with diverse AI models, personalized memory, custom assistant creation, and privacy-focused locally stored conversations. Explore features like plugin integration, tailored preferences, and prompt examples for various tasks.

Klu accelerates LLM app development by enabling collaborative prompt design, version control, and automated evaluation across multiple providers. It offers unified observability, cost and drift tracking, private infrastructure, continuous monitoring, and integration with 50+ tools for scalable AI de

The Full Stack offers a complete AI lifecycle curriculum, covering prompt engineering, LLMOps, deep learning, GPU selection, model monitoring, ethics, and MLOps. It trains developers, product managers, and researchers to design, build, and deploy AI applications.

RunLLM is an AI platform that automates incident investigations by querying observability tools, correlating telemetry, and delivering root-cause analyses. It generates live runbooks and remediation recommendations to accelerate MTTR and create an auditable history of incidents.