Open Source Llm Hub

LiteLLM is an open‑source gateway that unifies access to 100+ LLMs through a single OpenAI‑compatible API, enabling provider fallback, cost tracking, tag‑based budgeting, guardrails, observability, and on‑prem or cloud deployment with a lightweight SDK.

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

LLMAPI is a unified OpenAI-compatible LLM gateway offering access to 100+ models across providers, centralized API key management, failover routing, performance and cost analytics, and team-oriented key controls to simplify integration and operations.

Portkey is an LLMOps platform offering a unified API and model catalog with observability, guardrails, RBAC, audit logs, prompt management, caching, routing and PII redaction to simplify multi-model integration, governance, monitoring, and cost optimization.

SurfSense is an open-source team collaboration tool built as an alternative to NotebookLM, connecting LLMs to internal knowledge sources for real-time chat, research, and workflow automation with cited answers.

LLM Pulse tracks brand visibility and search presence across LLMs (ChatGPT, Perplexity, Google AI), offering prompt tracking and suggestions, citation analysis, visibility scoring and competitor benchmarking, sentiment and response inspection, plus API and reporting exports.

LLM Arena enables users to compare multiple large language models side-by-side, analyzing features like accuracy and capabilities. It supports up to 10 models, facilitating informed decision-making for researchers and developers in selecting the right LLM for their needs.

AIHubMix is a single API gateway to major LLMs and multimodal models, enabling model selection, automatic routing, orchestration and SDKs for text, code, image, video and embedding workflows, with native search, concurrency and production-ready infrastructure.

Open‑Chat is a self‑hostable, decentralized chat platform that supports both proprietary and open‑source AI models. It provides a full chat API, runs LLMs on local GPUs, lowers latency, enhances privacy, and deploys easily on personal or cloud servers.

OpenLIT is an open‑source observability platform for large‑language‑model applications, offering distributed tracing, real‑time monitoring, model evaluation, prompt versioning, fleet telemetry, and a zero‑code Kubernetes operator to integrate with major LLM providers and vector databases.

Inception Labs' diffusion-based large language models (dLLMs) offer faster, more efficient, and cost-effective text generation than traditional autoregressive models. With built-in error correction, multimodal support, and structured output control, they excel in function calling and complex data ge

LLMStack is an open‑source platform that lets developers build AI agents and workflows without coding, supports multiple model providers, imports data from web, PDFs, audio, cloud services, and offers a collaborative React UI with granular permissions.

OmniRoute is an open-source AI gateway that routes requests to 236 LLM providers via a single /v1 endpoint, offering multi-provider routing with auto-fallback, token compression, persistent memory, resilience controls, MCP/A2A support, and self-hosted analytics.

Open‑source AI code‑review platform that plugs into GitHub, GitLab, Bitbucket, and Azure DevOps at the pull‑request level. Model‑agnostic, it runs custom rule sets, tracks technical debt, and delivers real‑time metrics without storing source code.

LLM Selector filters open‑source large language models by use case—chatbots, content, code, summarization, research—while presenting benchmarks, training data, architecture, and deployment details. The interface updates regularly to aid researchers, developers, and product managers in data‑driven mo

Clawhub.ai is an open-source developer tool for managing and discovering reusable AI skills and code snippets. It centralizes assets with local and GitHub search, streamlining skill import and workflow integration.

ChatHub lets users interact with over 20 LLMs, including GPT‑5 and Claude 4.5, in one interface, plus image generation, document analysis, live web search, code preview, and a prompt library across web, mobile and desktop.

mdhub automates behavioral health clinic operations—patient intake, provider matching, insurance eligibility, clinical documentation, claim submission, denial flagging, and prior authorization. It consolidates scheduling, EHR, and CRM on a HIPAA‑compliant, SOC 2‑certified platform, reducing billing

LLMChat is an AI chat tool that offers a beta version experience with diverse AI models, personalized memory, custom assistant creation, and privacy-focused locally stored conversations. Explore features like plugin integration, tailored preferences, and prompt examples for various tasks.

MLflow is an open‑source AI engineering platform that tracks LLM and agent execution, monitors performance, cost, and safety, manages prompts, and supports experiment tracking, tuning, and deployment across multiple clouds or on‑premises.

Mistral AI offers developers a platform for building cutting-edge generative AI models with a focus on performance and customization. Their models excel in reasoning tasks and benchmarks, providing flexible deployment options across infrastructures.

LLMOps Space is a global community for LLM practitioners, offering curated content, discussion forums, event recordings, and resources on production deployment, fine‑tuning, observability, and search optimization, plus networking via Discord and newsletters.

Awan LLM offers unlimited token generation with Meta Llama 3.1 8B and 70B models, no censorship or caps, supporting persistent AI assistance, autonomous agents, roleplay, data processing, and code completion, hosted on owned GPUs for continuous use.

LLM Price Check aggregates LLM API models and provider details into sortable tables and a cost calculator, showing context windows, input/output cost metrics, and quality indicators to help developers and teams evaluate cost–performance tradeoffs.

Duck.ai offers anonymous access to popular AI models. It ensures privacy by keeping conversations untracked and outside AI training data, with seamless model switching.

Klu accelerates LLM app development by enabling collaborative prompt design, version control, and automated evaluation across multiple providers. It offers unified observability, cost and drift tracking, private infrastructure, continuous monitoring, and integration with 50+ tools for scalable AI de

llmule is a decentralized network that enables users to run AI models locally, ensuring data privacy. It offers a library of community-shared models, promoting flexibility and collaboration while eliminating reliance on cloud services.

LearnHouse is an open‑source LMS that lets educators create courses quickly with a block‑based editor. It supports self‑hosting, a REST API, payments, analytics, AI grading, multi‑tenancy, and integrations like YouTube and Google Analytics.

Uncensored AI delivers a chat platform featuring Claude Opus, Gemini, Grok, and MiniMax M2‑Her. It supports text, audio, image, and code interactions, including image‑to‑video via Image Studio. API beta and usage stats benefit developers, writers, educators, and researchers.

OurToken.ai is a unified LLM API that allows developers to access models from OpenAI, Anthropic, Google, and others through a single integration point. It simplifies multi-provider deployment with smart prompt routing, centralized key management, and built-in usage tracking for cost optimization.

Falcon is an open‑source LLM family by the Technology Innovation Institute, spanning 0.09‑180 B parameters. It offers efficient Falcon‑H1 series, Arabic variants, multimodal Falcon‑3, and Falcon‑Mamba 7B, all under permissive licenses.

Unstract is an open‑source, no‑code platform that automates structured data extraction from unstructured documents using LLMs. It features reusable prompts, Human‑in‑the‑Loop verification, and dual‑LLM hallucination mitigation for secure, compliant use across finance, insurance, and healthcare.

HumanLayer is an open-source IDE and orchestration layer for AI coding agents, managing parallel Claude Code sessions, multiclaude workflows, worktrees and remote workers, with context-engineering tools, session replay, workflow templates and GitHub-integrated code-review automation.

OpenRouter gives one API key to access 300+ models from 60+ providers, SDK‑compatible, with visual routing, automated fall‑back, edge hosting, data‑policy controls, and agentic tools for building efficient autonomous workflows.

Aleph Alpha offers specialized large language models built on EU infrastructure, trained on domain‑specific data for legal, administrative, industrial, and scientific use. It ensures data sovereignty, compliance, and real‑time workflow integration for secure AI in public, manufacturing, and defense

OpenEvidence is a secure medical information platform for U.S. healthcare professionals, facilitating question logging, managing protected health information, and streamlining prior authorization letter writing with access to trusted clinical findings and insights from over 10,000 care centers.

LLMWare AI installs a lightweight client on PCs, providing instant access to 100+ AI models optimized for Intel and Qualcomm hardware. It supports RAG, auto‑tunes weights, runs locally without Wi‑Fi, and offers an admin console for monitoring, scaling, and audit logs.

OpenManus is an open-source framework for building AI agents, offering flexibility and ease of use. It supports RL-based tuning methods like GRPO, allows LLM API configuration, and enables customizable AI-driven workflows with minimal setup, fostering community contributions.

Claude Skills Hub is a platform offering over 33 modular extensions to enhance Claude's functionality, enabling tasks like web asset generation, browser automation, and comprehensive analysis, while supporting user-generated skills in a collaborative environment.

Open Knowledge Maps is an AI search engine that visualizes scientific literature across disciplines, clustering related papers to reveal topic connections and trends. It supports varied document types, offers high‑quality metadata, multilingual browsing, and open‑source integration.

Latitude offers end‑to‑end observability for LLM deployments, recording inputs, outputs, and context. It enables manual annotations, automated error grouping, continuous evaluation, and prompt optimization with GEPA. OTEL telemetry and SDK integrations support major model providers.

Opper is a unified AI gateway and agent control plane that routes requests across 200+ models and modalities, offering centralized model routing, automated fallbacks, budget caps, LLM observability, a multi-provider testing playground, OpenAI-compatible SDK, and enterprise privacy/compliance control

Ollm.com is a confidential AI gateway providing a single API to route across hundreds of LLM models and providers. It ensures enterprise security with zero data retention, confidential computing, and centralized key management for private, compliant AI workloads.

RunningHub is a cloud IDE for ComfyUI workflows, enabling in‑browser design, editing, and GPU‑accelerated execution. It offers pre‑installed nodes, access to major diffusion and video models, training tools, API integration, and real‑time collaboration.

ScienHub is an online LaTeX editor for scientific writing and collaboration. It offers syntax highlighting, auto‑completion, Git integration, AI‑powered language refinement (TeXGPT), pre‑made templates, real‑time shared workspaces, and a responsive interface for desktop and mobile use.

OpenAgents is an open-source framework for building and operating scalable, interoperable AI agent networks. It provides tools to launch, connect, and orchestrate agents with live monitoring, enabling collaborative applications and workflows.

Orq.ai is a generative AI collaboration platform for building, evaluating, and deploying LLM applications. It provides an agent runtime for multi-agent workflows, secure model gateway, RAG-enabled knowledge base, monitoring, evaluation tools, APIs, and governance controls.

CoPaw is an open-source, modular AI agent workstation (Agentscope) for local or cloud deployment, unifying model layers, plugins and long-term memory. It supports local LLMs, multi-channel chat, schedulers and CLI tools for custom agents and workflows.

RunLLM is an AI platform that automates incident investigations by querying observability tools, correlating telemetry, and delivering root-cause analyses. It generates live runbooks and remediation recommendations to accelerate MTTR and create an auditable history of incidents.

The Full Stack offers a complete AI lifecycle curriculum, covering prompt engineering, LLMOps, deep learning, GPU selection, model monitoring, ethics, and MLOps. It trains developers, product managers, and researchers to design, build, and deploy AI applications.