Llm Inference Api

LiteLLM is an open‑source gateway that unifies access to 100+ LLMs through a single OpenAI‑compatible API, enabling provider fallback, cost tracking, tag‑based budgeting, guardrails, observability, and on‑prem or cloud deployment with a lightweight SDK.

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

LLMAPI is a unified OpenAI-compatible LLM gateway offering access to 100+ models across providers, centralized API key management, failover routing, performance and cost analytics, and team-oriented key controls to simplify integration and operations.

BenchLLM evaluates language‑model applications via API or CLI, running JSON/YAML test suites with automated, interactive, or custom strategies. It supports OpenAI, LangChain, and any API, detecting regressions, generating reports, and visualizing results for continuous QA.

LLM Pulse tracks brand visibility and search presence across LLMs (ChatGPT, Perplexity, Google AI), offering prompt tracking and suggestions, citation analysis, visibility scoring and competitor benchmarking, sentiment and response inspection, plus API and reporting exports.

Inception Labs' diffusion-based large language models (dLLMs) offer faster, more efficient, and cost-effective text generation than traditional autoregressive models. With built-in error correction, multimodal support, and structured output control, they excel in function calling and complex data ge

LLM Price Check aggregates LLM API models and provider details into sortable tables and a cost calculator, showing context windows, input/output cost metrics, and quality indicators to help developers and teams evaluate cost–performance tradeoffs.

LLM Arena enables users to compare multiple large language models side-by-side, analyzing features like accuracy and capabilities. It supports up to 10 models, facilitating informed decision-making for researchers and developers in selecting the right LLM for their needs.

Awan LLM offers unlimited token generation with Meta Llama 3.1 8B and 70B models, no censorship or caps, supporting persistent AI assistance, autonomous agents, roleplay, data processing, and code completion, hosted on owned GPUs for continuous use.

LLMWare AI installs a lightweight client on PCs, providing instant access to 100+ AI models optimized for Intel and Qualcomm hardware. It supports RAG, auto‑tunes weights, runs locally without Wi‑Fi, and offers an admin console for monitoring, scaling, and audit logs.

LlamaIndex enables efficient development of AI knowledge assistants for enterprise data management, allowing users to parse complex documents and integrate various data sources, ultimately streamlining workflows and optimizing knowledge management across multiple sectors.

RunLLM is an AI platform that automates incident investigations by querying observability tools, correlating telemetry, and delivering root-cause analyses. It generates live runbooks and remediation recommendations to accelerate MTTR and create an auditable history of incidents.

Morphllmis a high-throughput AI code-editing platform that applies LLM-generated multi-file edits, automated diffs, and merges at 10,500+ tokens/sec via edit_file and MCP/OpenAI-compatible SDKs (TypeScript, Python) for editor, CI, and agent integration. It combines warp-grep/warpsearch semantic co

LLMStack is an open‑source platform that lets developers build AI agents and workflows without coding, supports multiple model providers, imports data from web, PDFs, audio, cloud services, and offers a collaborative React UI with granular permissions.

LLM Pricing Comparison lets developers and businesses compare token costs, context lengths, and modalities for major large‑language models. An interactive calculator estimates application expenses based on input/output token volumes, helping teams budget AI workloads accurately.

UBIAI fine‑tunes LLMs with classifiers, retrievers, and reasoning. It automates PDF/DOCX labeling, synthetic data, and quality filtering; offers 15‑minute prompt‑level tuning or 2‑4 hour weight training; exports to GGUF, safetensors, or Hugging Face for API or custom deployment.

Upstage AI delivers enterprise LLMs and document-processing tools: low-latency and Japan-specific models, PDF/OCR parsing, structured information extraction, centralized search and Q&A with citations, REST/AWS/on‑prem deployment, and team collaboration for review.

Code Snippets AI indexes full codebases to deliver contextual insights, auto‑generated comments, and precise snippet recommendations. It tracks LLM usage, supports multi‑model chat, offers role‑based collaboration, and integrates with macOS and Windows via API.

LLMChat is an AI chat tool that offers a beta version experience with diverse AI models, personalized memory, custom assistant creation, and privacy-focused locally stored conversations. Explore features like plugin integration, tailored preferences, and prompt examples for various tasks.

DeepSeek API, available via Kie.ai, provides access to DeepSeek models R1 and V3 for complex reasoning and natural language processing.

Wafer AI is a serverless inference platform that lets you run open-source LLMs in production with OpenAI-compatible APIs. It offers dedicated endpoints with optimized performance, long-context support, and caching to reduce costs for coding, reasoning, and agent workloads.

MLflow is an open‑source AI engineering platform that tracks LLM and agent execution, monitors performance, cost, and safety, manages prompts, and supports experiment tracking, tuning, and deployment across multiple clouds or on‑premises.

LMQL is a Python‑based language that enables modular, constraint‑driven prompts for large language models. It supports nested queries, type‑enforced outputs, and runtime distribution checks while switching between backends such as llama.cpp, OpenAI, and Hugging Face.

Unstract is an open‑source, no‑code platform that automates structured data extraction from unstructured documents using LLMs. It features reusable prompts, Human‑in‑the‑Loop verification, and dual‑LLM hallucination mitigation for secure, compliant use across finance, insurance, and healthcare.

LLMWizard offers access to multiple AI models like GPT-4o and DALL-E 3, enabling users to automate tasks across coding, legal work, and content creation. The platform supports real-time comparison of AI responses for diverse insights.

Sapling offers a language‑model API that delivers real‑time grammar corrections in enterprise workspaces and messaging platforms. Developers embed it into editors, CRMs, and customer‑service tools with a simple SDK/API, while the platform supports private cloud, encryption, PII redaction, SSO, and s

mancer delivers unfiltered large‑language‑model inference on high‑end hardware. After signing up, users select a model and prompt immediately, with no output filtering or moderation. The platform supports multiple model tiers and provides Discord and email support.

VLLM is a high-throughput, memory-efficient inference engine for Large Language Models, enabling faster responses and effective memory management. It supports multi-node configurations for scalability and offers robust documentation for seamless integration into workflows.

NotebookLM is an AI-powered research assistant designed to help users summarize and connect information from sources like PDFs, websites, videos, and audio. It offers detailed insights, citations, and an 'Audio Overview' feature for on-the-go engagement.

Mistral AI offers developers a platform for building cutting-edge generative AI models with a focus on performance and customization. Their models excel in reasoning tasks and benchmarks, providing flexible deployment options across infrastructures.

llmarena.ai offers side-by-side LLM comparisons across major providers, showing specs like context window, output capacity, modality and routing options. Filters and role-based categories help developers, ML engineers, product managers and researchers select suitable models.

Linnk AI's Instant Insight Page streamlines content analysis and information retrieval with automated features. Users can quickly summarize, extract insights, filter out fluff content, and bridge language barriers effortlessly.

OurToken.ai is a unified LLM API that allows developers to access models from OpenAI, Anthropic, Google, and others through a single integration point. It simplifies multi-provider deployment with smart prompt routing, centralized key management, and built-in usage tracking for cost optimization.

Instant Insight Page by Linnk AI simplifies webpage summaries, eliminates clickbait, and delivers direct answers for efficient content consumption. Bridge language barriers, get concise information, and bid farewell to misleading headlines.

SiliconFlow is an AI infrastructure platform enabling high-speed inference for LLMs and multimodal applications, supporting serverless, reserved, and private-cloud deployments. It offers low-latency processing, elastic compute, and built-in monitoring for scalable, cost-efficient AI workloads.

AIMLAPI.com offers a unified API endpoint for over 400 AI models spanning chat, image, video, audio, voice, text, 3D, and OCR. It supports sandbox testing, granular access control, batch requests, and an OpenClaw runtime for secure, human‑in‑the‑loop workflows.

Llama is a local AI tool that enables users to create customizable and efficient language models without relying on cloud-based platforms, available for download on MacOS, Windows, and Linux.

Open‑source AI code‑review platform that plugs into GitHub, GitLab, Bitbucket, and Azure DevOps at the pull‑request level. Model‑agnostic, it runs custom rule sets, tracks technical debt, and delivers real‑time metrics without storing source code.

ModelsLab offers API‑based generative AI for image, video, audio, and language tasks, including editing, generation, and voice synthesis. It supports GPU server deployment, custom workflows, fine‑tuning, and LoRA adaptation for creators and developers.

Copyleaks delivers AI text and image detection, plagiarism checking, grammar correction, and text moderation in 30+ languages. It integrates via API, LMS, browser extensions, and Google Docs, supports major LLMs, and ensures secure, compliant workflows for education and enterprise.

Luminance is a Legal-Grade AI platform for enterprise contract lifecycle management that automates drafting and clause population, reviews and extracts obligations, deadlines and risks at scale, supports AI-assisted negotiation/redlining in Word, and tracks compliance and obligations.

LLM SEO Report generates detailed SEO analyses for brands by assessing visibility across major AI platforms. It provides actionable recommendations to optimize online presence and adapt to evolving search trends influenced by AI technologies.

SurfSense is an open-source team collaboration tool built as an alternative to NotebookLM, connecting LLMs to internal knowledge sources for real-time chat, research, and workflow automation with cited answers.

LangWatch enables real‑time testing of LLM agents, offering simulation, prompt management, audit trails, and batch testing across models. It integrates with OpenTelemetry, LangChain, LangGraph, and supports self‑hosted, cloud, and role‑based access.

Portkey is an LLMOps platform offering a unified API and model catalog with observability, guardrails, RBAC, audit logs, prompt management, caching, routing and PII redaction to simplify multi-model integration, governance, monitoring, and cost optimization.

Confident AI is an evaluation platform for assessing large language models, enabling benchmarking, unit testing, and A/B testing. It streamlines dataset management and monitoring, ensuring optimal performance and alignment with benchmarks for LLM applications.

LLM Selector filters open‑source large language models by use case—chatbots, content, code, summarization, research—while presenting benchmarks, training data, architecture, and deployment details. The interface updates regularly to aid researchers, developers, and product managers in data‑driven mo

LastMile AI is a platform that perceives, remembers, and reasons from vision, speech, and text using LLMs as CPU and context as RAM. It connects to tools, automates workflows, anticipates needs, and surfaces actionable insights for teams and organizations.

Eden AI offers a single API that consolidates LLMs, vision, OCR, speech, translation, and more from Meta, Mistral, AWS, Azure, Google, and OpenAI. It provides smart routing, fallback, cost/latency selection, batch processing, caching, and multi‑API key management.

AIHubMix is a single API gateway to major LLMs and multimodal models, enabling model selection, automatic routing, orchestration and SDKs for text, code, image, video and embedding workflows, with native search, concurrency and production-ready infrastructure.