What is NewAPI?
NewAPI is an open-source AI API gateway that exposes a single OpenAI-compatible API to connect 30+ upstream providers, including OpenAI, Anthropic (Claude), Google Gemini, XAI (Grok), Azure OpenAI and AWS Bedrock.
It provides a self-hosted control panel for managing model routing, channel-based mapping, load-balancing weights, priority failover and multi-vendor routing without application code changes.
Centralized API key management issues per-user keys with configurable quotas, rate limits and group access while storing upstream credentials server-side.
Built-in usage logging and monitoring capture model, token counts, latency and status for per-user and per-channel consumption visibility.
Deployments support Docker or standalone binaries and are compatible with SQLite, MySQL and PostgreSQL to keep data on customer infrastructure.
Common use cases include team platforms, internal tools, public products and OpenAI-compatible migrations that require unified access, quota control, usage visibility and multi-supplier cost tracking.
NewAPI user reviews
Would you recommend NewAPI?
NewAPI's key features
-
OpenAI-compatible API gateway connecting multiple upstream providers (OpenAI, Anthropic Claude, Google Gemini, XAI Grok, Azure OpenAI, AWS Bedrock)
-
Self-hosted control panel for model routing, channel-based mapping, load-balancing weights, priority failover, and multi-vendor routing without application code changes
-
Centralized API key management issuing per-user keys with configurable quotas, rate limits, group access, and server-side upstream credential storage
-
Built-in usage logging and monitoring capturing model, token counts, latency, and status for per-user and per-channel consumption visibility
-
Deployable via Docker or standalone binaries and compatible with SQLite, MySQL, and PostgreSQL for on-premises data storage
NewAPI use cases
-
Deploy a self-hosted AI API gateway that routes requests across 30+ providers with built-in load balancing, failover and on‑premise model hosting to maintain low latency, high availability and keep sensitive data on your infrastructure
-
Centralize API key issuance, per‑user quota management and usage logging to power a SaaS product—enforce rate limits, integrate billing and cost controls, and monitor consumption for compliance and cost optimization
-
Use the control panel to orchestrate multi‑provider model routing by cost, performance or regulatory requirements, with detailed logs and monitoring for audit trails and seamless provider fallback
Who is it for?
-
Software developers
-
Ml engineers
-
Platform engineers
-
Ctos
-
Product teams