Infrastructure tools AI tools with API

Odysseus is a privacy-first, self-hosted AI worksp...

Odysseus is a privacy-first, self-hosted AI workspace for running and serving local LLMs, autonomous agents, and multi-turn chat, offering model management, hardware-aware serving, built-in tools, persistent memory, research workflows, and integrations.

EmpirioLabs AI is a platform for hosting, deployin...

EmpirioLabs AI is a platform for hosting, deploying, and scaling open-source and proprietary AI models via API or web playground. It supports multimodal, long-context models with optimized endpoints, creative templates, and high-throughput rate limits for production workloads.

Dedalus Labs offers persistent full Linux VMs with...

Dedalus Labs offers persistent full Linux VMs with VM-level kernel, memory and filesystem isolation, fast boot under 250 ms, preserved state across sessions, and CLI/API/SSH access for reproducible development, long-running agents, CI, and model workloads.

General Compute is an OpenAI-compatible inference ...

General Compute is an OpenAI-compatible inference API using custom ASIC accelerators to deliver high throughput (e.g., 950 tokens/sec) and dramatically lower power consumption (≈17 kW vs. 120 kW per rack), enabling developers to switch providers by simply changing the base URL and API key. It supports REST endpoints, streaming, SDKs, and deployment options from shared models to dedicated infrastructure with SLAs.

GPU Mart provides dedicated GPU server hosting and...

GPU Mart provides dedicated GPU server hosting and VPS solutions optimized for demanding AI workloads, including LLM inference, image generation, and 3D rendering, offering guaranteed resources and transparent pricing.

Open-source desktop app for running local LLMs on ...

Open-source desktop app for running local LLMs on Windows/macOS/Linux, supporting text and multimodal inputs, file attachments, multiple model backends with hot-switching, chat/instruction modes, prompt-engineering tools, API/tool-calling, extensibility, and conversation branching.

CloudCLI AI is a containerized remote development ...

CloudCLI AI is a containerized remote development platform that provides persistent, cross-device coding sessions. It integrates AI coding agents, supports major IDEs, and offers team features for shared environments and configurations.

OmniRoute is an open-source AI gateway that routes...

OmniRoute is an open-source AI gateway that routes requests to 236 LLM providers via a single /v1 endpoint, offering multi-provider routing with auto-fallback, token compression, persistent memory, resilience controls, MCP/A2A support, and self-hosted analytics.

Netify Application Lookup provides a categorized i...

Netify Application Lookup provides a categorized index and downloadable datasets of detected websites, apps, IPs and protocols via APIs and feeds (including VPN/Tor/WiFi Calling), enabling traffic classification, policy enforcement, capacity planning and incident response.

Brainboard is a visual Infrastructure-as-Code desi...

Brainboard is a visual Infrastructure-as-Code designer that generates Terraform/OpenTofu modules, offers one-click IaC migration, a central module registry and self-service catalogs, integrates with GitOps/CI-CD, and enforces governance with RBAC, templating and drift remediation.

ComfyDeploy is an open-source tool for deploying C...

ComfyDeploy is an open-source tool for deploying ComfyUI workflows, enabling instant sharing, auto-scaling for GPUs, version control, and custom node integration, while supporting external input nodes and private S3 for efficient performance validation.

Stakpak is an AI DevOps terminal that streamlines ...

Stakpak is an AI DevOps terminal that streamlines the management of cloud infrastructure, automates application containerization, and enhances troubleshooting. It integrates with existing tools, provides cost insights, and supports CI/CD pipelines in an open-source framework.

llmule is a decentralized network that enables use...

llmule is a decentralized network that enables users to run AI models locally, ensuring data privacy. It offers a library of community-shared models, promoting flexibility and collaboration while eliminating reliance on cloud services.

BestProxy is a high-performance proxy service offe...

BestProxy is a high-performance proxy service offering global residential proxies with 80M+ IPs, unlimited bandwidth, and advanced management tools for AI data extraction

Schematic decouples pricing and entitlements from ...

Schematic decouples pricing and entitlements from product code, enabling SaaS teams to meter seats, credits, tokens, API calls and MAUs, enforce limits/overages, manage plans and feature flags via a config-driven catalog, integrate with Stripe, and surface revenue insights.

Vast.ai supplies on‑demand GPU instances, includin...

Vast.ai supplies on‑demand GPU instances, including NVIDIA RTX, H100, and Blackwell models, deployable in seconds. Developers can programmatically provision resources via CLI, SDK or API, and scale workloads with autoscaling, serverless inference, and dedicated InfiniBand clusters.

K8Studio is a client‑side Kubernetes GUI that conn...

K8Studio is a client‑side Kubernetes GUI that connects directly to cluster APIs, providing real‑time topology maps, AI‑assisted YAML editing, a unified security dashboard, multi‑cluster management, built‑in terminal execution, and no data collection for compliance.

web3.com ventures focuses on scalable infrastructu...

web3.com ventures focuses on scalable infrastructure within the web3 ecosystem, enhancing product development in AI, DeFi, and privacy technologies. It provides developers with foundational tools to build diverse applications efficiently and securely.

VLLM is a high-throughput, memory-efficient infere...

VLLM is a high-throughput, memory-efficient inference engine for Large Language Models, enabling faster responses and effective memory management. It supports multi-node configurations for scalability and offers robust documentation for seamless integration into workflows.

ClearML AI Infrastructure Platform unifies GPU man...

ClearML AI Infrastructure Platform unifies GPU management, model development, and generative‑AI deployment across on‑prem, cloud, and hybrid setups, offering secure multi‑tenant provisioning, priority scheduling, fractional GPU allocation, integrated IDE, CI/CD, and streamlined workflows for data scientists, engineers, and DevOps.

MimicPC is a cloud-based AI tool for image generat...

MimicPC is a cloud-based AI tool for image generation and AI application deployment in the cloud, offering over 20 pre-deployment applications, including Stable Diffusion.

Llama.cpp is an open-source tool for efficient inf...

Llama.cpp is an open-source tool for efficient inference of large language models. Run open source LLM models locally everywhere.

ZGI is an AI‑native data platform that enables rap...

ZGI is an AI‑native data platform that enables rapid creation, integration, and deployment of intelligent agent applications. It automates schema inference, data import, and semantic search across 1,000+ models, with workflow design, multi‑agent orchestration, and secure connectors for enterprise use.

KoboldCpp is a versatile AI text-generation tool t...

KoboldCpp is a versatile AI text-generation tool that supports various GGML and GGUF models with an intuitive UI, native image generation, and enhanced performance via CUDA and CLBlast acceleration.

Vectorize is a modular AI platform for building, d...

Vectorize is a modular AI platform for building, deploying, and managing intelligent agents with persistent memory. It offers end‑to‑end context engineering, data connectors, automated pipelines, semantic search, and enterprise security for reliable RAG solutions.

local.ai runs language models locally without GPUs...

local.ai runs language models locally without GPUs. Its Rust backend keeps the binary under 10 MB and performs CPU inference with GGML quantization. A single‑click interface streams responses to a UI, while a model manager tracks, verifies, and resumes downloads.

SvectorDB is a serverless AWS vector database that...

SvectorDB is a serverless AWS vector database that supports instant upserts, deletions, and hybrid vector‑Lucene searches. It offers built‑in text and image vectorizers, custom embedding import, and scales to one million records per database.

Modal is a cloud‑native platform that lets develop...

Modal is a cloud‑native platform that lets developers run inference, training, batch jobs, sandboxes, and notebooks with sub‑second cold starts and instant autoscaling. It’s Python‑centric, offers elastic multi‑cloud GPU scaling, zero‑idle scaling, unified observability, and high‑throughput AI‑native runtime and storage.

Groq is an inference platform that uses custom LPU...

Groq is an inference platform that uses custom LPU silicon for low‑latency, high‑throughput AI workloads. It supports large language and multimodal models via an OpenAI‑compatible API, with modular deployment and predictable performance for NLP, vision, and recommendation tasks.

LM Studio runs open‑source large language models l...

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.