Infrastructure tools AI tools

Lemonade is a self-hosted local AI platform offeri...

Lemonade is a self-hosted local AI platform offering GUI, CLI, REST API and SDKs to host and run multimodal models (text, image, code, speech), manage model lifecycle, benchmark inference, deploy on-prem agents, and keep data local.

Odysseus is a privacy-first, self-hosted AI worksp...

Odysseus is a privacy-first, self-hosted AI workspace for running and serving local LLMs, autonomous agents, and multi-turn chat, offering model management, hardware-aware serving, built-in tools, persistent memory, research workflows, and integrations.

EmpirioLabs AI is a platform for hosting, deployin...

EmpirioLabs AI is a platform for hosting, deploying, and scaling open-source and proprietary AI models via API or web playground. It supports multimodal, long-context models with optimized endpoints, creative templates, and high-throughput rate limits for production workloads.

Dedalus Labs offers persistent full Linux VMs with...

Dedalus Labs offers persistent full Linux VMs with VM-level kernel, memory and filesystem isolation, fast boot under 250 ms, preserved state across sessions, and CLI/API/SSH access for reproducible development, long-running agents, CI, and model workloads.

General Compute is an OpenAI-compatible inference ...

General Compute is an OpenAI-compatible inference API using custom ASIC accelerators to deliver high throughput (e.g., 950 tokens/sec) and dramatically lower power consumption (≈17 kW vs. 120 kW per rack), enabling developers to switch providers by simply changing the base URL and API key. It supports REST endpoints, streaming, SDKs, and deployment options from shared models to dedicated infrastructure with SLAs.

GPU Mart provides dedicated GPU server hosting and...

GPU Mart provides dedicated GPU server hosting and VPS solutions optimized for demanding AI workloads, including LLM inference, image generation, and 3D rendering, offering guaranteed resources and transparent pricing.

Open-source desktop app for running local LLMs on ...

Open-source desktop app for running local LLMs on Windows/macOS/Linux, supporting text and multimodal inputs, file attachments, multiple model backends with hot-switching, chat/instruction modes, prompt-engineering tools, API/tool-calling, extensibility, and conversation branching.

Unsloth Studio is a no-code web UI enabling local ...

Unsloth Studio is a no-code web UI enabling local training, running, and exporting of open AI models like Qwen3.5 and NVIDIA Nemotron 3, simplifying experimentation for users without extensive technical expertise.

OmniRoute is an open-source AI gateway that routes...

OmniRoute is an open-source AI gateway that routes requests to 236 LLM providers via a single /v1 endpoint, offering multi-provider routing with auto-fallback, token compression, persistent memory, resilience controls, MCP/A2A support, and self-hosted analytics.

netpilot.io is an AI-powered network lab platform ...

netpilot.io is an AI-powered network lab platform that translates plain-English descriptions into fully deployed, multi-vendor topologies with real CLIs for Cisco, Juniper, Arista, Nokia, and FRR. It enables rapid change validation, bug reproduction, and pre/post testing through cloud-native or air-gapped deployments, integrating with CI/CD and inventory systems for automated, production-matched digital twins.

auriko.ai is a cache-aware LLM inference platform ...

auriko.ai is a cache-aware LLM inference platform that optimizes cost and latency by routing requests across multiple providers based on real-time pricing and prompt-caching behavior. It offers a unified, OpenAI-compatible API with global edge routing, automatic failover, and seamless integration with major ecosystems like LangChain and Vercel.

VLLM is a high-throughput, memory-efficient infere...

VLLM is a high-throughput, memory-efficient inference engine for Large Language Models, enabling faster responses and effective memory management. It supports multi-node configurations for scalability and offers robust documentation for seamless integration into workflows.

MimicPC is a cloud-based AI tool for image generat...

MimicPC is a cloud-based AI tool for image generation and AI application deployment in the cloud, offering over 20 pre-deployment applications, including Stable Diffusion.

Llama.cpp is an open-source tool for efficient inf...

Llama.cpp is an open-source tool for efficient inference of large language models. Run open source LLM models locally everywhere.

KoboldCpp is a versatile AI text-generation tool t...

KoboldCpp is a versatile AI text-generation tool that supports various GGML and GGUF models with an intuitive UI, native image generation, and enhanced performance via CUDA and CLBlast acceleration.

Groq is an inference platform that uses custom LPU...

Groq is an inference platform that uses custom LPU silicon for low‑latency, high‑throughput AI workloads. It supports large language and multimodal models via an OpenAI‑compatible API, with modular deployment and predictable performance for NLP, vision, and recommendation tasks.

LM Studio runs open‑source large language models l...

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

Llama is a local AI tool that enables users to cre...

Llama is a local AI tool that enables users to create customizable and efficient language models without relying on cloud-based platforms, available for download on MacOS, Windows, and Linux.

AI Horde is a community‑powered platform that harn...

AI Horde is a community‑powered platform that harnesses volunteer CPU/GPU resources to generate images, text, and utilities via an open REST API. Users can access it through web apps, earn kudos for queue priority, and view real‑time throughput stats.