Model Performance Monitoring

Monitaur is an AI governance platform that automates drift, bias, and stress testing for all models. It centralizes policy, risk, and compliance, providing continuous monitoring, vendor controls, and audit‑ready reporting across the entire model lifecycle.

LangWatch enables real‑time testing of LLM agents, offering simulation, prompt management, audit trails, and batch testing across models. It integrates with OpenTelemetry, LangChain, LangGraph, and supports self‑hosted, cloud, and role‑based access.

Real‑time employee monitoring for Windows, macOS, and Linux. Tracks screens, keystrokes, and apps, offering dashboards, analytics, and reports. Supports office, remote, hybrid, and offline modes with time‑tracking, alerts, SSO, API, and compliance‑ready data retention.

VModel provides a unified REST API that lets developers deploy and run custom or community‑built models with a single line of code. It supports Node.js, Python, and cURL for image, text, and video tasks, automatically scaling for production workloads.

Monitor User Flows is a web-based tool that tracks user interactions across applications using various frameworks. It offers real-time monitoring, detailed reporting, and automated testing integrations to help teams identify usability issues and optimize user experiences.

ManageBetter uses AI to automate performance reviews, offering one‑click generation, analytics, 360° feedback, milestone tracking, coaching tools, and real‑time 1:1 scheduling, cutting review time by up to 80% while centralizing data for actionable insights.

LLM Arena enables users to compare multiple large language models side-by-side, analyzing features like accuracy and capabilities. It supports up to 10 models, facilitating informed decision-making for researchers and developers in selecting the right LLM for their needs.

Unsloth Studio is a no-code web UI enabling local training, running, and exporting of open AI models like Qwen3.5 and NVIDIA Nemotron 3, simplifying experimentation for users without extensive technical expertise.

BenchLLM evaluates language‑model applications via API or CLI, running JSON/YAML test suites with automated, interactive, or custom strategies. It supports OpenAI, LangChain, and any API, detecting regressions, generating reports, and visualizing results for continuous QA.

Rolemodel.ai is an AI tool that creates custom avatars and conversational AI assistants to enhance personal growth and productivity. It uses GPT-4 technology and provides expert guidance and resources for its users.

Scorecard is an AI performance management tool that enables teams to create experiments and continuously evaluate AI agents. It integrates development and production environments for efficient testing, feedback, and customizable performance metrics tailored to business needs.

llmarena.ai offers side-by-side LLM comparisons across major providers, showing specs like context window, output capacity, modality and routing options. Filters and role-based categories help developers, ML engineers, product managers and researchers select suitable models.

EvalsOne is an evaluation platform for developers and researchers to assess LLM prompts, RAG, and agents using rule‑based or LLM‑based methods, human judgment, and customizable evaluators. It supports multiple APIs and integrates with major AI frameworks.

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

VMock is an AI platform that delivers feedback on resumes, LinkedIn profiles, and pitches. Its SMART Coach evaluates 100+ criteria, while computer vision, audio, and NLP tools provide guidance, skill mapping, and job‑cluster insights for candidates and career services.

Maxim is an AI evaluation observability platform that aids teams in optimizing product quality through systematic testing, prompt management, dataset curation, and real-time monitoring, all while ensuring secure collaboration and efficient development workflows.

ModelsLab offers API‑based generative AI for image, video, audio, and language tasks, including editing, generation, and voice synthesis. It supports GPU server deployment, custom workflows, fine‑tuning, and LoRA adaptation for creators and developers.

OverallGPT lets users compare text, image, and video AI model outputs side‑by‑side, including custom models. The interface displays parallel responses, helping developers and researchers assess accuracy, relevance, and style to select the best model.

Runway offers Gen‑4.5 generative video and GWM‑1 world models for real‑time simulation, robotics, and interactive environments. Its Characters API creates autonomous video agents from a single image. Ideal for filmmakers, architects, game developers, and educators.

Confident AI is an evaluation platform for assessing large language models, enabling benchmarking, unit testing, and A/B testing. It streamlines dataset management and monitoring, ensuring optimal performance and alignment with benchmarks for LLM applications.

Marlee is an AI platform that measures up to 48 work motivations with high reliability, delivering insights that personalize communication, boost teamwork, reduce conflict, and improve productivity. It also streamlines hiring, onboarding, and career alignment.

Velvet, part of Arize, is a developer gateway that links to Arize’s Unified Observability Platform for real‑time AI feature assessment. It supports open‑source LLM tracing, a LiteLLM gateway with 100+ models, fallback, spend tracking, and cloud or on‑premise deployment.

Klu accelerates LLM app development by enabling collaborative prompt design, version control, and automated evaluation across multiple providers. It offers unified observability, cost and drift tracking, private infrastructure, continuous monitoring, and integration with 50+ tools for scalable AI de

Be Your Best tracks athlete vision and decision‑making by measuring scan rate during gameplay. It offers real‑time data, progress tracking, leaderboards, and analytics for coaches and analysts to enhance tactical flexibility and possession control.

Modal is a cloud‑native platform that lets developers run inference, training, batch jobs, sandboxes, and notebooks with sub‑second cold starts and instant autoscaling. It’s Python‑centric, offers elastic multi‑cloud GPU scaling, zero‑idle scaling, unified observability, and high‑throughput AI‑nativ

gpt-oss playground provides open-weight demos of gpt-oss-120b and 20b for infrastructure testing, distributed and on-device inference, benchmarking, API integration, and reproducible research, with adjustable reasoning levels and visible-reasoning for diagnostics. Demo-only; validate outputs.

Roark - Voice AI Evals provides monitoring and evaluation tools for voice AI, tracking over 40 call metrics, facilitating multi-speaker analysis, and ensuring compliance with regulations while optimizing voice agent performance through customizable dashboards and automated alerts.

Fiddler AI is an observability platform for monitoring AI models, focusing on performance assessment, anomaly detection, and explainable AI. It supports responsible AI practices across sectors like healthcare and finance while integrating with various MLOps tools.

Meta AI Demos is a catalog of experimental models and interactive technical demos from Meta Research, enabling developers and researchers to test image/video segmentation and tracking, audio/video generation, embodied agent and 3D localization models, prototype integrations, and evaluate outputs.

Windmill is an AI-driven performance review tool that streamlines performance management through real-time feedback, automated agendas, custom surveys, and bias reduction, enabling faster reviews and improved employee engagement and satisfaction.

Parea AI tracks LLM calls via Python/TypeScript SDKs, letting teams evaluate models on custom data, spot regressions, iterate prompts in a playground, monitor cost, latency and quality, and collect human annotations for fine‑tuning.

Latitude offers end‑to‑end observability for LLM deployments, recording inputs, outputs, and context. It enables manual annotations, automated error grouping, continuous evaluation, and prompt optimization with GEPA. OTEL telemetry and SDK integrations support major model providers.

Plat.AI is a real‑time decision‑making engine that auto‑builds, deploys, and updates ML models without code. It offers automated preprocessing, one‑click deployment, API integration, and dashboards for performance monitoring and regulatory compliance across finance, insurance, marketing and more.

Respan offers AI observability by tracing prompts, tool calls, and responses, enabling end‑to‑end debugging, evaluation with human, code, and LLM reviews, and real‑time monitoring for quality, cost, and compliance, and deployment orchestration across multiple cloud providers.

Tokenomy is an AI token intelligence platform that offers a token calculator, real-time usage monitoring, and analytical tools. It helps manage token costs, assess GPU memory needs, and evaluate energy consumption for efficient AI model performance.

Graphite Note is a user-friendly, no-code predictive analytics tool for cross-industry teams. It delivers accurate predictions (outcomes, lead conversions), analyzes customer behavior, creates personalized marketing strategies, optimizes campaigns, and forecasts demand, simplifying complex data ana

MESSA delivers structured MUN training with interactive POI exercises at three difficulty levels, speech‑making modules for drafting and rehearsal, progress tracking, personalized improvement tips, and collaborative peer‑review features for flexible, self‑paced study.

Metaview automates candidate sourcing with 24/7 AI agents, generates interview notes and scorecards, and integrates outreach sequencing. It links to ATS, CRM, and scheduling tools, offers real‑time compliance checks, analytics, and DEI insights for secure, compliant talent acquisition.

NOF1 is an AI trading platform linking multiple LLMs to live market execution, model chat logs and a public leaderboard, enabling transparent benchmarking, real‑time P&L, chain‑of‑thought review, strategy-mode analytics and time-series performance charts.

MetaModels.ai transforms static product photos into high‑quality images and videos by draping them onto virtual models and styling options. Users pick models, outfits, and backgrounds, then receive human‑reviewed 4K‑ready files for e‑commerce and marketing.

Middleware.io is an AI-driven cloud observability platform designed for middleware businesses. It provides real-time monitoring of infrastructure, applications, logs, errors, and performance, enabling swift issue resolution and cost-effective observability optimization.

Monetize.AI is a social media analytics tool that tracks video performance across TikTok, Instagram, and YouTube. It provides insights on engagement and trends to help you optimize your content strategy.

ExamOnline offers a secure remote proctoring solution for online examinations, featuring customizable settings, AI-based monitoring, and a secure browser. It integrates with LMS, ensuring exam integrity while reducing logistical costs for organizations.

MLflow is an open‑source AI engineering platform that tracks LLM and agent execution, monitors performance, cost, and safety, manages prompts, and supports experiment tracking, tuning, and deployment across multiple clouds or on‑premises.

HoneyHive delivers AI observability and evaluation for production agents, offering OpenTelemetry tracing across 100+ LLMs, live metrics on quality, safety, latency, cost, drift alerts, offline experimentation, expert annotation, CI/CD integration, and enterprise security.

Waikay is a platform that helps brands understand and manage how AI models perceive their brand identity, providing insights into AI-driven conversations and potential misinformation across leading platforms.

Web‑based bike fitting that mimics professional studios. Riders complete a mobility check, record a stationary‑trainer video, and receive AI‑generated sizing and position recommendations. Fitters and coaches track progress, set goals, and compare models through a unified dashboard.

H2O.ai delivers an end‑to‑end AI platform that automates feature engineering, model selection, and explainability through AutoML, offers no‑code LLM training, supports enterprise multi‑model orchestration, and includes MLOps and a feature store, all compliant with strict data security standards.

Jungle AI provides real‑time performance monitoring for industrial assets using unsupervised learning. It ingests sensor data, eliminates on‑site hardware, offers context‑sensitive alarms, and predicts failures to enhance wind, solar, and maritime operations and maintenance.

Kling AI Motion Control turns a single static image into a realistic, physics‑based animated video. It automatically generates motion paths, applies dynamic effects, and outputs smooth, cinematic clips, supporting batch processing and custom parameters for marketers, designers, and creators.