Model Evaluation AI tools with API

Tokenomy is an AI token intelligence platform that...

Tokenomy is an AI token intelligence platform that offers a token calculator, real-time usage monitoring, and analytical tools. It helps manage token costs, assess GPU memory needs, and evaluate energy consumption for efficient AI model performance.

Rival is an AI model comparison platform that allo...

Rival is an AI model comparison platform that allows users to analyze and compare various AI models based on performance metrics and capabilities, facilitating informed decisions for developers and businesses in selecting tailored AI solutions.

Anomalo automates data quality across structured, ...

Anomalo automates data quality across structured, semi‑structured, and unstructured data in cloud lakes and warehouses. Using unsupervised ML, it detects anomalies, validates completeness, enforces governance without code, and offers lineage mapping and KPI tracking.

Plat.AI is a real‑time decision‑making engine that...

Plat.AI is a real‑time decision‑making engine that auto‑builds, deploys, and updates ML models without code. It offers automated preprocessing, one‑click deployment, API integration, and dashboards for performance monitoring and regulatory compliance across finance, insurance, marketing and more.

HoneyHive delivers AI observability and evaluation...

HoneyHive delivers AI observability and evaluation for production agents, offering OpenTelemetry tracing across 100+ LLMs, live metrics on quality, safety, latency, cost, drift alerts, offline experimentation, expert annotation, CI/CD integration, and enterprise security.

Langtrace is an open‑source observability platform...

Langtrace is an open‑source observability platform that traces AI agent interactions, collects metrics such as token usage, cost, latency, and accuracy, and supports OTEL, major frameworks, and LLM providers. It offers on‑prem deployment, SOC 2 Type II compliance, and fine‑grained access control.

EvalsOne is an evaluation platform for developers ...

EvalsOne is an evaluation platform for developers and researchers to assess LLM prompts, RAG, and agents using rule‑based or LLM‑based methods, human judgment, and customizable evaluators. It supports multiple APIs and integrates with major AI frameworks.

LangWatch enables real‑time testing of LLM agents,...

LangWatch enables real‑time testing of LLM agents, offering simulation, prompt management, audit trails, and batch testing across models. It integrates with OpenTelemetry, LangChain, LangGraph, and supports self‑hosted, cloud, and role‑based access.