Python Llm Workflow Framework

LLMStack is an open‑source platform that lets developers build AI agents and workflows without coding, supports multiple model providers, imports data from web, PDFs, audio, cloud services, and offers a collaborative React UI with granular permissions.

LM Studio runs open‑source large language models locally on Mac (M‑series), Windows, and Linux, enabling private, offline inference. It offers command‑line and headless deployment, server‑side API, SDKs, a model hub, and LM Link for remote model access.

LlamaIndex enables efficient development of AI knowledge assistants for enterprise data management, allowing users to parse complex documents and integrate various data sources, ultimately streamlining workflows and optimizing knowledge management across multiple sectors.

LMQL is a Python‑based language that enables modular, constraint‑driven prompts for large language models. It supports nested queries, type‑enforced outputs, and runtime distribution checks while switching between backends such as llama.cpp, OpenAI, and Hugging Face.

LLMWizard offers access to multiple AI models like GPT-4o and DALL-E 3, enabling users to automate tasks across coding, legal work, and content creation. The platform supports real-time comparison of AI responses for diverse insights.

LiteLLM is an open‑source gateway that unifies access to 100+ LLMs through a single OpenAI‑compatible API, enabling provider fallback, cost tracking, tag‑based budgeting, guardrails, observability, and on‑prem or cloud deployment with a lightweight SDK.

HumanLayer is an open-source IDE and orchestration layer for AI coding agents, managing parallel Claude Code sessions, multiclaude workflows, worktrees and remote workers, with context-engineering tools, session replay, workflow templates and GitHub-integrated code-review automation.

Llama is a local AI tool that enables users to create customizable and efficient language models without relying on cloud-based platforms, available for download on MacOS, Windows, and Linux.

Llama.cpp is an open-source tool for efficient inference of large language models. Run open source LLM models locally everywhere.

MLflow is an open‑source AI engineering platform that tracks LLM and agent execution, monitors performance, cost, and safety, manages prompts, and supports experiment tracking, tuning, and deployment across multiple clouds or on‑premises.

Morphllmis a high-throughput AI code-editing platform that applies LLM-generated multi-file edits, automated diffs, and merges at 10,500+ tokens/sec via edit_file and MCP/OpenAI-compatible SDKs (TypeScript, Python) for editor, CI, and agent integration. It combines warp-grep/warpsearch semantic co

little-coder is a Pi-based coding agent for running 5–25 GB local LLMs via llama.cpp or Ollama, offering Python/Node CLIs and TypeScript extensions, reproducible benchmarks, build/serve guides, and tools for local code generation, on-device development, and evaluation.

CoPaw is an open-source, modular AI agent workstation (Agentscope) for local or cloud deployment, unifying model layers, plugins and long-term memory. It supports local LLMs, multi-channel chat, schedulers and CLI tools for custom agents and workflows.

Output.ai is an open-source TypeScript framework for building, testing, and running production AI workflows with built-in tracing and evaluation. It centralizes prompts, configs, and tests in Git, enabling durable execution and team collaboration through CLI tooling and a GitHub-first structure.

Inception Labs' diffusion-based large language models (dLLMs) offer faster, more efficient, and cost-effective text generation than traditional autoregressive models. With built-in error correction, multimodal support, and structured output control, they excel in function calling and complex data ge

Gumloop is an AI automation framework that allows users to create complex workflows visually, leveraging API integrations and ready-made components for tasks like data scraping and document processing, while ensuring data security through SOC 2 Type II certification and GDPR compliance.

BenchLLM evaluates language‑model applications via API or CLI, running JSON/YAML test suites with automated, interactive, or custom strategies. It supports OpenAI, LangChain, and any API, detecting regressions, generating reports, and visualizing results for continuous QA.

Portkey is an LLMOps platform offering a unified API and model catalog with observability, guardrails, RBAC, audit logs, prompt management, caching, routing and PII redaction to simplify multi-model integration, governance, monitoring, and cost optimization.

Open‑source AI code‑review platform that plugs into GitHub, GitLab, Bitbucket, and Azure DevOps at the pull‑request level. Model‑agnostic, it runs custom rule sets, tracks technical debt, and delivers real‑time metrics without storing source code.

###workflow is a project management tool that enhances creative collaboration by organizing assets, tracking tasks, and managing feedback with features like centralized inboxes and version control, streamlining workflow and improving project quality for teams.

LabEx delivers free, interactive labs for Linux, DevOps, and cybersecurity, organized into skill‑tree pathways. AI assistant Labby aids debugging, while online terminals and real‑world projects cover Docker, Kubernetes, Python, Java, Ansible, and more.

VLLM is a high-throughput, memory-efficient inference engine for Large Language Models, enabling faster responses and effective memory management. It supports multi-node configurations for scalability and offers robust documentation for seamless integration into workflows.

LLM Arena enables users to compare multiple large language models side-by-side, analyzing features like accuracy and capabilities. It supports up to 10 models, facilitating informed decision-making for researchers and developers in selecting the right LLM for their needs.

Workfusionapp is an open-source automation workspace for building, prototyping, and orchestrating AI and rule-based workflows; supports Python, Next.js, Vue, Streamlit, Gradio, multiple AI models, API/data integrations, GitHub versioning, scheduling, monitoring, and logging.

Code Snippets AI indexes full codebases to deliver contextual insights, auto‑generated comments, and precise snippet recommendations. It tracks LLM usage, supports multi‑model chat, offers role‑based collaboration, and integrates with macOS and Windows via API.

LLMWare AI installs a lightweight client on PCs, providing instant access to 100+ AI models optimized for Intel and Qualcomm hardware. It supports RAG, auto‑tunes weights, runs locally without Wi‑Fi, and offers an admin console for monitoring, scaling, and audit logs.

commandcode.ai is a developer-centric CLI tool for interacting with multiple large language models, managing sessions with sliding-window memory, and automating long-running AI workflows. It supports model switching, vision tasks, background shell operations, and persisted, resumeable sessions for r

exllama is a memory-efficient tool for executing Hugging Face transformers with the LLaMA models using quantized weights, enabling high-performance NLP tasks on modern GPUs while minimizing memory usage and supporting various hardware configurations.

LLMAPI is a unified OpenAI-compatible LLM gateway offering access to 100+ models across providers, centralized API key management, failover routing, performance and cost analytics, and team-oriented key controls to simplify integration and operations.

llmule is a decentralized network that enables users to run AI models locally, ensuring data privacy. It offers a library of community-shared models, promoting flexibility and collaboration while eliminating reliance on cloud services.

Dify is an open‑source, drag‑and‑drop platform that lets teams build agentic workflows and RAG pipelines without code, supports multiple LLMs and external data sources, offers observability, modular API integrations, and can serve as an MLP server.

LLMChat is an AI chat tool that offers a beta version experience with diverse AI models, personalized memory, custom assistant creation, and privacy-focused locally stored conversations. Explore features like plugin integration, tailored preferences, and prompt examples for various tasks.

Orq.ai is a generative AI collaboration platform for building, evaluating, and deploying LLM applications. It provides an agent runtime for multi-agent workflows, secure model gateway, RAG-enabled knowledge base, monitoring, evaluation tools, APIs, and governance controls.

LexWorkplace is a cloud-based document and email management solution for law firms, offering features like advanced search, secure sharing, Microsoft Office integration, and robust data security to enhance efficiency and organization in legal practices.

Metaflow is an open‑source Python framework for building, managing, and deploying ML workflows. It supports local development, seamless cloud migration, automatic variable tracking, compute scaling, versioned workflow storage, and one‑click production rollout.

Composio.dev is an AI-powered integration platform that connects developers to 250+ apps with a single line of code, automating workflows across tools like GitHub and Slack. It offers managed auth, RPA, and error handling while remaining LLM-agnostic for flexibility.

LM Studio is a local platform for running various large language models like Llama 2 and Mistral. It offers an offline environment, user-friendly interface, and supports multiple operating systems, enhancing privacy and allowing for simultaneous model execution.

n8n is an open‑source workflow automation platform with a visual canvas and custom JavaScript/Python support. It connects to 500+ integrations, enables AI agents and RAG, offers audit logs, real‑time alerts, and can be self‑hosted on Docker or Kubernetes.

The Full Stack offers a complete AI lifecycle curriculum, covering prompt engineering, LLMOps, deep learning, GPU selection, model monitoring, ethics, and MLOps. It trains developers, product managers, and researchers to design, build, and deploy AI applications.

Awan LLM offers unlimited token generation with Meta Llama 3.1 8B and 70B models, no censorship or caps, supporting persistent AI assistance, autonomous agents, roleplay, data processing, and code completion, hosted on owned GPUs for continuous use.

Llamachat is an AI tool enabling chat with llama, alpaca, and GPT-4 models on Mac. It offers a chatbot-like experience, supports model conversion, and is open-source for contributions on GitHub.

Upstage AI delivers enterprise LLMs and document-processing tools: low-latency and Japan-specific models, PDF/OCR parsing, structured information extraction, centralized search and Q&A with citations, REST/AWS/on‑prem deployment, and team collaboration for review.

GitHub Copilot is an AI pair programmer that uses the OpenAI Codex to suggest code and entire functions in real-time.

Sapling offers a language‑model API that delivers real‑time grammar corrections in enterprise workspaces and messaging platforms. Developers embed it into editors, CRMs, and customer‑service tools with a simple SDK/API, while the platform supports private cloud, encryption, PII redaction, SSO, and s

Workik AI enhances the software development lifecycle by providing AI-powered assistance for generating context-specific code, automating tasks, and facilitating collaboration. It supports multiple programming languages and integrates with version control systems to streamline development processes.

AI Spaceship guides developers through the full AI workflow—from mathematical foundations to deployment—with interactive Python labs, incremental validation‑driven exercises, and a self‑contained curriculum that culminates in building and deploying a large language model from scratch.

Dynamiq is a low-code enterprise platform for building and managing generative AI applications, offering tools for rapid prototyping, workflow automation, and real-time observability. It ensures secure, compliant deployment of open-source LLMs with built-in guardrails for reliable outputs across ind

Firecrawl offers an API that scrapes, crawls, and searches web content, outputting data in clean LLM‑ready formats such as Markdown, JSON, or screenshots. It handles JavaScript-heavy pages, PDFs, and enables interactive browser automation.

CodingPlanX AI is a development planning tool that converts project requirements into structured plans with code scaffolding and task breakdowns. It integrates with Git and issue trackers to automate workflows and provides collaboration features with reporting for risk and resource management.

Moveworks unifies search and action across enterprise apps, delivering end‑to‑end task automation for HR, IT, finance, and more. Its reasoning engine plans and executes requests, with multilingual support, native integrations, and secure governance.