/ README.md
README.md
1 <h1 align="center" style="border-bottom: none"> 2 <a href="https://mlflow.org/"> 3 <img alt="MLflow logo" src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/assets/logo.svg" width="200" /> 4 </a> 5 </h1> 6 <h2 align="center" style="border-bottom: none">The Open Source AI Engineering Platform for Agents, LLMs & Models</h2> 7 8 MLflow is the largest open source **AI engineering platform for agents, LLMs, and ML models**. MLflow enables teams of all sizes to [debug](https://mlflow.org/llm-tracing), 9 [evaluate](https://mlflow.org/llm-evaluation), [monitor](https://mlflow.org/ai-monitoring), and [optimize](https://mlflow.org/prompt-optimization) production-quality AI applications while 10 controlling costs and managing access to models and data. With over **60 million monthly downloads**, 11 thousands of organizations rely on MLflow each day to ship AI to production with confidence. 12 13 MLflow's comprehensive feature set for agents and LLM applications includes production-grade [observability](https://mlflow.org/docs/latest/genai/tracing), [evaluation](https://mlflow.org/docs/latest/genai/eval-monitor), 14 [prompt management](https://mlflow.org/docs/latest/genai/prompt-registry), [prompt optimization](https://mlflow.org/prompt-optimization) and an [AI Gateway](https://mlflow.org/docs/latest/genai/governance/ai-gateway) for managing costs and model access. 15 Learn more at [MLflow for LLMs and Agents](https://mlflow.org/docs/latest/genai). 16 17 <div align="center"> 18 19 [](https://pypi.org/project/mlflow/) 20 [](https://pepy.tech/projects/mlflow) 21 [](https://github.com/mlflow/mlflow/blob/master/LICENSE.txt) 22 <a href="https://twitter.com/intent/follow?screen_name=mlflow" target="_blank"> 23 <img src="https://img.shields.io/twitter/follow/mlflow?logo=X&color=%20%23f5f5f5" 24 alt="follow on X(Twitter)"></a> 25 <a href="https://www.linkedin.com/company/mlflow-org/" target="_blank"> 26 <img src="https://custom-icon-badges.demolab.com/badge/LinkedIn-0A66C2?logo=linkedin-white&logoColor=fff" 27 alt="follow on LinkedIn"></a> 28 [](https://deepwiki.com/mlflow/mlflow) 29 30 </div> 31 32 <div align="center"> 33 <div> 34 <a href="https://mlflow.org/"><strong>Website</strong></a> · 35 <a href="https://mlflow.org/docs/latest"><strong>Docs</strong></a> · 36 <a href="https://github.com/mlflow/mlflow/issues/new/choose"><strong>Feature Request</strong></a> · 37 <a href="https://mlflow.org/blog"><strong>News</strong></a> · 38 <a href="https://www.youtube.com/@mlflowoss"><strong>YouTube</strong></a> · 39 <a href="https://lu.ma/mlflow?k=c"><strong>Events</strong></a> 40 </div> 41 </div> 42 43 <br> 44 45 ## Get Started in 3 Simple Steps 46 47 From zero to full-stack LLMOps in minutes. No complex setup or major code changes required. [Get Started →](https://mlflow.org/docs/latest/genai/tracing/quickstart/) 48 49 **1. Start MLflow Server** 50 51 ```bash 52 uvx mlflow server 53 ``` 54 55 **2. Enable Logging** 56 57 ```python 58 import mlflow 59 60 mlflow.set_tracking_uri("http://localhost:5000") 61 mlflow.openai.autolog() 62 ``` 63 64 **3. Run Your Code** 65 66 ```python 67 from openai import OpenAI 68 69 client = OpenAI() 70 client.responses.create( 71 model="gpt-5.4-mini", 72 input="Hello!", 73 ) 74 ``` 75 76 Explore traces and metrics in the MLflow UI at `http://localhost:5000`. 77 78 ## LLMs & Agents 79 80 MLflow provides everything you need to build, debug, evaluate, and deploy production-quality LLM applications and AI agents. Supports Python, TypeScript/JavaScript, Java and any other programming language. MLflow also natively integrates with [OpenTelemetry](https://opentelemetry.io/) and MCP. 81 82 <table> 83 <tr> 84 <td width="50%"> 85 <img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/assets/readme-tracing.png" alt="Observability" width=100%> 86 <div align="center"> 87 <br> 88 <a href="https://mlflow.org/docs/latest/genai/tracing/"><strong>Observability</strong></a> 89 <br><br> 90 <div>Capture complete traces of your LLM applications and agents for deep behavioral insights. Built on OpenTelemetry, supporting any LLM provider and agent framework. Monitor production quality, costs, and safety.</div><br> 91 <a href="https://mlflow.org/docs/latest/genai/tracing/quickstart/">Getting Started →</a> 92 <br><br> 93 </div> 94 </td> 95 <td width="50%"> 96 <img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/assets/readme-llm-eval.png" alt="Evaluation" width=100%> 97 <div align="center"> 98 <br> 99 <a href="https://mlflow.org/docs/latest/genai/eval-monitor/"><strong>Evaluation</strong></a> 100 <br><br> 101 <div>Run systematic evaluations, track quality metrics over time, and catch regressions before they reach production. Choose from 50+ built-in metrics and LLM judges, or define your own.</div><br> 102 <a href="https://mlflow.org/docs/latest/genai/eval-monitor/">Getting Started →</a> 103 <br><br> 104 </div> 105 </td> 106 </tr> 107 <tr> 108 <td width="50%"> 109 <img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/assets/readme-prompt.png" alt="Prompts & Optimization" width=100%> 110 <div align="center"> 111 <br> 112 <a href="https://mlflow.org/docs/latest/genai/prompt-registry/"><strong>Prompts & Optimization</strong></a> 113 <br><br> 114 <div>Version, test, and deploy prompts with full lineage tracking. <a href="https://mlflow.org/prompt-optimization">Automatically optimize prompts</a> with state-of-the-art algorithms to improve performance.</div><br> 115 <a href="https://mlflow.org/docs/latest/genai/prompt-registry/create-and-edit-prompts/">Getting Started →</a> 116 <br><br> 117 </div> 118 </td> 119 <td width="50%"> 120 <img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/assets/readme-gateway.png" alt="AI Gateway" width=100%> 121 <div align="center"> 122 <br> 123 <a href="https://mlflow.org/docs/latest/genai/governance/ai-gateway/"><strong>AI Gateway</strong></a> 124 <br><br> 125 <div>Unified API gateway for all LLM providers. Route requests, manage rate limits, handle fallbacks, and control costs through an OpenAI-compatible interface with built-in credential management, guardrails and traffic splitting for A/B testing.</div><br> 126 <a href="https://mlflow.org/docs/latest/genai/governance/ai-gateway/quickstart/">Getting Started →</a> 127 <br><br> 128 </div> 129 </td> 130 </tr> 131 </table> 132 133 ## Model Training 134 135 For machine learning and deep learning model development, MLflow provides a full suite of tools to manage the ML lifecycle: 136 137 - [**Experiment Tracking**](https://mlflow.org/docs/latest/ml/tracking/) — Track models, parameters, metrics, and evaluation results across experiments 138 - [**Model Evaluation**](https://mlflow.org/docs/latest/ml/evaluation/) — Automated evaluation tools integrated with experiment tracking 139 - [**Model Registry**](https://mlflow.org/docs/latest/ml/model-registry/) — Collaboratively manage the full lifecycle of ML models 140 - [**Deployment**](https://mlflow.org/docs/latest/ml/deployment/) — Deploy models to batch and real-time scoring on Docker, Kubernetes, Azure ML, AWS SageMaker, and more 141 142 Learn more at [MLflow for Model Training](https://mlflow.org/docs/latest/ml). 143 144 ## Integrations 145 146 MLflow supports all agent frameworks, LLM providers, tools, and programming languages. We offer one-line automatic tracing for more than 60 frameworks. See the [full integrations list](https://mlflow.org/docs/latest/genai/tracing/integrations/). 147 148 ### OpenTelemetry 149 150 <table> 151 <tr> 152 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/app-instrumentation/opentelemetry"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/opentelemetry-logo-only.png" height="40"><br><sub><b>OpenTelemetry</b></sub></a></td> 153 </tr> 154 </table> 155 156 ### Agent Frameworks (Python) 157 158 <table> 159 <tr> 160 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/langchain"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langchain-logo-only.png" height="40"><br><sub><b>LangChain</b></sub></a></td> 161 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/langgraph"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langgraph-logo-only.png" height="40"><br><sub><b>LangGraph</b></sub></a></td> 162 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/openai-agent"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/openai-logo-only.png" height="40"><br><sub><b>OpenAI Agent</b></sub></a></td> 163 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/dspy"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/dspy-logo.png" height="40"><br><sub><b>DSPy</b></sub></a></td> 164 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/pydantic_ai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/pydantic-ai-logo-only.png" height="40"><br><sub><b>PydanticAI</b></sub></a></td> 165 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/google-adk"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/google-adk-logo.png" height="40"><br><sub><b>Google ADK</b></sub></a></td> 166 </tr> 167 <tr> 168 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/microsoft-agent-framework"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/microsoft-agent-framework-logo.png" height="40"><br><sub><b>Microsoft Agent</b></sub></a></td> 169 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/crewai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/crewai-logo.svg" height="40"><br><sub><b>CrewAI</b></sub></a></td> 170 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/llama_index"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/llamaindex-logo.svg" height="40"><br><sub><b>LlamaIndex</b></sub></a></td> 171 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/autogen"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/autogen-logo.png" height="40"><br><sub><b>AutoGen</b></sub></a></td> 172 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/strands"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/strands-logo.png" height="40"><br><sub><b>Strands</b></sub></a></td> 173 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/livekit"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/livekit-logo.png" height="40"><br><sub><b>LiveKit Agents</b></sub></a></td> 174 </tr> 175 <tr> 176 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/agno"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/agno-logo.png" height="40"><br><sub><b>Agno</b></sub></a></td> 177 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/bedrock-agentcore"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/bedrock-logo.png" height="40"><br><sub><b>Bedrock AgentCore</b></sub></a></td> 178 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/smolagents"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/smolagents-logo.png" height="40"><br><sub><b>Smolagents</b></sub></a></td> 179 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/semantic_kernel"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/semantic-kernel-logo.png" height="40"><br><sub><b>Semantic Kernel</b></sub></a></td> 180 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/deepagent"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/deepagent-logo.svg" height="40"><br><sub><b>DeepAgent</b></sub></a></td> 181 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/ag2"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/ag2-logo.png" height="40"><br><sub><b>AG2</b></sub></a></td> 182 </tr> 183 <tr> 184 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/haystack"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/haystack-logo.png" height="40"><br><sub><b>Haystack</b></sub></a></td> 185 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/koog"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/koog.png" height="40"><br><sub><b>Koog</b></sub></a></td> 186 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/txtai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/txtai-logo.png" height="40"><br><sub><b>txtai</b></sub></a></td> 187 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/pipecat"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/pipecat.png" height="40"><br><sub><b>Pipecat</b></sub></a></td> 188 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/watsonx-orchestrate"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/watsonx-orchestrate.png" height="40"><br><sub><b>Watsonx</b></sub></a></td> 189 </tr> 190 </table> 191 192 ### Agent Frameworks (TypeScript) 193 194 <table> 195 <tr> 196 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/langchain"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langchain-logo-only.png" height="40"><br><sub><b>LangChain</b></sub></a></td> 197 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/langgraph"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langgraph-logo-only.png" height="40"><br><sub><b>LangGraph</b></sub></a></td> 198 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/vercelai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/vercel-logo.svg" height="40"><br><sub><b>Vercel AI SDK</b></sub></a></td> 199 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/mastra"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/mastra-logo.png" height="40"><br><sub><b>Mastra</b></sub></a></td> 200 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/voltagent"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/voltagent-logo.png" height="40"><br><sub><b>VoltAgent</b></sub></a></td> 201 </tr> 202 </table> 203 204 ### Agent Frameworks (Java) 205 206 <table> 207 <tr> 208 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/spring-ai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/spring-ai-logo.png" height="40"><br><sub><b>Spring AI</b></sub></a></td> 209 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/quarkus-langchain4j"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langchain4j.svg" height="40"><br><sub><b>Quarkus LangChain4j</b></sub></a></td> 210 </tr> 211 </table> 212 213 ### Model Providers 214 215 <table> 216 <tr> 217 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/openai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/openai-logo-only.png" height="40"><br><sub><b>OpenAI</b></sub></a></td> 218 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/anthropic"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/anthropic-logo.png" height="40"><br><sub><b>Anthropic</b></sub></a></td> 219 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/databricks"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/databricks-logo.png" height="40"><br><sub><b>Databricks</b></sub></a></td> 220 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/gemini"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/google-gemini-logo.svg" height="40"><br><sub><b>Gemini</b></sub></a></td> 221 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/bedrock"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/bedrock-logo.png" height="40"><br><sub><b>Amazon Bedrock</b></sub></a></td> 222 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/litellm"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/litellm-logo.png" height="40"><br><sub><b>LiteLLM</b></sub></a></td> 223 </tr> 224 <tr> 225 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/mistral"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/mistral-ai-logo.svg" height="40"><br><sub><b>Mistral</b></sub></a></td> 226 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/xai-grok"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/grok-logo.png" height="40"><br><sub><b>xAI / Grok</b></sub></a></td> 227 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/ollama"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/ollama-logo.png" height="40"><br><sub><b>Ollama</b></sub></a></td> 228 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/groq"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/groq-logo.svg" height="40"><br><sub><b>Groq</b></sub></a></td> 229 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/deepseek"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/deepseek-logo.png" height="40"><br><sub><b>DeepSeek</b></sub></a></td> 230 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/qwen"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/qwen-logo.jpg" height="40"><br><sub><b>Qwen</b></sub></a></td> 231 </tr> 232 <tr> 233 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/moonshot"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/kimi-logo.png" height="40"><br><sub><b>Moonshot AI</b></sub></a></td> 234 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/cohere"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/cohere-logo.png" height="40"><br><sub><b>Cohere</b></sub></a></td> 235 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/byteplus"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/byteplus-logo.png" height="40"><br><sub><b>BytePlus</b></sub></a></td> 236 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/novitaai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/novitaai-logo.jpg" height="40"><br><sub><b>Novita AI</b></sub></a></td> 237 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/fireworksai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/fireworks-ai-logo.png" height="40"><br><sub><b>FireworksAI</b></sub></a></td> 238 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/togetherai"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/together-ai-logo.png" height="40"><br><sub><b>Together AI</b></sub></a></td> 239 </tr> 240 </table> 241 242 ### Gateways 243 244 <table> 245 <tr> 246 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/databricks-ai-gateway"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/databricks-logo.png" height="40"><br><sub><b>Databricks</b></sub></a></td> 247 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/litellm-proxy"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/litellm-logo.png" height="40"><br><sub><b>LiteLLM Proxy</b></sub></a></td> 248 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/vercel-ai-gateway"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/vercel-logo.svg" height="40"><br><sub><b>Vercel AI Gateway</b></sub></a></td> 249 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/openrouter"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/openrouter-logo.png" height="40"><br><sub><b>OpenRouter</b></sub></a></td> 250 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/portkey"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/portkey-logo.png" height="40"><br><sub><b>Portkey</b></sub></a></td> 251 </tr> 252 <tr> 253 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/helicone"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/helicone-logo.png" height="40"><br><sub><b>Helicone</b></sub></a></td> 254 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/kong"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/kong-logo.png" height="40"><br><sub><b>Kong AI Gateway</b></sub></a></td> 255 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/pydantic-ai-gateway"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/pydantic-ai-logo-only.png" height="40"><br><sub><b>PydanticAI Gateway</b></sub></a></td> 256 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/truefoundry"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/truefoundry-logo.png" height="40"><br><sub><b>TrueFoundry</b></sub></a></td> 257 </tr> 258 </table> 259 260 ### Tools & No-Code 261 262 <table> 263 <tr> 264 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/instructor"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/instructor-logo.svg" height="40"><br><sub><b>Instructor</b></sub></a></td> 265 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/claude_code"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/claude-code-logo.png" height="40"><br><sub><b>Claude Code</b></sub></a></td> 266 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/opencode"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/opencode-logo.png" height="40"><br><sub><b>Opencode</b></sub></a></td> 267 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/langfuse"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langfuse-logo.png" height="40"><br><sub><b>Langfuse</b></sub></a></td> 268 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/arize"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/arize-phoenix-logo.png" height="40"><br><sub><b>Arize / Phoenix</b></sub></a></td> 269 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/goose"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/goose-logo.png" height="40"><br><sub><b>Goose</b></sub></a></td> 270 </tr> 271 <tr> 272 <td align="center" width="110"><a href="https://mlflow.org/docs/latest/genai/tracing/integrations/listing/langflow"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/langflow.svg" height="40"><br><sub><b>Langflow</b></sub></a></td> 273 </tr> 274 </table> 275 276 ## Hosting MLflow 277 278 MLflow can be used in a variety of environments, including your local environment, on-premises clusters, cloud platforms, and managed services. Being an open-source platform, MLflow is **vendor-neutral** — whether you're building AI agents, LLM applications, or ML models, you have access to MLflow's core capabilities. 279 280 <table> 281 <tr> 282 <td align="center" width="130"><a href="https://docs.databricks.com/aws/en/mlflow3/genai/"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/databricks-logo.png" height="40"><br><sub><b>Databricks</b></sub></a></td> 283 <td align="center" width="130"><a href="https://aws.amazon.com/sagemaker-ai/experiments/"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/amazon-sagemaker-logo.png" height="40"><br><sub><b>Amazon SageMaker</b></sub></a></td> 284 <td align="center" width="130"><a href="https://learn.microsoft.com/en-us/azure/machine-learning/concept-mlflow?view=azureml-api-2"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/azure-ml-logo.png" height="40"><br><sub><b>Azure ML</b></sub></a></td> 285 <td align="center" width="130"><a href="https://nebius.com/services/managed-mlflow"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/nebius-logo.png" height="40"><br><sub><b>Nebius</b></sub></a></td> 286 <td align="center" width="130"><a href="https://mlflow.org/docs/latest/ml/tracking/"><img src="https://raw.githubusercontent.com/mlflow/mlflow/refs/heads/master/docs/static/images/logos/kubernetes-logo.png" height="40"><br><sub><b>Self-Hosted</b></sub></a></td> 287 </tr> 288 </table> 289 290 ## 💭 Support 291 292 - For help or questions about MLflow usage (e.g. "how do I do X?") visit the [documentation](https://mlflow.org/docs/latest). 293 - In the documentation, you can ask the question to our AI-powered chat bot. Click on the **"Ask AI"** button at the right bottom. 294 - Join the [virtual events](https://lu.ma/mlflow?k=c) like office hours and meetups. 295 - To report a bug, file a documentation issue, or submit a feature request, please [open a GitHub issue](https://github.com/mlflow/mlflow/issues/new/choose). 296 - For release announcements and other discussions, please subscribe to our mailing list (mlflow-users@googlegroups.com) 297 or join us on [Slack](https://mlflow.org/slack). 298 299 ## 🤝 Contributing 300 301 We happily welcome contributions to MLflow! 302 303 - Submit [bug reports](https://github.com/mlflow/mlflow/issues/new?template=bug_report_template.yaml) and [feature requests](https://github.com/mlflow/mlflow/issues/new?template=feature_request_template.yaml) 304 - Contribute for [good-first-issues](https://github.com/mlflow/mlflow/issues?q=is%3Aissue+is%3Aopen+label%3A%22good+first+issue%22) and [help-wanted](https://github.com/mlflow/mlflow/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 305 - Writing about MLflow and sharing your experience 306 307 Please see our [contribution guide](CONTRIBUTING.md) to learn more about contributing to MLflow. 308 309 ## ⭐️ Star History 310 311 <a href="https://star-history.com/#mlflow/mlflow&Date"> 312 <picture> 313 <source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=mlflow/mlflow&type=Date&theme=dark" /> 314 <source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=mlflow/mlflow&type=Date" /> 315 <img alt="Star History Chart" src="https://api.star-history.com/svg?repos=mlflow/mlflow&type=Date" /> 316 </picture> 317 </a> 318 319 ## ✏️ Citation 320 321 If you use MLflow in your research, please cite it using the "Cite this repository" button at the top of the [GitHub repository page](https://github.com/mlflow/mlflow), which will provide you with citation formats including APA and BibTeX. 322 323 ## 👥 Core Members 324 325 MLflow is currently maintained by the following core members with significant contributions from hundreds of exceptionally talented community members. 326 327 - [Ben Wilson](https://github.com/BenWilson2) 328 - [Corey Zumar](https://github.com/dbczumar) 329 - [Daniel Lok](https://github.com/daniellok-db) 330 - [Gabriel Fu](https://github.com/gabrielfu) 331 - [Harutaka Kawamura](https://github.com/harupy) 332 - [Joel Robin P](https://github.com/joelrobin18) 333 - [Matt Prahl](https://github.com/mprahl) 334 - [Pat Sukprasert](https://github.com/PattaraS) 335 - [Serena Ruan](https://github.com/serena-ruan) 336 - [Tomu Hirata](https://github.com/TomeHirata) 337 - [Weichen Xu](https://github.com/WeichenXu123) 338 - [Yuki Watanabe](https://github.com/B-Step62)