# Automatic Tracing MLflow Tracing is integrated with various LLM and AI agent frameworks and provides **one-line automatic tracing** experience for each library (and the combination of them!). This page shows detailed examples to integrate MLflow with popular LLM and AI agent frameworks. ![Automatic Tracing with MLflow](/docs/latest/images/llms/anthropic/anthropic-tracing.png) ## Supported Integrations[​](#supported-integrations "Direct link to Supported Integrations") Each integration automatically captures your application's logic and intermediate steps based on your implementation of the authoring framework / SDK. Click on the logo of your library to see the detailed integration guide. ### OpenTelemetry[​](#opentelemetry "Direct link to OpenTelemetry") [![OpenTelemetry Logo](/docs/latest/images/logos/opentelemetry-logo-only.png)](/docs/latest/genai/tracing/app-instrumentation/opentelemetry.md) [OpenTelemetry](/docs/latest/genai/tracing/app-instrumentation/opentelemetry.md) ### Agent Frameworks (Python)[​](#agent-frameworks-python "Direct link to Agent Frameworks (Python)") [![LangChain Logo](/docs/latest/images/logos/langchain-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/langchain.md) [LangChain](/docs/latest/genai/tracing/integrations/listing/langchain.md) [![LangGraph Logo](/docs/latest/images/logos/langgraph-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/langgraph.md) [LangGraph](/docs/latest/genai/tracing/integrations/listing/langgraph.md) [![OpenAI Agent Logo](/docs/latest/images/logos/openai-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/openai-agent.md) [OpenAI Agent](/docs/latest/genai/tracing/integrations/listing/openai-agent.md) [![DSPy Logo](/docs/latest/images/logos/dspy-logo.png)](/docs/latest/genai/tracing/integrations/listing/dspy.md) [DSPy](/docs/latest/genai/tracing/integrations/listing/dspy.md) [![PydanticAI Logo](/docs/latest/images/logos/pydantic-ai-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/pydantic_ai.md) [PydanticAI](/docs/latest/genai/tracing/integrations/listing/pydantic_ai.md) [![Google ADK Logo](/docs/latest/images/logos/google-adk-logo.png)](/docs/latest/genai/tracing/integrations/listing/google-adk.md) [Google ADK](/docs/latest/genai/tracing/integrations/listing/google-adk.md) [![Claude Agent SDK Logo](/docs/latest/images/logos/claude-code-logo.png)](/docs/latest/genai/tracing/integrations/listing/claude_agent_sdk_python.md) [Claude Agent SDK](/docs/latest/genai/tracing/integrations/listing/claude_agent_sdk_python.md) [![Microsoft Agent Framework Logo](/docs/latest/images/logos/microsoft-agent-framework-logo.png)](/docs/latest/genai/tracing/integrations/listing/microsoft-agent-framework.md) [Microsoft Agent Framework](/docs/latest/genai/tracing/integrations/listing/microsoft-agent-framework.md) [![CrewAI Logo](/docs/latest/images/logos/crewai-logo.svg)](/docs/latest/genai/tracing/integrations/listing/crewai.md) [CrewAI](/docs/latest/genai/tracing/integrations/listing/crewai.md) [![LlamaIndex Logo](/docs/latest/images/logos/llamaindex-logo.svg)](/docs/latest/genai/tracing/integrations/listing/llama_index.md) [LlamaIndex](/docs/latest/genai/tracing/integrations/listing/llama_index.md) [![AutoGen Logo](/docs/latest/images/logos/autogen-logo.png)](/docs/latest/genai/tracing/integrations/listing/autogen.md) [AutoGen](/docs/latest/genai/tracing/integrations/listing/autogen.md) [![Strands Agent SDK Logo](/docs/latest/images/logos/strands-logo.png)](/docs/latest/genai/tracing/integrations/listing/strands.md) [Strands Agent SDK](/docs/latest/genai/tracing/integrations/listing/strands.md) [![LiveKit Agents Logo](/docs/latest/images/logos/livekit-logo.png)](/docs/latest/genai/tracing/integrations/listing/livekit.md) [LiveKit Agents](/docs/latest/genai/tracing/integrations/listing/livekit.md) [![Agno Logo](/docs/latest/images/logos/agno-logo.png)](/docs/latest/genai/tracing/integrations/listing/agno.md) [Agno](/docs/latest/genai/tracing/integrations/listing/agno.md) [![Amazon Bedrock AgentCore Logo](/docs/latest/images/logos/bedrock-logo.png)](/docs/latest/genai/tracing/integrations/listing/bedrock-agentcore.md) [Amazon Bedrock AgentCore](/docs/latest/genai/tracing/integrations/listing/bedrock-agentcore.md) [![Smolagents Logo](/docs/latest/images/logos/smolagents-logo.png)](/docs/latest/genai/tracing/integrations/listing/smolagents.md) [Smolagents](/docs/latest/genai/tracing/integrations/listing/smolagents.md) [![Semantic Kernel Logo](/docs/latest/images/logos/semantic-kernel-logo.png)](/docs/latest/genai/tracing/integrations/listing/semantic_kernel.md) [Semantic Kernel](/docs/latest/genai/tracing/integrations/listing/semantic_kernel.md) [![LangChain DeepAgent Logo](/docs/latest/images/logos/deepagent-logo.svg)](/docs/latest/genai/tracing/integrations/listing/deepagent.md) [LangChain DeepAgent](/docs/latest/genai/tracing/integrations/listing/deepagent.md) [![AG2 Logo](/docs/latest/images/logos/ag2-logo.png)](/docs/latest/genai/tracing/integrations/listing/ag2.md) [AG2](/docs/latest/genai/tracing/integrations/listing/ag2.md) [![Haystack Logo](/docs/latest/images/logos/haystack-logo.png)](/docs/latest/genai/tracing/integrations/listing/haystack.md) [Haystack](/docs/latest/genai/tracing/integrations/listing/haystack.md) [![Koog Logo](/docs/latest/images/logos/koog.png)](/docs/latest/genai/tracing/integrations/listing/koog.md) [Koog](/docs/latest/genai/tracing/integrations/listing/koog.md) [![txtai Logo](/docs/latest/images/logos/txtai-logo.png)](/docs/latest/genai/tracing/integrations/listing/txtai.md) [txtai](/docs/latest/genai/tracing/integrations/listing/txtai.md) [![Pipecat Logo](/docs/latest/images/logos/pipecat.png)](/docs/latest/genai/tracing/integrations/listing/pipecat.md) [Pipecat](/docs/latest/genai/tracing/integrations/listing/pipecat.md) [![Watsonx Orchestrate Logo](/docs/latest/images/logos/watsonx-orchestrate.png)](/docs/latest/genai/tracing/integrations/listing/watsonx-orchestrate.md) [Watsonx Orchestrate](/docs/latest/genai/tracing/integrations/listing/watsonx-orchestrate.md) ### Agent Frameworks (TypeScript)[​](#agent-frameworks-typescript "Direct link to Agent Frameworks (TypeScript)") [![LangChain Logo](/docs/latest/images/logos/langchain-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/langchain.md) [LangChain](/docs/latest/genai/tracing/integrations/listing/langchain.md) [![LangGraph Logo](/docs/latest/images/logos/langgraph-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/langgraph.md) [LangGraph](/docs/latest/genai/tracing/integrations/listing/langgraph.md) [![Vercel AI SDK Logo](/docs/latest/images/logos/vercel-logo.svg)](/docs/latest/genai/tracing/integrations/listing/vercelai.md) [Vercel AI SDK](/docs/latest/genai/tracing/integrations/listing/vercelai.md) [![Mastra Logo](/docs/latest/images/logos/mastra-logo.png)](/docs/latest/genai/tracing/integrations/listing/mastra.md) [Mastra](/docs/latest/genai/tracing/integrations/listing/mastra.md) [![VoltAgent Logo](/docs/latest/images/logos/voltagent-logo.png)](/docs/latest/genai/tracing/integrations/listing/voltagent.md) [VoltAgent](/docs/latest/genai/tracing/integrations/listing/voltagent.md) [![Claude Agent SDK (TS) Logo](/docs/latest/images/logos/claude-code-logo.png)](/docs/latest/genai/tracing/integrations/listing/claude_agent_sdk_typescript.md) [Claude Agent SDK (TS)](/docs/latest/genai/tracing/integrations/listing/claude_agent_sdk_typescript.md) ### Model Providers[​](#model-providers "Direct link to Model Providers") [![OpenAI Logo](/docs/latest/images/logos/openai-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/openai.md) [OpenAI](/docs/latest/genai/tracing/integrations/listing/openai.md) [![Anthropic Logo](/docs/latest/images/logos/anthropic-logo.png)](/docs/latest/genai/tracing/integrations/listing/anthropic.md) [Anthropic](/docs/latest/genai/tracing/integrations/listing/anthropic.md) [![Databricks Logo](/docs/latest/images/logos/databricks-logo.png)](/docs/latest/genai/tracing/integrations/listing/databricks.md) [Databricks](/docs/latest/genai/tracing/integrations/listing/databricks.md) [![Gemini Logo](/docs/latest/images/logos/google-gemini-logo.svg)](/docs/latest/genai/tracing/integrations/listing/gemini.md) [Gemini](/docs/latest/genai/tracing/integrations/listing/gemini.md) [![Amazon Bedrock Logo](/docs/latest/images/logos/bedrock-logo.png)](/docs/latest/genai/tracing/integrations/listing/bedrock.md) [Amazon Bedrock](/docs/latest/genai/tracing/integrations/listing/bedrock.md) [![LiteLLM Logo](/docs/latest/images/logos/litellm-logo.png)](/docs/latest/genai/tracing/integrations/listing/litellm.md) [LiteLLM](/docs/latest/genai/tracing/integrations/listing/litellm.md) [![Mistral Logo](/docs/latest/images/logos/mistral-ai-logo.svg)](/docs/latest/genai/tracing/integrations/listing/mistral.md) [Mistral](/docs/latest/genai/tracing/integrations/listing/mistral.md) [![TypeSafe AI Logo](/docs/latest/images/logos/typesafe-ai-logo.png)](/docs/latest/genai/tracing/integrations/listing/typesafe.md) [TypeSafe AI](/docs/latest/genai/tracing/integrations/listing/typesafe.md) [![xAI / Grok Logo](/docs/latest/images/logos/grok-logo.png)](/docs/latest/genai/tracing/integrations/listing/xai-grok.md) [xAI / Grok](/docs/latest/genai/tracing/integrations/listing/xai-grok.md) [![Ollama Logo](/docs/latest/images/logos/ollama-logo.png)](/docs/latest/genai/tracing/integrations/listing/ollama.md) [Ollama](/docs/latest/genai/tracing/integrations/listing/ollama.md) [![Groq Logo](/docs/latest/images/logos/groq-logo.svg)](/docs/latest/genai/tracing/integrations/listing/groq.md) [Groq](/docs/latest/genai/tracing/integrations/listing/groq.md) [![DeepSeek Logo](/docs/latest/images/logos/deepseek-logo.png)](/docs/latest/genai/tracing/integrations/listing/deepseek.md) [DeepSeek](/docs/latest/genai/tracing/integrations/listing/deepseek.md) [![Qwen Logo](/docs/latest/images/logos/qwen-logo.jpg)](/docs/latest/genai/tracing/integrations/listing/qwen.md) [Qwen](/docs/latest/genai/tracing/integrations/listing/qwen.md) [![Moonshot AI Logo](/docs/latest/images/logos/kimi-logo.png)](/docs/latest/genai/tracing/integrations/listing/moonshot.md) [Moonshot AI](/docs/latest/genai/tracing/integrations/listing/moonshot.md) [![Cohere Logo](/docs/latest/images/logos/cohere-logo.png)](/docs/latest/genai/tracing/integrations/listing/cohere.md) [Cohere](/docs/latest/genai/tracing/integrations/listing/cohere.md) [![BytePlus Logo](/docs/latest/images/logos/byteplus-logo.png)](/docs/latest/genai/tracing/integrations/listing/byteplus.md) [BytePlus](/docs/latest/genai/tracing/integrations/listing/byteplus.md) [![Novita AI Logo](/docs/latest/images/logos/novitaai-logo.jpg)](/docs/latest/genai/tracing/integrations/listing/novitaai.md) [Novita AI](/docs/latest/genai/tracing/integrations/listing/novitaai.md) [![FireworksAI Logo](/docs/latest/images/logos/fireworks-ai-logo.png)](/docs/latest/genai/tracing/integrations/listing/fireworksai.md) [FireworksAI](/docs/latest/genai/tracing/integrations/listing/fireworksai.md) [![Together AI Logo](/docs/latest/images/logos/together-ai-logo.png)](/docs/latest/genai/tracing/integrations/listing/togetherai.md) [Together AI](/docs/latest/genai/tracing/integrations/listing/togetherai.md) ### Tools[​](#tools "Direct link to Tools") [![Instructor Logo](/docs/latest/images/logos/instructor-logo.svg)](/docs/latest/genai/tracing/integrations/listing/instructor.md) [Instructor](/docs/latest/genai/tracing/integrations/listing/instructor.md) [![Langfuse Logo](/docs/latest/images/logos/langfuse-logo.png)](/docs/latest/genai/tracing/integrations/listing/langfuse.md) [Langfuse](/docs/latest/genai/tracing/integrations/listing/langfuse.md) [![Arize / Phoenix Logo](/docs/latest/images/logos/arize-phoenix-logo.png)](/docs/latest/genai/tracing/integrations/listing/arize.md) [Arize / Phoenix](/docs/latest/genai/tracing/integrations/listing/arize.md) ### Gateways[​](#gateways "Direct link to Gateways") [![MLflow AI Gateway Logo](/docs/latest/images/logos/mlflow-logo.svg)](/docs/latest/genai/tracing/integrations/listing/mlflow-ai-gateway.md) [MLflow AI Gateway](/docs/latest/genai/tracing/integrations/listing/mlflow-ai-gateway.md) [![Databricks Logo](/docs/latest/images/logos/databricks-logo.png)](/docs/latest/genai/tracing/integrations/listing/databricks-ai-gateway.md) [Databricks](/docs/latest/genai/tracing/integrations/listing/databricks-ai-gateway.md) [![LiteLLM Proxy Logo](/docs/latest/images/logos/litellm-logo.png)](/docs/latest/genai/tracing/integrations/listing/litellm-proxy.md) [LiteLLM Proxy](/docs/latest/genai/tracing/integrations/listing/litellm-proxy.md) [![Vercel AI Gateway Logo](/docs/latest/images/logos/vercel-logo.svg)](/docs/latest/genai/tracing/integrations/listing/vercel-ai-gateway.md) [Vercel AI Gateway](/docs/latest/genai/tracing/integrations/listing/vercel-ai-gateway.md) [![OpenRouter Logo](/docs/latest/images/logos/openrouter-logo.png)](/docs/latest/genai/tracing/integrations/listing/openrouter.md) [OpenRouter](/docs/latest/genai/tracing/integrations/listing/openrouter.md) [![Portkey Logo](/docs/latest/images/logos/portkey-logo.png)](/docs/latest/genai/tracing/integrations/listing/portkey.md) [Portkey](/docs/latest/genai/tracing/integrations/listing/portkey.md) [![Helicone Logo](/docs/latest/images/logos/helicone-logo.png)](/docs/latest/genai/tracing/integrations/listing/helicone.md) [Helicone](/docs/latest/genai/tracing/integrations/listing/helicone.md) [![Kong AI Gateway Logo](/docs/latest/images/logos/kong-logo.png)](/docs/latest/genai/tracing/integrations/listing/kong.md) [Kong AI Gateway](/docs/latest/genai/tracing/integrations/listing/kong.md) [![Pydantic AI Gateway Logo](/docs/latest/images/logos/pydantic-ai-logo-only.png)](/docs/latest/genai/tracing/integrations/listing/pydantic-ai-gateway.md) [Pydantic AI Gateway](/docs/latest/genai/tracing/integrations/listing/pydantic-ai-gateway.md) [![TrueFoundry Logo](/docs/latest/images/logos/truefoundry-logo.png)](/docs/latest/genai/tracing/integrations/listing/truefoundry.md) [TrueFoundry](/docs/latest/genai/tracing/integrations/listing/truefoundry.md) ### No-Code[​](#no-code "Direct link to No-Code") [![Goose Logo](/docs/latest/images/logos/goose-logo.png)](/docs/latest/genai/tracing/integrations/listing/goose.md) [Goose](/docs/latest/genai/tracing/integrations/listing/goose.md) [![Langflow Logo](/docs/latest/images/logos/langflow.svg)](/docs/latest/genai/tracing/integrations/listing/langflow.md) [Langflow](/docs/latest/genai/tracing/integrations/listing/langflow.md) [![Open WebUI Logo](/docs/latest/images/logos/open-webui-logo.png)](/docs/latest/genai/tracing/integrations/listing/open-webui.md) [Open WebUI](/docs/latest/genai/tracing/integrations/listing/open-webui.md) [![n8n Logo](/docs/latest/images/logos/n8n-logo.png)](/docs/latest/genai/tracing/integrations/listing/n8n.md) [n8n](/docs/latest/genai/tracing/integrations/listing/n8n.md)
Missing your favorite library? Is your favorite library missing from the list? Consider [contributing to MLflow Tracing](/docs/latest/genai/tracing/integrations/contribute.md) or [submitting a feature request](https://github.com/mlflow/mlflow/issues/new?assignees=\&labels=enhancement\&projects=\&template=feature_request_template.yaml\&title=%5BFR%5D) to our Github repository. ## Advanced Usage[​](#advanced-usage "Direct link to Advanced Usage") ### Combining Manual and Automatic Tracing[​](#combining-manual-and-automatic-tracing "Direct link to Combining Manual and Automatic Tracing") The `@mlflow.trace` decorator can be used in conjunction with auto tracing to create powerful, integrated traces. This is particularly useful for: 1. 🔄 **Complex workflows** that involve multiple LLM calls 2. 🤖 **Multi-agent systems** where different agents use different LLM providers 3. 🔗 **Chaining multiple LLM calls** together with custom logic in between Here's a simple example that combines OpenAI auto-tracing with manually defined spans: python ``` import mlflow import openai from mlflow.entities import SpanType mlflow.openai.autolog() @mlflow.trace(span_type=SpanType.CHAIN) def run(question): messages = build_messages(question) # MLflow automatically generates a span for OpenAI invocation response = openai.OpenAI().chat.completions.create( model="gpt-4o-mini", max_tokens=100, messages=messages, ) return parse_response(response) @mlflow.trace def build_messages(question): return [ {"role": "system", "content": "You are a helpful chatbot."}, {"role": "user", "content": question}, ] @mlflow.trace def parse_response(response): return response.choices[0].message.content run("What is MLflow?") ``` Running this code generates a single trace that combines the manual spans with the automatic OpenAI tracing. ### Multi-Framework Example[​](#multi-framework-example "Direct link to Multi-Framework Example") You can also combine different LLM providers in a single trace. For example: note This example requires installing LangChain in addition to the base requirements: bash ``` pip install --upgrade langchain langchain-openai ``` python ``` import mlflow import openai from mlflow.entities import SpanType from langchain_openai import ChatOpenAI from langchain_core.prompts import ChatPromptTemplate # Enable auto-tracing for both OpenAI and LangChain mlflow.openai.autolog() mlflow.langchain.autolog() @mlflow.trace(span_type=SpanType.CHAIN) def multi_provider_workflow(query: str): # First, use OpenAI directly for initial processing analysis = openai.OpenAI().chat.completions.create( model="gpt-4o-mini", messages=[ {"role": "system", "content": "Analyze the query and extract key topics."}, {"role": "user", "content": query}, ], ) topics = analysis.choices[0].message.content # Then use LangChain for structured processing llm = ChatOpenAI(model="gpt-4o-mini") prompt = ChatPromptTemplate.from_template( "Based on these topics: {topics}\nGenerate a detailed response to: {query}" ) chain = prompt | llm response = chain.invoke({"topics": topics, "query": query}) return response # Run the function result = multi_provider_workflow("Explain quantum computing") ``` ## Disabling Tracing[​](#disabling-tracing "Direct link to Disabling Tracing") To **disable** tracing, the [`mlflow.tracing.disable()`](/docs/latest/api_reference/python_api/mlflow.tracing.html#mlflow.tracing.disable) API will cease the collection of trace data from within MLflow and will not log any data to the MLflow Tracking service regarding traces. To **enable** tracing (if it had been temporarily disabled), the [`mlflow.tracing.enable()`](/docs/latest/api_reference/python_api/mlflow.tracing.html#mlflow.tracing.enable) API will re-enable tracing functionality for instrumented models that are invoked. ## Next Steps[​](#next-steps "Direct link to Next Steps") ### [Manual Tracing](/docs/latest/genai/tracing/app-instrumentation/manual-tracing.md) [Learn how to add custom tracing to your application logic](/docs/latest/genai/tracing/app-instrumentation/manual-tracing.md) [Add custom spans →](/docs/latest/genai/tracing/app-instrumentation/manual-tracing.md) ### [Viewing Traces](/docs/latest/genai/tracing/observe-with-traces/ui.md) [Explore and analyze your traces in the MLflow UI](/docs/latest/genai/tracing/observe-with-traces/ui.md) [View traces →](/docs/latest/genai/tracing/observe-with-traces/ui.md) ### [Querying Traces](/docs/latest/genai/tracing/search-traces.md) [Programmatically search and retrieve trace data for analysis](/docs/latest/genai/tracing/search-traces.md) [Search traces →](/docs/latest/genai/tracing/search-traces.md)