MLflow 3.2.0
ยท 5 min read
MLflow 3.2.0 includes several major features and improvements
Major New Featuresโ
- ๐งญ Tracing TypeScript SDK: MLflow Tracing now supports the TypeScript SDK, allowing developers to trace GenAI applications in TypeScript environments. (#16871, @B-Step62)
- ๐ Semantic Kernel Tracing: MLflow now provides automatic tracing support for Semantic Kernel, simplifying trace capture for SK-based workflows. (#16469, @michael-berk)
- ๐งช Feedback Tracking: MLflow OSS now natively supports tracking human feedbacks, ground truths, LLM judges on traces, providing integrated quality monitoring and feedback management capabilities. (#16743, @BenWilson2)
- ๐ฅ๏ธ MLflow UI Improvements: The MLflow UI now features a redesigned experiment home view and includes enhancements like pagination on the model page for better usability. (#16464, @frontsideair, #15801, @Flametaa)
- ๐ Updated Trace UI: The Trace UI now has image support when rendering chat messages for OpenAI, Langchain, and Anthropic! Additionally, we're introducing a "summary view" which is a simplified, flat representation of the important spans in a trace. The full detail view is still available in a separate tab.
- ๐ก๏ธ PII Masking in Tracing: Added support for masking personally identifiable information (PII) via a custom span post-processor. (#16344, @B-Step62)
- ๐ปโโ๏ธ Polars Dataset Support: MLflow now supports Polars datasets, expanding compatibility with performant DataFrame libraries. (#13006, @AlpAribal)
๐ Usage Tracking (New in 3.2.0)โ
- Starting with version 3.2.0, MLflow will begin collecting anonymized usage data about how core features of the platform are used. This data contains no sensitive or personally identifiable information, and users can opt out of data collection at any time. Check MLflow documentation for more details. (#16439, @serena-ruan)
Features:
- [Tracing] Include mlflow-tracing as a dependency of mlflow (#16589, @B-Step62)
- [Tracing] Convert DatabricksRM output to MLflow document format (#16866, @WeichenXu123)
- [Tracing] Add unified token usage tracking for Bedrock LLMs (#16351, @mohammadsubhani)
- [Tracing] Token usage tracking for agent frameworks including Anthropic, Autogen, LlamaIndex etc. (#16251, #16362, #16246, #16258, #16313, #16312, #16340, #16357, #16358, @joelrobin18, #16387, @sanatb187)
- [Tracing] Render multi-modal trace for LangChain (#16799, @B-Step62)
- [Tracing] Support async tracing for Gemini (#16632, @B-Step62)
- [Tracing] Support global sampling for tracing (#16700, @B-Step62)
- [Tracing] ResponsesAgent tracing aggregation (#16787, @bbqiu)
- [Tracing] Add Agent and LLM complete name (#16613, @joelrobin18)
- [Tracking] Allow setting thread-local tracing destination via mlflow.tracing.set_destination (#16859, @WeichenXu123)
- [Tracking] Introduce MLFLOW_DISABLE_SCHEMA_DETAILS environment variable to toggle detailed schema errors (#16631, @NJAHNAVI2907)
- [Tracking] Add support for chat-style prompts with structured output with prompt object (#16341, @harshilprajapati96)
- [Tracking] Add support for responses.parse calls in oai autologger (#16245, @dipakkrishnan)
- [Tracking] Add support for uv as an environment manager in mlflow run (#16274, @isuyyy)
- [Evaluation] Replace guideline_adherence to guidelines (#16856, @smoorjani)
- [Evaluation] Replace Scheduled Scorers API to a Scorer Registration System (#16977, @dbrx-euirim)
- [UI] Add tag filter to the experiments page (#16648, @frontsideair)
- [UI] Add ability to the UI to edit experiment tags (#16614, @frontsideair)
- [UI] Create runs table using selected columns in the experiment view (#16804, @wangh118)
- [Scoring] Make spark_udf support 'uv' env manager (#16292, @WeichenXu123)
Bug fixes:
- [Tracking / UI] Add missing default headers and replace absolute URLs in new browser client requests (GraphQL & logged models) (#16840, @danilopeixoto)
- [Tracking] Fix tracking_uri positional argument bug in artifact repositories (#16878, @copilot-swe-agent)
- [Models] Fix UnionType support for Python 3.10 style union syntax (#16882, @harupy)
- [Tracing / Tracking] Fix OpenAI autolog Pydantic validation for enum values (#16862, @mohammadsubhani)
- [Tracking] Fix tracing for Anthropic and Langchain combination (#15151, @maver1ck)
- [Models] Fix OpenAI multimodal message logging support (#16795, @mohammadsubhani)
- [Tracing] Avoid using nested threading for Azure Databricks trace export (#16733, @TomeHirata)
- [Evaluation] Bug fix: Databricks GenAI evaluation dataset source returns string, instead of DatasetSource instance (#16712, @dbczumar)
- [Models] Fix
get_model_info
to provide logged model info (#16713, @harupy) - [Evaluation] Fix serialization and deserialization for python scorers (#16688, @connorchenn)
- [UI] Fix GraphQL handler erroring on NaN metric values (#16628, @daniellok-db)
- [UI] Add back video artifact preview (#16620, @daniellok-db)
- [Tracing] Proper chat message reconstruction from OAI streaming response (#16519, @B-Step62)
- [Tracing] Convert trace column in search_traces() response to JSON string (#16523, @B-Step62)
- [Evaluation] Fix mlflow.evaluate crashes in _get_binary_classifier_metrics due to โฆ (#16485, @mohammadsubhani)
- [Evaluation] Fix trace detection logic for
mlflow.genai.evaluate
(#16932, @B-Step62) - [Evaluation] Enable to use make_genai_metric_from_prompt for mlflow.evaluate (#16960, @TomeHirata)
- [Models] Add explicit encoding for decoding streaming Responses (#16855, @aravind-segu)
- [Tracking] Prevent from tracing DSPy model API keys (#17021, @czyzby)
- [Tracking] Fix pytorch datetime issue (#17030, @serena-ruan)
- [Tracking] Fix predict with pre-releases (#16998, @serena-ruan)
Documentation updates:
- [Docs] Overhaul of top level version management GenAI docs (#16728, @BenWilson2)
- [Docs] Fix Additional GenAI Docs pages (#16691, @BenWilson2)
- [Docs] Update the docs selector dropdown (#16280, @BenWilson2)
- [Docs] Update docs font sizing and link coloring (#16281, @BenWilson2)
- [Docs] Fix typo in model deployment page (#16999, @premkiran-o7)
For a comprehensive list of changes, see the release change log, and check out the latest documentation on mlflow.org.