Third-party Scorers
MLflow integrates with popular third-party evaluation frameworks, allowing you to leverage their specialized metrics within MLflow's evaluation workflow. This provides access to third-party libraries' evaluation metrics while maintaining a consistent MLflow interface.
MLflow's third-party scorer integrations provide:
- Consistent MLflow API for all evaluation frameworks
- Unified evaluation across multiple metric sources
- Seamless integration with
mlflow.genai.evaluate()
Click an integration below to get started with detailed setup instructions.
Available Integrations
Missing an Integration?
Is your favorite evaluation framework missing? Consider submitting a feature request.