Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.oumi.ai/llms.txt

Use this file to discover all available pages before exploring further.

Oumi allows you to save and reuse evaluator configurations of your LLM-based judges. By capturing settings like instructions, selected evaluator models, and optional data fields, you ensure consistent and reproducible evaluator behavior over time. Recipes not only streamline the process of configuring evaluators, but also ensure that configurations are easily versioned, shared, and reproduced across different environments and teams.

​
SAVING EVALUATOR RECIPES

To save an evaluator recipe:
  1. On the Create an Evaluator page, click on the Save icon.
  2. Give your evaluator a Display Name and click Save Evaluator.
You can now access your new evaluator from the Evaluators page.