EVALUATION RECIPES

Making evaluations consistent and repeatable

Recipes allow you to save the exact configuration of your model tests, making performance evaluations standardized, reproducible, and easy to repeat.

Each recipe automatically logs and versions all parameters and experimental settings, ensuring deterministic execution and consistent results over time. This gives you full transparency into how an evaluation was run and confidence that it can be replicated whenever needed.

SAVING EVALUATION RECIPES

Oumi allows you save your evaluations as recipes for a complete, traceable record of your configurations, making it simple to reproduce results and maintain consistency across experiments.

HOW TO SAVE

• From the Evaluations page, click on Run an Evaluation to start a new evaluation.
• Configure your evaluation’s inputs in the Builder.
• Click on the drop-down menu next to the Save button and select Save as.
• Give your evaluation a Display Name and click Save Recipe.

ACCESSING SAVED EVALUATION RECIPES

You can access saved evaluation recipes from the Recipes page. Select the Evaluation type from the Type drop-down to filter on evaluation recipes.

Click a recipe to review and edit its JSON configuration. After opening an item, you can:

• Save the recipe
• Create a new recipe
• Update an existing recipe
• Rename the recipe
• Run the job upon saving