Python: feat(evals): add ground_truth support for similarity evaluator by chetantoshniwal · Pull Request #5234 · microsoft/agent-framework

@chetantoshniwal

- Include expected_output as ground_truth in Foundry JSONL dataset rows
- Add ground_truth to item schema and data mapping for similarity evaluator
- Add expected_output parameter to evaluate_workflow
- Add similarity Pattern 3 to evaluate_agent and evaluate_workflow samples
- Add tests for ground_truth in dataset, schema, and evaluate_workflow

AI review requested due to automatic review settings

April 13, 2026 22:07

@chetantoshniwal chetantoshniwal changed the title feat(evals): add ground_truth support for similarity evaluator .NET feat(evals): add ground_truth support for similarity evaluator

Apr 13, 2026

@github-actions github-actions bot changed the title .NET feat(evals): add ground_truth support for similarity evaluator Python: .NET feat(evals): add ground_truth support for similarity evaluator

Apr 13, 2026

@chetantoshniwal

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

alliscode

@chetantoshniwal

@chetantoshniwal chetantoshniwal changed the title Python: .NET feat(evals): add ground_truth support for similarity evaluator Python: feat(evals): add ground_truth support for similarity evaluator

Apr 14, 2026