Add expected response for agent evaluation test cases
[Web]
Makers can now add expected responses to agent evaluation test cases manually or through file import.
Details:
What changed:
Test cases now support expected responses and multiple grading methods, including Exact, Partial, Similarity, and Compare Meaning.
Why:
This helps makers evaluate agent quality more accurately and consistently.
Try this:
Add expected responses to an existing test case.
Import a file containing multiple test cases.
Run an evaluation using different grading methods.
Why this matters:
Business impact:
Improves agent reliability and testing accuracy.
Personal impact:
Makes it easier to validate agent behavior.
Additional resources:
Learn:
Create a single response test set