EvalItem Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Provider-agnostic data for a single evaluation item.
public sealed class EvalItemtype EvalItem = classPublic NotInheritable Class EvalItem- Inheritance
-
EvalItem
Constructors
| Name | Description |
|---|---|
| EvalItem(IReadOnlyList<ChatMessage>, IConversationSplitter) |
Initializes a new instance of the EvalItem class from a conversation, deriving query and response text via the default splitter. |
| EvalItem(String, String, IReadOnlyList<ChatMessage>) |
Initializes a new instance of the EvalItem class. |
| EvalItem(String, String) |
Initializes a new instance of the EvalItem class from query and response strings, automatically building a minimal conversation. |
Properties
| Name | Description |
|---|---|
| Context |
Gets or sets grounding context for evaluation. |
| Conversation |
Gets the full conversation history. |
| ExpectedOutput |
Gets or sets the expected output for ground-truth comparison. |
| ExpectedToolCalls |
Gets or sets the expected tool calls for tool-correctness evaluation. |
| HasImageContent |
Gets whether any message in the conversation contains image content. |
| Query |
Gets the user query. |
| RawResponse |
Gets or sets the raw chat response for MEAI evaluators. |
| Response |
Gets the agent response text. |
| Splitter |
Gets or sets the conversation splitter for this item. |
| Tools |
Gets or sets the tools available to the agent. |
Methods
| Name | Description |
|---|---|
| PerTurnItems(IReadOnlyList<ChatMessage>, IReadOnlyList<AITool>, String) |
Splits a multi-turn conversation into one EvalItem per user turn. |
| Split(IConversationSplitter) |
Splits the conversation into query messages and response messages. |