EvalChecks Class

Definition

Built-in check functions for common evaluation patterns.

public static class EvalChecks
type EvalChecks = class
Public Class EvalChecks
Inheritance
EvalChecks

Methods

Name Description
ContainsExpected(Boolean)

Creates a check that verifies the response contains the expected output text.

HasImageContent()

A check that verifies the conversation contains at least one image (DataContent or UriContent with an image media type).

KeywordCheck(Boolean, String[])

Creates a check that verifies the response contains all specified keywords.

KeywordCheck(String[])

Creates a check that verifies the response contains all specified keywords.

NonEmpty(Int32)

Creates a check that verifies the response is non-empty and meets a minimum length.

ToolCallArgsMatch()

A check that verifies expected tool calls match on name and optionally arguments.

ToolCalledCheck(String[])

Creates a check that verifies specific tools were called in the conversation. All specified tools must have been called.

ToolCalledCheck(ToolCalledMode, String[])

Creates a check that verifies specific tools were called in the conversation.

ToolCallsPresent()

A check that verifies at least one tool was called in the conversation.

Applies to