A Conversation is a series of messages exchanged between your Target Agent and Maihem’s Agents.

A Conversation will consist of a set of:

  • Turn: One message each from the Target Agent and Maihem Agent.
  • Message: The text content of the message (a message belongs to a single Turn)
  • Sentence: A substring of a Message.

Each of these components are individually evaluated against the configured Metrics to determine the performance of the Target Agent.

A Test Run will typically include multiple Conversations to evaluate the performance of your Target Agent against the configured Metrics.

Test RunEvaluation