In evaluation, a ground-truth plan serves to provide what?

• A. The ideal sequence of tool calls and steps used as a benchmark to assess agent decisions.
• B. A log of past actions.
• C. A random plan to stress test.
• D. A plan to bypass safety checks.

Answer: (A)

In evaluation, the ground-truth plan is a reference sequence of tool calls and steps that represents the optimal way to complete the task. It provides a gold standard against which the agent’s decisions are judged, letting you see whether the agent chose the right tools and followed the correct order to reach the goal. This benchmark helps measure how closely the agent’s actions align with the intended procedure and how effectively it progresses through the task. It’s not a log of actions taken earlier, nor a random plan used for stress testing, nor a plan designed to bypass safety checks.