Tool2026-06-25#evals

Use Socratic eval prompts in group

Socratic eval prompts frame readers to inspect systems instead of merely reacting to outputs. The question shapes the habit.

Good field eval prompts are short, reusable, and attached to visible artifacts. They work on a model answer, a tool plan, a note, a definition, or a citation list.

The strongest prompt is often: what would you need to see before you let this action run?

Aha moment

The question shapes the habit. Ask about failure, missing receipts, and next evidence instead of asking if it is good.

Try this

Give readers four prompts: what fails first, what receipt is missing, what term is undefined, and what evidence changes this.

Watch for

  • Eval questions that invite taste instead of inspection
  • Readers scoring outputs without citing artifacts
  • Questions that do not transfer to another workflow