{
  "ok": true,
  "data": {
    "entry": {
      "id": "logprobs",
      "kind": "method",
      "kindLabel": "Method",
      "title": "Read the logprobs, not the answer",
      "body": "The text a model gives you is the tip of the iceberg. Ask the API for token logprobs and you can see where it was confident versus where it basically flipped a coin. A fluent sentence built on 51% tokens is a guess wearing a suit.",
      "tag": "interpretability",
      "date": "2025 · 11 · 02",
      "publishedAt": "2025-11-02",
      "note": "Confidence ≠ correctness. But low confidence is a great place to look for hallucinations.",
      "insight": {
        "aha": "The final text is only the winning token path. The uncertainty is still visible in the runners-up.",
        "tryThis": "Render low-margin tokens first, especially names, dates, citations, and first tokens after a policy boundary.",
        "watchFor": [
          "Fluent spans built from low-confidence token choices",
          "Nearly tied alternatives around entities",
          "A confident tone hiding a fragile probability margin"
        ],
        "labId": "logprobs"
      },
      "extended": [
        "Every token a model emits comes with a probability distribution over the whole vocabulary. The decoded text only shows you the winner. The logprobs show you the race.",
        "When you pull them back, scan for the spots where the top token barely beat the runner-up. Those are the seams. Names, dates, citations, and the first token of a refusal are where you most often find a coin-flip dressed up as a confident sentence.",
        "A practical loop: request the top 5 logprobs per token, render them as a heatmap over the output, and read the cold spots first. That is usually where the hallucination lives."
      ],
      "url": "https://tips.platphormnews.com/entries/logprobs"
    }
  }
}