{
  "ok": true,
  "data": {
    "entry": {
      "id": "attention-viz",
      "kind": "tool",
      "kindLabel": "Tool",
      "title": "BertViz for watching attention move",
      "body": "An open-source visualizer that shows which tokens each attention head is looking at, layer by layer. You start to notice heads that only track quotation marks, or ones that follow subject-verb agreement across a whole paragraph.",
      "tag": "tooling",
      "date": "2025 · 10 · 19",
      "publishedAt": "2025-10-19",
      "note": "Most heads are boring. The interesting 5% are worth the dig.",
      "insight": {
        "aha": "Attention is not the whole mind, but it is a useful map of what information is being routed where.",
        "tryThis": "Inspect heads for repeated roles: bracket matching, quote tracking, subject agreement, or copied labels.",
        "watchFor": [
          "Pretty attention maps with no behavioral test",
          "One dramatic head treated as the whole explanation",
          "Patterns that disappear after small prompt perturbations"
        ],
        "labId": "attention-routing"
      },
      "extended": [
        "BertViz draws the attention pattern as lines connecting tokens, split by head and layer. It runs in a notebook in a couple of lines and works on most Hugging Face transformer models.",
        "The value is not the pretty picture, it is the habit of looking. Once you have seen a head that exclusively tracks matching brackets, you stop thinking of the model as a black box and start thinking of it as a stack of small, legible mechanisms."
      ],
      "url": "https://tips.platphormnews.com/entries/attention-viz"
    }
  }
}