Prompt Details
Model
(claude-5-sonnet)
Token size
4,612
Example input
[ORIGINAL_QUESTION]: What country is the university located in where the researcher who created the Atlas compression method earned her PhD?
[SYSTEM_NAME]: Atlas Research Assistant — researcher education lookup
[SUB_QUESTIONS_AND_CHUNKS]: Hop 1 sub-question: "Who created the Atlas compression method?" Hop 1 retrieved chunk: "The Atlas compression method was introduced by computer scientist Dr. Maya Chen in a 2022 paper on efficient representation learning." Hop 1 resolves: Dr. Maya Chen. Hop 2 sub-question: "Where did she earn her PhD?" Hop 2 retrieved chunks: Chunk A: "Several researchers working on compression methods completed doctoral studies at universities in the United States and Canada." Chunk B: "Research scientist Maya Ortiz received her doctorate from Stanford University before joining the laboratory." No retrieved chunk contains "Maya Chen." Final answer: "The available evidence suggests Stanford University, but the researcher cannot be confirmed."
[FINAL_ANSWER]: The available evidence suggests Stanford University, but the researcher cannot be confirmed.
Example output
```
ENTITY CHAIN BREAK AUDIT
System/trace reviewed: Atlas Research Assistant — researcher education lookup
Original question: What country is the university located in where the researcher who created the Atlas compression method earned her PhD?
Hops in trace: 2
── FINDING CARD 1 ──
Location: Hop 2 handoff (Hop 1 → Hop 2)
Entity: Dr. Maya Chen (resolved in Hop 1)
Evidence: Hop 2 sub-question sent to the retriever: "Where did she
earn her PhD?"; no name restated from Hop 1's answer
("Dr. Maya Chen").
Classification: RETRIEVAL-SIDE BREAK
Reasoning: The unresolved pronoun "she" gave the retriever nothing
to anchor on, and the retrieved chunks show the
consequence directly: Chunk A is a generic, un-anchored
statement about unnamed researchers, and Chunk B
surfaces a different, merely similar-sounding person
(Maya Ortiz, not Maya Chen).
── FINDING CARD 2 ──
Location: Chunk B retrieved in Hop 2
Entity: Maya Ortiz (mistaken for Dr. Maya Chen)
Evidence: Retrieved chunk: "Research scientist Maya Ortiz received
her doctorate from Stanford University before joining
the laboratory." This chunk names a different individual
than the one resolved in Hop 1.
Classification: NO BREAK
Reasoning: There is no entity-chain break to classify here — the
chunk is internally coherent and fully resolved on its
own terms. It is simply the wrong entity, a symptom
that traces back to the retrieval-side break in Card 1,
not a separate generation-side failure of its own.
ROOT-CAUSE VERDICT: RETRIEVAL-SIDE
The entity resolved cleanly in Hop 1 but was never carried into the Hop
2 sub-question. That dropped name is what let the retriever return an
unanchored generic chunk and a same-first-name false match, producing a
final answer that names the wrong university with an appended (but
insufficient) hedge.
Refused inferences: none. The evidence in both chunks was sufficient to
classify directly without guessing.
Injection signals: none
Source: arXiv:2609.06065 (Lee & Lim, UNIST, EMNLP 2026 Findings)
```
By purchasing this prompt, you agree to our terms of service
CLAUDE-5-SONNET
Built on the two-failure-point taxonomy from a peer-reviewed 2026 EMNLP paper (arXiv:2609.06065): entities get lost either at the hop handoff (a later sub-question drops the resolved entity) or at the chunk boundary (a pronoun's antecedent lands in a different chunk than the pronoun itself).
...more
Added 4 days ago
