The AI could not analyze a file it never received
The requested analysis depended on a document that was referenced but never attached or pasted.
What the user wanted
The actual target
Compare a private research memo with a published paper and identify contradictions.
What they asked
The instruction
Compare my memo with the paper and tell me where they disagree.
What the AI produced
The observable result
A generic comparison based on assumptions about what the unseen memo probably contained.
Why
Why WWW assigns this verdict
No model can compare two documents when it has only one of them. The missing source is not a wording flaw and not evidence that a different model would know the private memo.
What gave it away
The answer never quoted or referenced any exact claim from the memo because the memo was absent from the conversation.
Fix
What to do next
- Attach or paste the memo and confirm that the model can read it.
- Name the comparison dimensions: claims, evidence, methods, and conclusions.
- Require citations to both documents so missing access becomes obvious.
Repaired instruction
A safer retry
Using the attached memo and paper, identify direct disagreements in claims, methods, evidence, and conclusions. Quote or cite the relevant passage from each document for every disagreement. If either document is unavailable or unreadable, stop and tell me exactly what is missing instead of inferring its contents.
Model recommendation
Stay, retry, or switch?
Stay with Claude once both documents are actually available. The blocker was access to the source, not model capability.
General lesson
What survives this one case
If success depends on information the model cannot see, fix access before rewriting the instruction or switching models.