Saved visible answer
Exact saved user prompt
The study download includes token usage, original responses, scoring code and supporting records.
Browse saved runs, prompts and model answers.
16K vs. 32K token study → This separate study is not included in the totals below.
Triangle confirmation · 17 Nov 2026 → 576/576 responses on 96 fresh graphs. Reported separately from the archive totals below.
Compare results within each run; datasets and settings differ.
The 24/24 family-pilot row is a subset of the larger replication.
Select a run to inspect its answers.
| Model / run | Correct / returned | Wrong answers | Cutoffs | Invalid answers | API errors | Coverage | Requested settings | Recorded cost |
|---|
| Graph question | Condition | Expected | Parsed | Outcome |
|---|
The study download includes token usage, original responses, scoring code and supporting records.
These scores come from the paper. The original model responses are unavailable.