How scoring works
Accuracy uses baseline questions that received a response. Consistency compares pairs where both answers can be read. CFM is the share of initially correct answers that remain correct under semantic renaming; unclear semantic answers count as failures.
Each score shows how many answers it uses. Partial runs use the available comparisons, with API failures listed separately. Use the Python auditor to add bootstrap confidence intervals.