Evidence collection
Model outputs
Original answers and available reasoning traces.
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q01_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q01_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q02_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q02_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q03_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q03_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q04_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q04_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q05_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q05_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q06_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q06_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q07_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q07_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q08_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q08_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q09_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q09_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q10_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q10_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q11_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q11_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q12_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q12_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q13_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q13_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q14_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q14_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q15_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q15_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q16_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q16_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q17_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q17_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q18_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q18_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q19_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q19_r1.reasoning.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q20_r1.md
- DeepSeek-V4-Flash-0731-UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS__q20_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q01_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q01_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q02_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q02_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q03_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q03_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q04_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q04_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q05_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q05_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q06_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q06_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q07_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q07_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q08_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q08_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q09_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q09_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q10_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q10_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q11_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q11_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q12_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q12_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q13_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q13_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q14_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q14_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q15_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q15_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q16_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q16_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q17_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q17_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q18_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q18_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q19_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q19_r1.reasoning.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q20_r1.md
- Qwen3.5-27B-UD-Q6_K_XL/Qwen3.5-27B-UD-Q6_K_XL__q20_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q01_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q01_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q02_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q02_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q03_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q03_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q04_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q04_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q05_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q05_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q06_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q06_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q07_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q07_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q08_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q08_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q09_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q09_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q10_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q10_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q11_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q11_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q12_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q12_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q13_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q13_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q14_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q14_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q15_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q15_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q16_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q16_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q17_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q17_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q18_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q18_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q19_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q19_r1.reasoning.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q20_r1.md
- Qwen3.8-27B-UD-Q6_K_XL/Qwen3.8-27B-UD-Q6_K_XL__q20_r1.reasoning.md
- claude-opus-5/claude-opus-5__q01_r1.md
- claude-opus-5/claude-opus-5__q01_r1.reasoning.md
- claude-opus-5/claude-opus-5__q02_r1.md
- claude-opus-5/claude-opus-5__q02_r1.reasoning.md
- claude-opus-5/claude-opus-5__q03_r1.md
- claude-opus-5/claude-opus-5__q03_r1.reasoning.md
- claude-opus-5/claude-opus-5__q04_r1.md
- claude-opus-5/claude-opus-5__q04_r1.reasoning.md
- claude-opus-5/claude-opus-5__q05_r1.md
- claude-opus-5/claude-opus-5__q05_r1.reasoning.md
- claude-opus-5/claude-opus-5__q06_r1.md
- claude-opus-5/claude-opus-5__q07_r1.md
- claude-opus-5/claude-opus-5__q07_r1.reasoning.md
- claude-opus-5/claude-opus-5__q08_r1.md
- claude-opus-5/claude-opus-5__q09_r1.md
- claude-opus-5/claude-opus-5__q10_r1.md
- claude-opus-5/claude-opus-5__q10_r1.reasoning.md
- claude-opus-5/claude-opus-5__q11_r1.md
- claude-opus-5/claude-opus-5__q11_r1.reasoning.md
- claude-opus-5/claude-opus-5__q12_r1.md
- claude-opus-5/claude-opus-5__q12_r1.reasoning.md
- claude-opus-5/claude-opus-5__q13_r1.md
- claude-opus-5/claude-opus-5__q13_r1.reasoning.md
- claude-opus-5/claude-opus-5__q14_r1.md
- claude-opus-5/claude-opus-5__q14_r1.reasoning.md
- claude-opus-5/claude-opus-5__q15_r1.md
- claude-opus-5/claude-opus-5__q15_r1.reasoning.md
- claude-opus-5/claude-opus-5__q16_r1.md
- claude-opus-5/claude-opus-5__q16_r1.reasoning.md
- claude-opus-5/claude-opus-5__q17_r1.md
- claude-opus-5/claude-opus-5__q17_r1.reasoning.md
- claude-opus-5/claude-opus-5__q18_r1.md
- claude-opus-5/claude-opus-5__q18_r1.reasoning.md
- claude-opus-5/claude-opus-5__q19_r1.md
- claude-opus-5/claude-opus-5__q19_r1.reasoning.md
- claude-opus-5/claude-opus-5__q20_r1.md
- claude-opus-5/claude-opus-5__q20_r1.reasoning.md