| |
Alpha This system is experimental. Scores and classifications are early-stage research and may be unreliable. Methodology → |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | @cf/meta/llama-4-scout-17b-16e-instruct lite | ND | ND | — | 0.83 | — | — | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | 0.00 | +0.23 | Neutral | 0.90 | -0.23 | Mathematics | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | ND | ND | — | 0.92 | — | — | | @cf/meta/llama-4-scout-17b-16e-instruct lite | 0.00 | -0.17 | Neutral | 1.00 | 0.17 | Mathematics AI | | Section | @cf/meta/llama-4-scout-17b-16e-instruct lite | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | @cf/meta/llama-4-scout-17b-16e-instruct lite | | Preamble | ND | ND | ND | ND | | Article 1 | ND | ND | ND | ND | | Article 2 | ND | ND | ND | ND | | Article 3 | ND | ND | ND | ND | | Article 4 | ND | ND | ND | ND | | Article 5 | ND | ND | ND | ND | | Article 6 | ND | ND | ND | ND | | Article 7 | ND | ND | ND | ND | | Article 8 | ND | ND | ND | ND | | Article 9 | ND | ND | ND | ND | | Article 10 | ND | ND | ND | ND | | Article 11 | ND | ND | ND | ND | | Article 12 | ND | ND | ND | ND | | Article 13 | ND | ND | ND | ND | | Article 14 | ND | ND | ND | ND | | Article 15 | ND | ND | ND | ND | | Article 16 | ND | ND | ND | ND | | Article 17 | ND | ND | ND | ND | | Article 18 | ND | ND | ND | ND | | Article 19 | ND | ND | ND | ND | | Article 20 | ND | ND | ND | ND | | Article 21 | ND | ND | ND | ND | | Article 22 | ND | ND | ND | ND | | Article 23 | ND | ND | ND | ND | | Article 24 | ND | ND | ND | ND | | Article 25 | ND | ND | ND | ND | | Article 26 | ND | ND | ND | ND | | Article 27 | ND | ND | ND | ND | | Article 28 | ND | ND | ND | ND | | Article 29 | ND | ND | ND | ND | | Article 30 | ND | ND | ND | ND | | Summary ~lite Terence Tao discusses AI solving Erdos problem #728, demonstrating increased AI capability.
Lite evaluation by llama-4-scout-wai-psq · editorial channel only · no per-section breakdown available
| |
Longitudinal
· 6 evals | |
Audit Trail
15 entries | 2026-03-09 09:21 | eval_success | PSQ evaluated: g-PSQ=0.320 (3 dims) | - - | | 2026-03-09 09:21 |
eval
|
Evaluated by llama-4-scout-wai-psq: +0.32 (Moderate positive) 0.00 | | | 2026-03-09 09:17 | eval_success | Lite evaluated: Neutral (0.09) | - - | | 2026-03-09 09:17 |
eval
|
Evaluated by llama-3.3-70b-wai: +0.09 (Neutral) 0.00 | | | reasoning Technical math post, no rights discussion | | 2026-03-09 09:17 | rater_validation_warn | Lite validation warnings for model llama-3.3-70b-wai: 1W 0R | - - | | 2026-03-09 09:17 | eval_success | PSQ evaluated: g-PSQ=0.320 (3 dims) | - - | | 2026-03-09 09:17 |
eval
|
Evaluated by llama-4-scout-wai-psq: +0.32 (Moderate positive) | | | 2026-03-09 09:15 | eval_success | PSQ evaluated: g-PSQ=0.669 (3 dims) | - - | | 2026-03-09 09:15 |
eval
|
Evaluated by llama-3.3-70b-wai-psq: +0.67 (Strong positive) | | | 2026-03-09 09:14 | eval_success | Lite evaluated: Neutral (-0.07) | - - | | 2026-03-09 09:14 |
eval
|
Evaluated by llama-4-scout-wai: -0.07 (Neutral) | | | reasoning Technical discussion on AI solving Erdos problems, no human rights discussion | | 2026-03-09 09:14 | rater_validation_warn | Lite validation warnings for model llama-4-scout-wai: 1W 0R | - - | | 2026-03-09 09:12 | eval_success | Lite evaluated: Neutral (0.09) | - - | | 2026-03-09 09:12 | rater_validation_warn | Lite validation warnings for model llama-3.3-70b-wai: 1W 0R | - - | | 2026-03-09 09:12 |
eval
|
Evaluated by llama-3.3-70b-wai: +0.09 (Neutral) | | | reasoning Technical math post, no rights discussion | | |
| |