| |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | +0.80 | ND | Strong positive | 0.90 | 0.00 | Digital Library Rights | | deepseek/deepseek-v3.2-20251201 | +0.42 | +0.43 | Moderate positive | 0.15 | 0.26 | Information Access & Culture | | @cf/meta/llama-4-scout-17b-16e-instruct lite | +0.60 | ND | Moderate positive | 0.80 | 0.00 | Digital Rights | | meta-llama/llama-3.3-70b-instruct:free | ND | ND | — | — | — | — | | nvidia/nemotron-3-nano-30b-a3b:free | ND | ND | — | — | — | — | | Section | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | deepseek/deepseek-v3.2-20251201 | @cf/meta/llama-4-scout-17b-16e-instruct lite | meta-llama/llama-3.3-70b-instruct:free | nvidia/nemotron-3-nano-30b-a3b:free | | Preamble | ND | 0.56 | ND | ND | ND | | Article 1 | ND | ND | ND | ND | ND | | Article 2 | ND | ND | ND | ND | ND | | Article 3 | ND | ND | ND | ND | ND | | Article 4 | ND | ND | ND | ND | ND | | Article 5 | ND | ND | ND | ND | ND | | Article 6 | ND | ND | ND | ND | ND | | Article 7 | ND | ND | ND | ND | ND | | Article 8 | ND | 0.20 | ND | ND | ND | | Article 9 | ND | ND | ND | ND | ND | | Article 10 | ND | 0.20 | ND | ND | ND | | Article 11 | ND | ND | ND | ND | ND | | Article 12 | ND | ND | ND | ND | ND | | Article 13 | ND | ND | ND | ND | ND | | Article 14 | ND | ND | ND | ND | ND | | Article 15 | ND | ND | ND | ND | ND | | Article 16 | ND | ND | ND | ND | ND | | Article 17 | ND | 0.30 | ND | ND | ND | | Article 18 | ND | ND | ND | ND | ND | | Article 19 | ND | 1.00 | ND | ND | ND | | Article 20 | ND | ND | ND | ND | ND | | Article 21 | ND | ND | ND | ND | ND | | Article 22 | ND | ND | ND | ND | ND | | Article 23 | ND | ND | ND | ND | ND | | Article 24 | ND | ND | ND | ND | ND | | Article 25 | ND | 0.30 | ND | ND | ND | | Article 26 | ND | 0.80 | ND | ND | ND | | Article 27 | ND | 1.00 | ND | ND | ND | | Article 28 | ND | ND | ND | ND | ND | | Article 29 | ND | 0.20 | ND | ND | ND | | Article 30 | ND | ND | ND | ND | ND | | Summary ~lite Digital Library Rights Champions Defending library lending
Lite evaluation by llama-3.3-70b-wai · editorial channel only · no per-section breakdown available
| |
Longitudinal
· 3 evals | |
Audit Trail
15 entries | 2026-02-28 00:43 | eval_success | Light evaluated: Strong positive (0.80) | - - | | 2026-02-28 00:43 |
eval
|
Evaluated by llama-3.3-70b-wai: +0.80 (Strong positive) | | | 2026-02-27 02:01 | eval_success | Evaluated: Moderate positive (0.60) | - - | | 2026-02-27 02:01 |
eval
|
Evaluated by deepseek-v3.2: +0.60 (Moderate positive) 11,349 tokens | | | 2026-02-26 22:36 | eval_success | Light evaluated: Moderate positive (0.60) | - - | | 2026-02-26 22:36 |
eval
|
Evaluated by llama-4-scout-wai: +0.60 (Moderate positive) | | | 2026-02-26 22:08 | rater_validation_fail | Validation failed for model llama-4-scout-wai | - - | | 2026-02-26 22:02 | rater_validation_fail | Validation failed for model llama-4-scout-wai | - - | | 2026-02-26 21:21 | dlq | Dead-lettered after 1 attempts: Archive.org Seeks Summary Judgment in Lawsuit | - - | | 2026-02-26 21:19 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-26 21:18 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-26 21:17 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-26 06:54 | dlq | Dead-lettered after 1 attempts: Archive.org Seeks Summary Judgment in Lawsuit | - - | | 2026-02-26 06:46 | credit_exhausted | Credit balance too low, retrying in 253s | - - | | 2026-02-26 06:40 | credit_exhausted | Credit balance too low, retrying in 298s | - - | | |
| |