Model Comparison
Model Editorial Structural Class Conf SETL Theme
@cf/meta/llama-4-scout-17b-16e-instruct lite +0.20 ND Mild positive 0.80 0.00 Data Protection
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite 0.00 ND Neutral 0.80 0.00 Legal Compliance
deepseek/deepseek-v3.2-20251201 +0.42 +0.17 Moderate positive 0.01 Digital Access
Section @cf/meta/llama-4-scout-17b-16e-instruct lite @cf/meta/llama-3.3-70b-instruct-fp8-fast lite deepseek/deepseek-v3.2-20251201
Preamble ND ND ND
Article 1 ND ND ND
Article 2 ND ND ND
Article 3 ND ND ND
Article 4 ND ND ND
Article 5 ND ND ND
Article 6 ND ND ND
Article 7 ND ND ND
Article 8 ND ND ND
Article 9 ND ND ND
Article 10 ND ND ND
Article 11 ND ND ND
Article 12 ND ND ND
Article 13 ND ND ND
Article 14 ND ND ND
Article 15 ND ND ND
Article 16 ND ND ND
Article 17 ND ND ND
Article 18 ND ND ND
Article 19 ND ND ND
Article 20 ND ND ND
Article 21 ND ND ND
Article 22 ND ND ND
Article 23 ND ND ND
Article 24 ND ND ND
Article 25 ND ND ND
Article 26 ND ND ND
Article 27 ND ND ND
Article 28 ND ND ND
Article 29 ND ND ND
Article 30 ND ND ND
Longitudinal · 4 evals
+1 0 −1 HN
Audit Trail 24 entries
2026-02-28 07:31 eval_success Light evaluated: Mild positive (0.20) - -
2026-02-28 07:31 eval Evaluated by llama-4-scout-wai: +0.20 (Mild positive)
reasoning
Policy page with legal and compliance information
2026-02-28 07:31 rater_validation_warn Light validation warnings for model llama-4-scout-wai: 0W 1R - -
2026-02-28 07:31 model_divergence Cross-model spread 0.42 exceeds threshold (3 models) - -
2026-02-28 07:19 eval_success Light evaluated: Neutral (0.00) - -
2026-02-28 07:19 rater_validation_warn Light validation warnings for model llama-3.3-70b-wai: 0W 1R - -
2026-02-28 07:19 model_divergence Cross-model spread 0.42 exceeds threshold (2 models) - -
2026-02-28 07:19 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) 0.00
reasoning
Legal page neutral stance
2026-02-28 07:12 eval_success Light evaluated: Neutral (0.00) - -
2026-02-28 07:12 rater_validation_warn Light validation warnings for model llama-3.3-70b-wai: 0W 1R - -
2026-02-28 07:12 model_divergence Cross-model spread 0.42 exceeds threshold (2 models) - -
2026-02-28 07:12 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral)
reasoning
Legal page neutral stance
2026-02-26 17:26 eval_success Evaluated: Moderate positive (0.42) - -
2026-02-26 17:26 eval Evaluated by deepseek-v3.2: +0.42 (Moderate positive) 10,061 tokens
2026-02-26 17:26 dlq Dead-lettered after 1 attempts: Anthropic officially bans using subscription auth for third party use - -
2026-02-26 17:24 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 17:23 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 17:22 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 12:19 dlq Dead-lettered after 1 attempts: Anthropic officially bans using subscription auth for third party use - -
2026-02-26 12:17 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 12:16 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 12:15 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 05:33 dlq Dead-lettered after 1 attempts: Anthropic officially bans using subscription auth for third party use - -
2026-02-26 04:55 credit_exhausted Credit balance too low, retrying in 242s - -