Model Comparison 77% sign agreement
Model Editorial Structural Class Conf SETL Theme
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite +0.50 ND Moderate positive 0.90 0.00 Police Surveillance
@cf/meta/llama-4-scout-17b-16e-instruct lite -0.60 ND Moderate negative 0.80 0.00 law enforcement surveillance
deepseek/deepseek-v3.2-20251201 +0.40 0.00 Neutral 0.21 0.50 Privacy & Surveillance
meta-llama/llama-3.3-70b-instruct:free ND ND — — — —
nvidia/nemotron-3-nano-30b-a3b:free ND ND — — — —
Section @cf/meta/llama-3.3-70b-instruct-fp8-fast lite @cf/meta/llama-4-scout-17b-16e-instruct lite deepseek/deepseek-v3.2-20251201 meta-llama/llama-3.3-70b-instruct:free nvidia/nemotron-3-nano-30b-a3b:free
Preamble ND -0.06 0.30 ND ND
Article 1 ND 0.00 0.60 ND ND
Article 2 ND 0.00 0.70 ND ND
Article 3 ND 0.00 0.60 ND ND
Article 4 ND 0.00 ND ND ND
Article 5 ND 0.00 ND ND ND
Article 6 ND 0.00 0.40 ND ND
Article 7 ND 0.00 0.40 ND ND
Article 8 ND 0.00 ND ND ND
Article 9 ND 0.00 ND ND ND
Article 10 ND 0.00 ND ND ND
Article 11 ND 0.00 ND ND ND
Article 12 ND 0.00 -0.80 ND ND
Article 13 ND -0.06 0.40 ND ND
Article 14 ND 0.00 ND ND ND
Article 15 ND 0.00 ND ND ND
Article 16 ND 0.00 ND ND ND
Article 17 ND 0.00 ND ND ND
Article 18 ND 0.00 0.50 ND ND
Article 19 ND 0.06 0.70 ND ND
Article 20 ND 0.06 0.40 ND ND
Article 21 ND 0.00 0.30 ND ND
Article 22 ND 0.00 ND ND ND
Article 23 ND 0.00 ND ND ND
Article 24 ND 0.00 ND ND ND
Article 25 ND 0.00 ND ND ND
Article 26 ND 0.00 ND ND ND
Article 27 ND 0.00 ND ND ND
Article 28 ND 0.00 0.50 ND ND
Article 29 ND 0.00 ND ND ND
Article 30 ND 0.00 ND ND ND
+0.50 DEA authorized to conduct surveillance on protestors (www.buzzfeednews.com)
599 points by codezero 2098 days ago | 313 comments on HN | Moderate positive ~lite vlite-1.4
Summary ~lite Police Surveillance Advocates
Exposes government surveillance
EQ 0.80
SO 0.70
TD 0.60
Lite evaluation by llama-3.3-70b-wai · editorial channel only · no per-section breakdown available
Longitudinal · 4 evals
+1 0 −1 HN
Audit Trail 24 entries
2026-02-28 13:36 model_divergence Cross-model spread 1.10 exceeds threshold (3 models) - -
2026-02-28 13:36 eval_success Lite evaluated: Moderate positive (0.50) - -
2026-02-28 13:36 eval Evaluated by llama-3.3-70b-wai: +0.50 (Moderate positive)
reasoning
Exposing surveillance abuse
2026-02-26 22:37 eval_success Light evaluated: Moderate negative (-0.60) - -
2026-02-26 22:37 eval Evaluated by llama-4-scout-wai: -0.60 (Moderate negative) -0.60
2026-02-26 20:44 eval_success Evaluated: Neutral (0.36) - -
2026-02-26 20:44 eval Evaluated by deepseek-v3.2: +0.36 (Neutral) 13,531 tokens
2026-02-26 20:01 dlq Dead-lettered after 1 attempts: DEA authorized to conduct surveillance on protestors - -
2026-02-26 20:00 dlq Dead-lettered after 1 attempts: DEA authorized to conduct surveillance on protestors - -
2026-02-26 20:00 eval_failure Evaluation failed: Error: Unknown model in registry: llama-4-scout-wai - -
2026-02-26 20:00 eval_failure Evaluation failed: Error: Unknown model in registry: llama-4-scout-wai - -
2026-02-26 19:59 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:58 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:57 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:52 eval_success Evaluated: Neutral (0.00) - -
2026-02-26 19:52 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
2026-02-26 19:52 rater_validation_warn Validation warnings for model llama-4-scout-wai: 27W 27R - -
2026-02-26 19:12 dlq Dead-lettered after 1 attempts: DEA authorized to conduct surveillance on protestors - -
2026-02-26 19:09 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:08 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:07 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 07:24 dlq Dead-lettered after 1 attempts: DEA authorized to conduct surveillance on protestors - -
2026-02-26 07:23 dlq Dead-lettered after 1 attempts: DEA authorized to conduct surveillance on protestors - -
2026-02-26 07:21 dlq Dead-lettered after 1 attempts: DEA authorized to conduct surveillance on protestors - -