Model Comparison
Model Editorial Structural Class Conf SETL Theme
@cf/meta/llama-4-scout-17b-16e-instruct lite +0.10 -0.20 Neutral 0.80 0.24 Cybersecurity Privacy
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite +0.04 -0.60 Moderate negative 0.70 0.62 Digital Rights
@cf/meta/llama-4-scout-17b-16e-instruct lite ND ND 0.80
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite ND ND 0.70
openai/gpt-oss-120b:free lite ND ND
google/gemma-3-27b-it:free lite ND ND
qwen/qwen3-coder:free lite ND ND
Section @cf/meta/llama-4-scout-17b-16e-instruct lite @cf/meta/llama-3.3-70b-instruct-fp8-fast lite @cf/meta/llama-4-scout-17b-16e-instruct lite @cf/meta/llama-3.3-70b-instruct-fp8-fast lite openai/gpt-oss-120b:free lite google/gemma-3-27b-it:free lite qwen/qwen3-coder:free lite
Preamble ND ND ND ND ND ND ND
Article 1 ND ND ND ND ND ND ND
Article 2 ND ND ND ND ND ND ND
Article 3 ND ND ND ND ND ND ND
Article 4 ND ND ND ND ND ND ND
Article 5 ND ND ND ND ND ND ND
Article 6 ND ND ND ND ND ND ND
Article 7 ND ND ND ND ND ND ND
Article 8 ND ND ND ND ND ND ND
Article 9 ND ND ND ND ND ND ND
Article 10 ND ND ND ND ND ND ND
Article 11 ND ND ND ND ND ND ND
Article 12 ND ND ND ND ND ND ND
Article 13 ND ND ND ND ND ND ND
Article 14 ND ND ND ND ND ND ND
Article 15 ND ND ND ND ND ND ND
Article 16 ND ND ND ND ND ND ND
Article 17 ND ND ND ND ND ND ND
Article 18 ND ND ND ND ND ND ND
Article 19 ND ND ND ND ND ND ND
Article 20 ND ND ND ND ND ND ND
Article 21 ND ND ND ND ND ND ND
Article 22 ND ND ND ND ND ND ND
Article 23 ND ND ND ND ND ND ND
Article 24 ND ND ND ND ND ND ND
Article 25 ND ND ND ND ND ND ND
Article 26 ND ND ND ND ND ND ND
Article 27 ND ND ND ND ND ND ND
Article 28 ND ND ND ND ND ND ND
Article 29 ND ND ND ND ND ND ND
Article 30 ND ND ND ND ND ND ND
+0.10 EU Commission to staff: Switch to Signal messaging app (www.politico.eu)
495 points by maxbaines 2210 days ago | 278 comments on HN | Neutral ~lite vlite-1.6
Summary ~lite Cybersecurity Privacy Acknowledges
EU Commission advises staff to switch to Signal messaging app for security
EQ 0.60
SO 0.70
TD 0.50
Lite evaluation by llama-4-scout-wai · editorial channel only · no per-section breakdown available
Longitudinal · 4 evals
+1 0 −1 HN
Audit Trail 9 entries
2026-03-07 21:59 eval_success Lite evaluated: Neutral (-0.02) - -
2026-03-07 21:59 model_divergence Cross-model spread 0.39 exceeds threshold (2 models) - -
2026-03-07 21:59 eval Evaluated by llama-4-scout-wai: -0.02 (Neutral)
reasoning
Editorial stance on EU Commission's switch to Signal messaging app, transparency indicators
2026-03-07 21:51 eval_success Lite evaluated: Moderate negative (-0.41) - -
2026-03-07 21:51 eval Evaluated by llama-3.3-70b-wai: -0.41 (Moderate negative)
reasoning
EU Commission staff switch to Signal
2026-03-06 18:18 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-06 18:18 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive)
2026-03-06 18:17 eval_success PSQ evaluated: g-PSQ=0.034 (3 dims) - -
2026-03-06 18:17 eval Evaluated by llama-3.3-70b-wai-psq: +0.03 (Neutral)