| |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | @cf/meta/llama-4-scout-17b-16e-instruct lite | +0.40 | ND | Moderate positive | 0.90 | 0.00 | Data Protection | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | 0.00 | ND | Neutral | 0.80 | 0.00 | Data Security | | Section | @cf/meta/llama-4-scout-17b-16e-instruct lite | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | Delta | | Preamble | ND | ND | | Article 1 | ND | ND | | Article 2 | ND | ND | | Article 3 | ND | ND | | Article 4 | ND | ND | | Article 5 | ND | ND | | Article 6 | ND | ND | | Article 7 | ND | ND | | Article 8 | ND | ND | | Article 9 | ND | ND | | Article 10 | ND | ND | | Article 11 | ND | ND | | Article 12 | ND | ND | | Article 13 | ND | ND | | Article 14 | ND | ND | | Article 15 | ND | ND | | Article 16 | ND | ND | | Article 17 | ND | ND | | Article 18 | ND | ND | | Article 19 | ND | ND | | Article 20 | ND | ND | | Article 21 | ND | ND | | Article 22 | ND | ND | | Article 23 | ND | ND | | Article 24 | ND | ND | | Article 25 | ND | ND | | Article 26 | ND | ND | | Article 27 | ND | ND | | Article 28 | ND | ND | | Article 29 | ND | ND | | Article 30 | ND | ND | | Summary ~lite Data Protection Acknowledges Article discusses and fixes a data exfiltration vulnerability in Microsoft 365 Copilot
Lite evaluation by llama-4-scout-wai · editorial channel only · no per-section breakdown available
| |
Longitudinal
· 3 evals | |
Audit Trail
13 entries | 2026-02-28 08:21 | eval_success | Light evaluated: Moderate positive (0.40) | - - | | 2026-02-28 08:21 | model_divergence | Cross-model spread 0.40 exceeds threshold (2 models) | - - | | 2026-02-28 08:21 |
eval
|
Evaluated by llama-4-scout-wai: +0.40 (Moderate positive) | | | reasoning ED - Technical article on data exfiltration vulnerability | | 2026-02-28 08:21 | rater_validation_warn | Light validation warnings for model llama-4-scout-wai: 0W 1R | - - | | 2026-02-28 08:13 | eval_success | Light evaluated: Neutral (0.00) | - - | | 2026-02-28 08:13 | rater_validation_warn | Light validation warnings for model llama-3.3-70b-wai: 0W 1R | - - | | 2026-02-28 08:13 |
eval
|
Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) 0.00 | | | reasoning Tech blog neutral stance | | 2026-02-28 08:09 | eval_success | Light evaluated: Neutral (0.00) | - - | | 2026-02-28 08:09 |
eval
|
Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) | | | reasoning Tech blog neutral stance | | 2026-02-28 08:09 | rater_validation_warn | Light validation warnings for model llama-3.3-70b-wai: 0W 1R | - - | | 2026-02-26 06:54 | dlq | Dead-lettered after 1 attempts: Microsoft 365 Copilot – Arbitrary Data Exfiltration via Mermaid Diagrams | - - | | 2026-02-26 06:46 | credit_exhausted | Credit balance too low, retrying in 245s | - - | | 2026-02-26 06:41 | credit_exhausted | Credit balance too low, retrying in 274s | - - | | |
| |