| |
Alpha This system is experimental. Scores and classifications are early-stage research and may be unreliable. Methodology → |
| Summary ~lite A developer post-mortems a supply chain attack on their package, emphasizing transparency and future security plans.
Lite evaluation by llama-4-scout-wai-psq · editorial channel only · no per-section breakdown available
| |
Longitudinal
· 5 evals | |
Audit Trail
18 entries | 2026-03-05 11:45 | eval_success | PSQ evaluated: g-PSQ=0.440 (3 dims) | - - | | 2026-03-05 11:45 |
eval
|
Evaluated by llama-4-scout-wai-psq: +0.44 (Moderate positive) | | | 2026-03-05 11:40 | eval_success | PSQ evaluated: g-PSQ=0.481 (3 dims) | - - | | 2026-03-05 11:40 |
eval
|
Evaluated by llama-3.3-70b-wai-psq: +0.48 (Moderate positive) 0.00 | | | 2026-03-05 11:35 | eval_success | PSQ evaluated: g-PSQ=0.481 (3 dims) | - - | | 2026-03-05 11:35 |
eval
|
Evaluated by llama-3.3-70b-wai-psq: +0.48 (Moderate positive) | | | 2026-02-28 08:25 | eval_success | Light evaluated: Mild positive (0.10) | - - | | 2026-02-28 08:25 |
eval
|
Evaluated by llama-4-scout-wai: +0.10 (Mild positive) | | | reasoning Editorial on supply chain attack, no explicit rights stance | | 2026-02-28 08:25 | rater_validation_warn | Light validation warnings for model llama-4-scout-wai: 0W 1R | - - | | 2026-02-28 08:14 | eval_success | Light evaluated: Mild positive (0.20) | - - | | 2026-02-28 08:14 | rater_validation_warn | Light validation warnings for model llama-3.3-70b-wai: 0W 1R | - - | | 2026-02-28 08:14 |
eval
|
Evaluated by llama-3.3-70b-wai: +0.20 (Mild positive) | | | reasoning Security post-mortem with rights awareness | | 2026-02-26 05:56 | dlq | Dead-lettered after 1 attempts: Tinycolor supply chain attack post-mortem | - - | | 2026-02-26 05:44 | credit_exhausted | Credit balance too low, retrying in 305s | - - | | 2026-02-26 05:30 | dlq | Dead-lettered after 1 attempts: Tinycolor supply chain attack post-mortem | - - | | 2026-02-26 05:20 | credit_exhausted | Credit balance too low, retrying in 293s | - - | | 2026-02-26 05:08 | dlq | Dead-lettered after 1 attempts: Tinycolor supply chain attack post-mortem | - - | | 2026-02-26 04:56 | credit_exhausted | Credit balance too low, retrying in 344s | - - | | |
| |