ND 2% of ICML papers desk rejected because the authors used LLM in their reviews (blog.icml.cc)
199 points by sergdigon 9 days ago | 158 comments on HN ~lite vlite-2.0
Summary ~lite
ICML blog post discusses desk rejections due to LLM usage in reviews.
Lite evaluation by llama-4-scout-wai-psq · editorial channel only · no per-section breakdown available
Longitudinal 424 HN snapshots · 101 evals
+1 0 −1 HN
Audit Trail 121 entries
2026-03-22 00:40 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-22 00:40 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-22 00:40 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-22 00:40 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-21 22:31 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-21 22:31 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-21 22:10 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-21 22:10 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-21 20:43 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-21 20:43 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-21 20:27 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-21 20:27 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 23:18 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 23:18 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 22:11 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-20 22:11 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 21:58 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 21:58 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 21:29 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-20 21:29 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 21:21 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 21:21 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 20:54 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-20 20:54 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 20:43 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 20:43 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 20:19 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-20 20:19 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) -0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 20:06 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 20:06 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 19:43 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-20 19:43 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 19:27 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 19:27 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 18:33 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-20 18:33 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 18:15 eval_success PSQ evaluated: g-PSQ=0.120 (3 dims) - -
2026-03-20 18:15 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 17:56 eval_success Lite evaluated: Mild negative (-0.18) - -
2026-03-20 17:56 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 17:23 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 17:06 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 16:07 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 15:47 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) -0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 15:25 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 15:05 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 14:44 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 14:27 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) +0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 14:07 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 13:52 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 13:31 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 13:16 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) -0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 12:54 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 12:37 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 12:12 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 11:57 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 11:31 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 11:20 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 10:50 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 10:41 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 10:13 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 10:04 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 09:35 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 09:25 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) +0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 08:55 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 08:46 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) -0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 08:14 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 08:07 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) +0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 07:32 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 07:26 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) -0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 06:49 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 06:44 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 06:09 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 06:07 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) +0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 05:32 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 05:31 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) -0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 04:57 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 04:56 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 04:22 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 04:21 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 03:47 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 03:46 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) -0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 03:12 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 03:11 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 02:30 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 02:30 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 01:56 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 01:55 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 01:37 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) +0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 01:34 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 00:55 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) -0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-20 00:50 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-20 00:28 eval Evaluated by llama-3.3-70b-wai-psq: -0.24 (Mild negative)
2026-03-20 00:23 eval Evaluated by llama-3.3-70b-wai: -0.24 (Mild negative)
reasoning
Technical blog post on LLM review policies
2026-03-19 23:44 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) -0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 23:30 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 23:05 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 22:49 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 22:16 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) -0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 21:35 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 21:06 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 20:16 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 19:49 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 19:00 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 18:32 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 18:08 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 17:19 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) 0.00
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 16:54 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 16:04 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) -0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 15:43 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 14:49 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.36
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 14:23 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 13:31 eval Evaluated by llama-4-scout-wai: -0.36 (Moderate negative) -0.36
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 13:02 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 12:51 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) +0.18
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 12:19 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 12:11 eval Evaluated by llama-4-scout-wai: -0.18 (Mild negative) +0.08
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 11:38 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive) 0.00
2026-03-19 11:33 eval Evaluated by llama-4-scout-wai: -0.26 (Mild negative) -0.26
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion
2026-03-19 11:00 eval Evaluated by llama-4-scout-wai-psq: +0.12 (Mild positive)
2026-03-19 10:59 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
reasoning
Blog post discussing LLM review policy violations, no explicit human rights discussion