Model Comparison
Model Editorial Structural Class Conf SETL Theme
claude-haiku-4-5-20251001 ND ND — — — —
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite 0.00 ND Neutral 0.80 0.00 AI Model Access
@cf/meta/llama-4-scout-17b-16e-instruct lite 0.00 ND Neutral 1.00 0.00 —
deepseek/deepseek-v3.2-20251201 +0.10 +0.20 Mild positive 0.01 -0.14 Information Access
claude-haiku-4-5 lite 0.00 ND Neutral 0.20 0.00 No evaluable content
nvidia/nemotron-3-nano-30b-a3b:free ND ND — — — —
meta-llama/llama-3.3-70b-instruct:free ND ND — — — —
Section claude-haiku-4-5-20251001 @cf/meta/llama-3.3-70b-instruct-fp8-fast lite @cf/meta/llama-4-scout-17b-16e-instruct lite deepseek/deepseek-v3.2-20251201 claude-haiku-4-5 lite nvidia/nemotron-3-nano-30b-a3b:free meta-llama/llama-3.3-70b-instruct:free
Preamble ND ND ND ND ND ND ND
Article 1 ND ND ND ND ND ND ND
Article 2 ND ND ND ND ND ND ND
Article 3 ND ND ND ND ND ND ND
Article 4 ND ND ND ND ND ND ND
Article 5 ND ND ND ND ND ND ND
Article 6 ND ND ND ND ND ND ND
Article 7 ND ND ND ND ND ND ND
Article 8 ND ND ND ND ND ND ND
Article 9 ND ND ND ND ND ND ND
Article 10 ND ND ND ND ND ND ND
Article 11 ND ND ND ND ND ND ND
Article 12 ND ND ND ND ND ND ND
Article 13 ND ND ND ND ND ND ND
Article 14 ND ND ND ND ND ND ND
Article 15 ND ND ND ND ND ND ND
Article 16 ND ND ND ND ND ND ND
Article 17 ND ND ND ND ND ND ND
Article 18 ND ND ND ND ND ND ND
Article 19 ND ND ND 0.17 ND ND ND
Article 20 ND ND ND ND ND ND ND
Article 21 ND ND ND ND ND ND ND
Article 22 ND ND ND ND ND ND ND
Article 23 ND ND ND ND ND ND ND
Article 24 ND ND ND ND ND ND ND
Article 25 ND ND ND ND ND ND ND
Article 26 ND ND ND ND ND ND ND
Article 27 ND ND ND 0.17 ND ND ND
Article 28 ND ND ND ND ND ND ND
Article 29 ND ND ND ND ND ND ND
Article 30 ND ND ND ND ND ND ND
0.00 Open models by OpenAI (openai.com)
2124 points by lackoftactics 208 days ago | 876 comments on HN | Neutral ~lite vlite-1.3
Summary ~lite AI Model Access Neutral
AI model info
EQ 0.50
SO 0.50
TD 0.50
Lite evaluation by llama-3.3-70b-wai · editorial channel only · no per-section breakdown available
Longitudinal · 4 evals
+1 0 −1 HN
Audit Trail 24 entries
2026-02-28 01:34 dlq_replay DLQ message 97548 replayed to EVAL_QUEUE: Open models by OpenAI - -
2026-02-28 01:34 dlq_replay DLQ message 97542 replayed to EVAL_QUEUE: Open models by OpenAI - -
2026-02-28 00:29 eval_success Light evaluated: Neutral (0.00) - -
2026-02-28 00:29 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral)
2026-02-27 21:05 dlq_auto_replay DLQ auto-replay: message 97553 re-enqueued - -
2026-02-27 16:47 eval_success Light evaluated: Neutral (0.00) - -
2026-02-27 16:47 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
2026-02-27 16:33 eval_skip Skipped: no readable text in HTML (likely JS-rendered SPA) - -
2026-02-27 01:47 eval_success Evaluated: Mild positive (0.17) - -
2026-02-27 01:47 eval Evaluated by deepseek-v3.2: +0.17 (Mild positive) 7,801 tokens
2026-02-27 01:45 dlq Dead-lettered after 1 attempts: Open models by OpenAI - -
2026-02-27 01:43 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-27 01:42 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-27 01:41 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-27 01:39 dlq Dead-lettered after 1 attempts: Open models by OpenAI - -
2026-02-27 01:38 eval_failure Evaluation failed: Error: OpenRouter API error 400: {"error":{"message":"Provider returned error","code":400,"metadata":{"raw":"{\"details\":{\"_errors\":[\"response_format is not supported by this model\"]},\"issues\": - -
2026-02-27 01:38 eval_retry OpenRouter error 400 model=llama-3.3-70b - -
2026-02-27 01:37 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-27 01:36 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-27 01:33 dlq Dead-lettered after 1 attempts: Open models by OpenAI - -
2026-02-27 01:32 eval_retry OpenRouter error 400 model=llama-3.3-70b - -
2026-02-27 01:32 eval_failure Evaluation failed: Error: OpenRouter API error 400: {"error":{"message":"Provider returned error","code":400,"metadata":{"raw":"{\"details\":{\"_errors\":[\"response_format is not supported by this model\"]},\"issues\": - -
2026-02-27 01:32 eval_retry OpenRouter error 400 model=llama-3.3-70b - -
2026-02-27 01:28 eval Evaluated by claude-haiku-4-5: 0.00 (Neutral)