0.00 Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU (github.com)
394 points by xaskasdf 9 days ago | 101 comments on HN | Neutral ~lite vlite-1.4
Summary ~lite Technology Neutral
Technical discussion on AI model inference
EQ 0.50
SO 0.50
TD 0.50
Lite evaluation by llama-4-scout-wai · editorial channel only · no per-section breakdown available
Longitudinal · 2 evals
+1 0 −1 HN
Audit Trail 22 entries
2026-02-28 07:29 eval_success Light evaluated: Neutral (0.00) - -
2026-02-28 07:29 rater_validation_warn Light validation warnings for model llama-4-scout-wai: 0W 1R - -
2026-02-28 07:29 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
reasoning
ED: Technical discussion on AI model inference
2026-02-28 07:07 eval_success Light evaluated: Neutral (0.00) - -
2026-02-28 07:07 rater_validation_warn Light validation warnings for model llama-3.3-70b-wai: 0W 1R - -
2026-02-28 07:07 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral)
reasoning
Tech tutorial no rights stance
2026-02-26 06:53 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:44 credit_exhausted Credit balance too low, retrying in 257s - -
2026-02-26 06:39 credit_exhausted Credit balance too low, retrying in 304s - -
2026-02-26 06:38 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:36 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:34 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:33 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:30 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:26 credit_exhausted Credit balance too low, retrying in 268s - -
2026-02-26 06:25 credit_exhausted Credit balance too low, retrying in 343s - -
2026-02-26 06:24 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:12 credit_exhausted Credit balance too low, retrying in 317s - -
2026-02-26 06:12 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:11 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -
2026-02-26 06:11 credit_exhausted Credit balance too low, retrying in 331s - -
2026-02-26 06:10 dlq Dead-lettered after 1 attempts: Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - -