Image: github.com · Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath. - hardrave/NIGHTRUN
NightRun: a local LLM that boots from a USB stick
A single Rust UEFI app that boots from USB or an SD card and runs small language models on the CPU, with most of the code written by Claude Code.
Credits
- Reddit poster centoslinux Source ↗
- Repository account hardrave Source ↗
Earliest dated source:
The full story
NightRun is a single Rust UEFI app with no Linux and no kernel. You flash it to a USB stick, boot, and chat with Llama 3.2 1B, Qwen3 4B or Granite 4.1 on the CPU. It also runs on a Raspberry Pi 5 from an SD card.
It reads standard GGUF files and decodes at roughly llama.cpp speed, with output checked token for token against it. Most of the code was written with Claude Code, including the SIMD kernels and firmware parts, kept honest by heavy parity testing and fuzzing. The poster said it got further than expected.
How it was done
Tools
Themes
Loading themes…
Sources
From a short post by the maker, so the details are as they tell them.
- Reddit: I built NightRun: boot a local LLM straight from a USB stick. No OS, just a UEFI app (x86-64 + RaspbReddit poster: centoslinuxPosted
The maker's post on r/ClaudeAI.
If it disappears: archived copy of Reddit: I built NightRun: boot a local LLM straight from a USB stick. No OS, just a UEFI app (x86-64 + Raspb (opens in a new tab)
- The code: github.comRepository account: hardrave
The project on GitHub.