Image: u/wollymonjac on Reddit · The DOS PC that runs the floppy-sized language model
A language model for DOS that fits on a floppy disk
Claude Fable 5.2 wrote and trained a 367K-parameter transformer with data from Opus 5.5; with 8-bit weights the program and model come to about 435 KB and run on an Intel Pentium under DOS.
Credits
- Reddit poster wollymonjac Source ↗
- Repository account WollyMonjac Source ↗
- Reddit poster tpimh Source ↗
Earliest dated source:
The full story
TINY 2.1 is a small question-answering transformer that runs under plain DOS on a Pentium or 486DX. Claude Fable 5.2 wrote the model in Turbo C 2.0 and trained it, while Opus 5.5 generated the training data: about 3,500 facts plus small talk and maths, each asked and answered in different ways.
It has 367,000 parameters in four layers and reads and writes one letter at a time. With 8-bit weights and one scale per row, the program and weights come to about 435 KB, small enough for DOS memory and a floppy disk. XDA Developers and MakeUseOf covered it, and the code is on GitHub.
How it was done
Tools
Themes
Loading themes…
Sources
From a short post by the maker, so the details are as they tell them.
- Reddit: Claude wrote and trained a language model for DOS that fits on a floppy diskReddit poster: wollymonjacPosted
The maker's post in r/ClaudeAI.
- The code: github.comRepository account: WollyMonjac
The project's code.
- Blogs: Someone used Claude to build an AI chatbot for MS-DOS, and it fits on a floppyPublished
Coverage on xda-developers.com.
- Reddit: Claude wrote and trained a language model for DOS that fits on a floppy diskReddit poster: tpimhPosted
The maker's post in r/DOS.
- Blogs: Someone used Claude to build a chatbot that fits on a floppy diskPublished
The project on makeuseof.com.