Image: reddit.com · Video still: Created a custom piano fingering model / sandbox with Opus 5.5
A piano fingering model trained on 10,000 pianist videos
Claude read fingering research papers and built a multi-rule piano fingering model, which the poster then trained on about 10,000 pianist videos.
Credits
- Repository account carlosrmz009 Source ↗
The full story
The poster wanted to know how to finger a particular piece, found few fingered scores, and the one similar program, ConcertPianist, had been discontinued. Claude read several fingering research papers and built a multi-rule custom model that combines existing annotations and raw data with real-time simulated biomechanics.
The poster then spent about three weeks training it on roughly 10,000 pianist videos, using MediaPipe and Transkun for note transcription. They are happy with the result, but say precision and fluidness of movement can still improve.
How it was done
Tools
Themes
Loading themes…
Sources
From a short post by the maker, so the details are as they tell them.
- Reddit: Created a custom piano fingering model / sandbox with Opus 5.5
The maker's post on r/ClaudeAI.
The subreddit's moderators removed it, but the original is still readable (it can take a few seconds to load): archived copy of Reddit: Created a custom piano fingering model / sandbox with Opus 5.5 (opens in a new tab)
- The code: github.comRepository account: carlosrmz009
The project on GitHub.