Image: u/chartojs on Reddit
Street-view building photos turned into descriptions for a 3D map
A developer segmented street panoramas, matched them to OpenStreetMap and had Claude Haiku describe each building, with Fable writing the instructions and shaders.
Credits
Earliest dated source:
The full story
A developer is building a pipeline to turn open geodata into an explorable 3D map. Street-view panoramas are segmented with SAM 3.1, matched to OpenStreetMap buildings and rectified with basic computer vision, then each building photo is passed to Claude Haiku to turn into a structured description. The aim is a recognisable building, not an exact copy of the facade.
Claude Fable first studied example panoramas and wrote the instructions for Haiku, together with procedural shaders to render the buildings. Most of the street furniture, vehicles and plants are generated by code written by another model, Astra.
How it was done
Tools
Themes
Loading themes…
Sources
From a short post by the maker, so the details are as they tell them.
- Reddit: Using Haiku to turn building photos into structured descriptions for my 3D mapReddit poster: chartojsPosted
The developer's post in r/ClaudeAI describing the pipeline.