01
A photo becomes a toy
Point the camera at a spoon. SAM 3.1 outlines it and Kip picks it up.
Build for Your World · Meta Global AI Developer Hackathon
Helping the next generation grow into robotics through play. Kids design and build toys, robots and upgrades, then play with them across digital, physical and AR worlds.
FIG 02In the demo
01
Point the camera at a spoon. SAM 3.1 outlines it and Kip picks it up.
02
Describe a world and custom Glimmer writes the level, while Muse Image paints its sky and backdrop. Then it is ready to play.
03
Meta's open-weight model, custom trained by us and hosted on Modal. 54% faster than untuned, 98.8% of parts printable, 68 of 70 red-team prompts passed.
FIG 03Use of Meta tooling
Muse Wonder/Spark, Muse Image, Muse Transcribe and SAM 3.1 run through Meta Model API. Muse Code is the coding agent that wrote the app. Muse Glimmer is an open-weight model we custom train and host on Modal, one of the inference partners supporting the hackathon.
Not Meta: Gemini text-to-speech says the names, and Mureka sings the songs.