On learning
- Optimus sorts blocks. A toddler falls down a thousand times
Tesla's new video shows Optimus sorting colored blocks with a neural network trained end to end. Curated robot demos and messy child learning, and which one scales.
2 min reads likes comments - It learned Minecraft by watching YouTube
OpenAI's VPT labeled 70,000 hours of Minecraft videos with the actions players took, using a small model trained on a little labeled data. Passive video became interaction data.
2 min reads likes comments - Curiosity is a prediction error
A Berkeley paper gives agents an internal reward for being surprised by their own predictions. It learns Mario with no score at all, and it answers a question I asked two years ago.
2 min reads likes comments - Breath of the Wild is a physics engine you can think in
The new Zelda replaced scripted puzzles with a world that follows consistent rules. It's the best example I've seen of what a training environment for intelligence could look like.
2 min reads likes comments