On self-supervised-learning
- Predicting in representation space
Meta's I-JEPA is the first concrete result from LeCun's world model agenda. It learns image representations by predicting hidden regions in latent space, with no augmentations and no pixel reconstruction.
2 min reads likes comments - LeCun's path, read carefully
Yann LeCun's position paper argues that intelligence needs world models that predict in representation space, not pixels. Where I agree, and where I'd push back: bodies and hands.
2 min reads likes comments