On openai
- "World simulator" is doing a lot of work
OpenAI's Sora generates minute-long videos that look astonishing. Its technical report calls it a world simulator. The samples show both why that's tempting and why it isn't true yet.
2 min reads likes comments - The model rewrites your prompt
DALL·E 3 in ChatGPT doesn't use what you typed. It has a language model write a long, detailed prompt for you. Creative tools are turning into agents that interpret intent.
2 min reads likes comments - GPT-4 reads the picture
OpenAI's GPT-4 scores near the top of the bar exam and can explain a joke in a photo. Describing a scene is useful, but I'm still unsure how far that gets it toward understanding the physical world.
2 min reads likes comments - ChatGPT is a product, not a model
A million people signed up in five days. The underlying model isn't new. What's new is the interface and the training to follow instructions, and that changes every software team.
2 min reads likes comments - It learned Minecraft by watching YouTube
OpenAI's VPT labeled 70,000 hours of Minecraft videos with the actions players took, using a small model trained on a little labeled data. Passive video became interaction data.
2 min reads likes comments - Copilot finished my function
GitHub's Copilot preview suggests whole functions inside the editor. Two days of using it on side projects, and what changes when the IDE becomes a conversation.
2 min reads likes comments - GPT-3 wrote a React component from a sentence
The demos flooding Twitter this week come from the same next-word objective as GPT-2, scaled a hundred times. Few-shot learning appeared on its own. Coding changes first.
2 min reads likes comments - "Too dangerous to release"
OpenAI trained a much bigger language model and is holding back the full version. The unicorn story is impressive. What's actually dangerous is cheap, plausible text at scale.
2 min reads likes comments