"OpenAI's Sora: From Text to Photorealistic Video Games"
OpenAI's latest creation, Sora, is a text-to-video diffusion model that can generate games, including a realistic-looking Minecraft video. The AI can simulate artificial processes and control the player in Minecraft while rendering the world and its dynamics in high fidelity. Despite its impressive capabilities, Sora has limitations in modeling certain physics, but OpenAI sees continued scaling of video models as a promising path towards highly-capable simulators of the physical and digital world.