GPT-4 in Minecraft reveals AI's untapped potential.
Researchers at Nvidia have created a Minecraft bot called Voyager that uses GPT-4 to solve problems inside the game. The language model generates objectives that help the agent explore the game, and code that improves the bot’s skill at the game over time. Voyager obtains more than three times as many items, explores more than twice as far, and builds tools 15 times more quickly than other AI agents. The approach may be improved in the future with the addition of a way for the system to incorporate visual information from the game. The technology could be adapted for a software assistant that works out how to automate tasks via the operating system on a PC or phone.
