During the inaugural Build 2024 conference, Microsoft was full of new features. Among them, the arrival of GPT-4o in the Windows 11 Copilot assistant. And for the purposes of the demonstration, Microsoft used Minecraft. And it was pretty convincing.
Build 2024 is full of new features. We can cite the new Surface Laptop, the Surface Pro, the Copilot+ PCs or even the Recall function of Windows 11. And that was without counting on another piece of news: the arrival of GPT-4o (OpenAI) on Windows 11 via Copilot .
To show what GPT-4o could be used for, Microsoft used a well-known video game: Minecraft. Copilot can then accompany and help the player. GPT-4o sees what is happening on the screen, and can give advice to the player. For example, Copilot can see the contents of the player’s inventory, and assist them in creating items in Minecraft.
Here, the player asks Copilot to help them create a sword. The assistant tells him that he is missing materials to make the blade of the sword and invites the player to go get some wood or stones.
But at that moment, Copilot sees zombies on the screen, and reacts by saying “Oh no, it’s a zombie!” “. Copilot then tells the player how to hide. It’s a bit like playing a game with a friend who knows the game better than you. Except that this is a “simple” artificial intelligence.
Other uses for Copilot
Of course, this won’t be the only use of GPT-4o with Copilot. But we realize that artificial intelligence is very powerful, and that it can do a lot of things. The goal is to allow Copilot to have more natural discussions with the user.
Microsoft specifies that GPT-4o will arrive later on Windows 11, in the coming weeks. We do not yet know if a Copilot+ compatible PC will be required, or if all PCs running Windows 11 will benefit from it.