Minecraft is an incredibly popular and creative game, with over 126 million monthly active users and 200 million copies sold. But what if you could make it even better using artificial intelligence? That’s what Microsoft is exploring with OpenAI technology. In a recent demo, Microsoft showed how they can leverage OpenAI Codex, an advanced system that can generate code from natural language, to develop new features and experiences within Minecraft.
OpenAI Codex is a powerful system based on GPT-3, recently becoming famous through its adaptation for ChatGPT and the new Microsoft Bing. GPT-3 can understand natural language and generate code for different programming languages and frameworks. It’s a deep learning system that can turn a simple description of what you want to do into working code that you can edit or run. This allows you to create websites, games, or apps by using plain English.
The well-known leaker WalkigCat has shared the following demo of Minecraft with OpenAI Codex on Twitter.
mayyyyybe this one? https://t.co/Sh9gbzjmk6 pic.twitter.com/avlSR5afqz
— WalkingCat (@_h0x0d_) February 17, 2023
How OpenAI Codex Integrates with Minecraft
Microsoft has integrated OpenAI Codex with Minecraft using a custom extension called Code Builder for Minecraft. Code Builder allows you to create and modify objects in Minecraft using natural language commands. For instance, you can ask Code Builder to spawn animals, build a house, or change the weather using simple sentences. Code Builder then generates Python code that will execute your commands within Minecraft. You can also use Visual Studio Code to see and edit the code generated by Code Builder, which can help you learn how natural language translates into programming logic.
Combining OpenAI Codex and Minecraft, you can create anything you can imagine by using natural language commands. You might use commands for creating a rollercoaster that goes around a mountain, spawning zombies that follow you, making fireworks spell out “Hello World,” building a castle with a moat and a drawbridge or changing weather conditions and the time of day. Or you could make flowers grow wherever you walk.
Why is this important for gaming?
OpenAI Codex and Minecraft could revolutionize gaming by making it more accessible, creative, and educational. With OpenAI Codex, you can create your own games without having to learn how to code. You can describe what you want to do, and OpenAI Codex will do the rest. This opens up new possibilities for game design and storytelling, allowing you to create your own worlds, characters, and scenarios using natural language. You can even share your creations with other players online.
Moreover, OpenAI Codex could help gamers learn how to code while having fun. By seeing how natural language commands translate into code, gamers can develop their coding skills and logical thinking. OpenAI Codex could also inspire new genres of games that combine natural language interaction with gameplay mechanics. For example, you could have games where you talk to NPCs (non-player characters) using natural language and influence their behavior or outcomes.
How to Test OpenAI Codex and Minecraft
Up to now OpenAI Codex is not yet publicly available, as it is still in beta testing mode and only accessible by invitation. However, you can sign up for the waitlist on OpenAI’s website. You will also need Minecraft: Education Edition, which is free for educators and students who have an Office 365 Education account. If you have these things, you can follow the steps mentioned below and start creating things with OpenAI:
- Install the Code Builder mod for Minecraft: Education Edition
- Launch Minecraft: Education Edition
- Press C key (or click on Agent icon) to open Code Builder
- Select “Open AI” as your coding platform
- Start typing your natural language commands
Tip of the day: Tired of Windows´s default notification and other system sounds? In our tutorial we show you how to change windows sounds or turn off system sounds entirely.