Genie Google GoogleGenie Genie world model released, understands physics and understands space

Genie is a generative interactive environment model developed by Google AI that can generate various playable worlds from synthetic images, photos, or even sketches. The model is trained on internet videos and can learn how to control and interact with objects in an environment. Currently, like Sora, it is not publicly accessible; only some preliminary examples can be seen, and it is even earlier than Sora.



Most of the additional demonstrations are game-related videos, and the description also focuses more on games.

How Genie Works

Genie is trained using a technique called “unsupervised learning.” This means it does not require any manually labeled data; instead, it learns how to control objects in an environment from internet videos.



Genie’s training dataset contains a large number of 2D platform game and robotics videos. By analyzing these videos, Genie can learn which objects are controllable and how to control them.

Genie’s Features

Genie can generate various types of playable worlds, including:

• 2D platform game worlds
  
• 3D mazes
  
• Virtual cities
  
• Any other world you can imagine
  

Genie can also generate customized worlds based on user input. For example, you can input a photo or a sketch, and Genie will generate a playable world based on your input.

Genie’s Applications

Genie can be used for various applications, including:

• Game development
  
• Education
  
• Entertainment
  
• Virtual reality
  
• The future of Genie
  

Genie is a technology still under development. Google AI is researching how to improve Genie’s performance and features and apply it to a broader range of fields.

Below are some examples of playable worlds generated by Genie:

2D platform game world: https://store.steampowered.com/app/2342210/GENIE/
3D maze: https://www.youtube.com/watch?v=QzTISx91HOI
Virtual city:https://www.g5.com/games/virtual-city-playground

Moderator Summary

Genie is a generative interactive environment model with enormous potential. It can generate various playable worlds and has broad application prospects.

Other Resources

Genie official website: https://sites.google.com/view/genie-2024/
Genie paper: https://arxiv.org/abs/2302.07915