Google DeepMind’s Genie

Subject: Science and tech

Section: Awareness in IT, COMPUTER

Context:

Google DeepMind has just introduced Genie, a new model that can generate interactive video games from just a text or image prompt.

More on news:

The research paper ‘Genie: Generative Interactive Environments’ states that Genie is the first generative interactive environment that has been trained in an unsupervised manner from unlabelled internet videos.

What is Genie?

Genie is a foundation world model that is trained on videos sourced from the Internet.
The model can generate an endless variety of playable (action-controllable) worlds from synthetic images, photographs, and even sketches.
When it comes to size, Genie stands at 11B parameters and consists of a spatiotemporal video tokenizer, an autoregressive dynamics model, and a simple and scalable latent action model.
These technical specifications let Genie act in generated environments on a frame-by-frame basis even in the absence of training, labels, or any other domain-specific requirements.

What does Genie do?

Genie is a new kind of generative AI that enables anyone, even children, to dream up and step into generated worlds similar to human-designed simulated environments.
Genie can be prompted to generate a diverse set of interactive and controllable environments although it is trained on video-only data.