Search results

A research project on high-resolution video synthesis with latent diffusion models. It pre-trains an image latent diffusion model, then adds a temporal dimension and fine-tunes on encoded image sequences to produce video. Applications include simulation of in-the-wild driving data and text-to-video creative content creation. Updaters are temporally aligned into video super-resolution models.

Phenaki – Google Research

sites.research.google

Phenaki is a Google Research model that synthesizes realistic videos from textual prompt sequences. It uses an encoder-decoder tokenizer for variable-length videos and a transformer that translates text embeddings to video tokens, trained jointly on image-text and video-text data.