Align your Latents

A research project on high-resolution video synthesis with latent diffusion models. It pre-trains an image latent diffusion model, then adds a temporal dimension and fine-tunes on encoded image sequences to produce video. Applications include simulation of in-the-wild driving data and text-to-video creative content creation. Updaters are temporally aligned into video super-resolution models.

Website Directory import
0 shouts Added Sep 23, 2026 research.nvidia.com
research.nvidia.com/labs/toronto-ai/VideoLDM/
Align your Latents website preview

Features

  • temporally align diffusion model upsamplers, turning them into temporally consistent video super resolution models Source: research.nvidia.com

Uses

  • Simulation of in-the-wild driving data and creative content creation with text-to-video modeling Source: research.nvidia.com

Links

Tags