January 29, 2024
1 min read

Google’s latest AI Lumiere creates videos from images

The design facilitates a wide range of content creation tasks and video editing applications, including image-to-video, video inpainting, and stylised generation…reports Asian Lite News

Google has introduced a new video generation AI model called Lumiere that uses a new diffusion model called Space-Time-U-Net, or STUNet. Lumiere creates 5-second videos in one process instead of putting smaller still frames together.

This technology figures out where things are in a video (space) and how they simultaneously move and change (time).

“We introduce Lumiere — a text-to-video diffusion model designed for synthesising videos that portray realistic, diverse and coherent motion — a pivotal challenge in video synthesis,” said Google researchers in a paper.

“We introduce a Space-Time U-Net architecture that generates the entire temporal duration of the video at once, through a single pass in the model,” they wrote.

The design facilitates a wide range of content creation tasks and video editing applications, including image-to-video, video inpainting, and stylised generation.

Lumiere can perform text-to-video generation, convert still images into videos, generate videos in specific styles using a reference image, apply consistent video editing using text-based prompts and create cinemagraphs by animating specific regions of an image.

The Google researchers said that the AI model outputs five-second-long 1024×1024 pixel videos, which they describe as “low-resolution.”

Lumiere also generates 80 frames compared to 25 frames from Stable Video Diffusion.

“There is a risk of misuse for creating fake or harmful content with our technology, and we believe that it is crucial to develop and apply tools for detecting biases and malicious use cases to ensure a safe and fair use,” said the paper authors.

ALSO READ-Google Cloud AI to power new Samsung phones

Previous Story

Protests Surge in Gilgit-Baltistan Over Inflation

Next Story

Jaishankar congratulates Bhutan’s new Foreign Minister

Latest from Tech LITE

UAE reshapes AI council

The newly reconstituted Council will be chaired by His Highness Sheikh Tahnoon bin Zayed Al Nahyan, with His Highness Sheikh Khaled bin Mohamed bin Zayed Al Nahyan serving as Vice-Chairman….reports Asian Lite

EDGE unleashes cyber shield

The flagship platform, PROTECTION360, expands EDGE’s capabilities in continuous attack surface management….reports Asian Lite News EDGE, the UAE-based global advanced technology and defence conglomerate, has unveiled a suite of four cutting-edge cyber

EY, Microsoft Boost AI Skills

The AI Skills Passport is a fully online programme with approximately 10 hours of comprehensive content, available in both English and Hindi to maximize accessibility across India’s diverse linguistic landscape In a landmark

UPI Powers Digital Revolution

New innovations such as LiteX (offline payments), tap-and-pay, credit card integration, UPI Autopay, and UPI for IPO subscriptions are pushing the platform from a payment tool to a full-fledged embedded finance ecosystem Unified

India’s EV sales need turbo boost

India must accelerate EV adoption by 22% in five years, or risk missing its 2030 green mobility target, warns NITI Aayog….reports Asian Lite News India will need to accelerate electric vehicle (EV)
Go toTop

Don't Miss

UK govt to work with AI firms

Sunak meets tech leaders of OpenAI’s Sam Altman, Google DeepMind’s

54% of Indian firms implemented AI

About 38 per cent of Indian companies revealed that they