Skip to main content

Google’s Lumiere brings AI video closer to real than unreal

Single frame from a video showing multiple AI-generated clips
Still frame from a teaser reel of Lumiere clips | Image: Google

Google’s new video generation AI model Lumiere uses a new diffusion model called Space-Time-U-Net, or STUNet, that figures out where things are in a video (space) and how they simultaneously move and change (time). Ars Technica reports this method lets Lumiere create the video in one process instead of putting smaller still frames together.

Lumiere starts with creating a base frame from the prompt. Then, it uses the STUNet framework to begin approximating where objects within that frame will move to create more frames that flow into each other, creating the appearance of seamless motion. Lumiere also generates 80 frames compared to 25 frames from Stable Video Diffusion.

Admittedly, I am more of a text reporter than a video person, but...

Continue reading…



from The Verge - All Posts https://ift.tt/X4EUZWB

Comments

Popular posts from this blog

Pandora Stories lets artists add commentary to their own playlists

Pandora launched Stories today, a tool that lets artists and creators add voice commentary to their own playlists. The Stories feature merges podcasts with music playlists, and is meant for artists to add context to an album, or for podcasters to experiment with new storytelling formats. The feature is part of Pandora AMP, the streaming service’s free Artist Marketing Platform that helps creators promote their work. To kick off the launch, Pandora’s prepared some Stories by artists like John Legend and Daddy Yankee, who tell listeners their personal stories interspersed between their own songs. There’s also a Stories playlist called Love Songs That Aren’t Really Love Songs , which includes commentary on individual songs like a podcast... Continue reading… from The Verge - All Posts https://ift.tt/2Xz1oNc

Android Addition Opens FIDO Password Killer to Billions

The FIDO Alliance hammered another nail into the passwords coffin with the announcement that devices running Android 7.0 or higher will be compatible with FIDO2. Certification of Android 7.0+ means devices running those versions of Google's mobile operating system will support FIDO2 out of the box or through a software update. FIDO2, introduced last year, provides a FIDO Web authentication standard that combines the World Wide Web Consortium's Web Authentication specification with FIDO's Client-to-Authenticator protocol. from TechNewsWorld https://ift.tt/2GQVG4f

Nintendo Switch Online reaches more than 100 retro games

Illustration by Alex Castro / The Verge Nintendo has hit a milestone with the ever-growing library of retro games included in its Nintendo Switch Online service. The next batch will take the number of available games past 100, with five new titles resulting in a total of 104. In keeping with recent form , the latest additions are, well, not necessarily blockbuster releases. Here’s the list: Caveman Ninja: Joe & Mac , a prehistoric action game released in arcades and ported to the SNES by Data East in 1991 Magical Drop 2 , a 1996 Data East puzzle game for the SNES that was originally on the Neo Geo but never previously got a Western release Super Baseball Simulator 1.000 , a SNES baseball game released by Culture Brain in 1991 Spanky’s Quest , a 1991 SNES action game by Natsume... Continue reading… from The Verge - All Posts https://ift.tt/3eXBE7D