Skip to main content

Meta's Make-A-Video AI is Dall-E for video clips

Make-A-Video results for the prompts

Everyone's favorite text-to-image generator Dall-E has a new competitor from Meta: A video-to-text generator called Make-A-Video. The tool generates short, soundless video snippets based on the same type of text prompts you feed to Dall-E.

But Dall-E is child's play compared to Make-A-Video, at least according to Mark Zuckerberg. The Meta CEO noted in a Facebook post, “It’s much harder to generate video than photos because beyond correctly generating each pixel, the system also has to predict how they’ll change over time.” Make-A-Video doesn't have that problem because it "understand[s] motion in the physical world and apply it to traditional text-to-image generation."

Another Make-A-Video feature is the ability to add motion to static images. Make-A-Video's transformation of a static image of a woman doing a yoga pose, for example, has her leaning deeper into her stretch as a light flare shimmers on the lens. Other examples of the tool are available on its website, which notes that you can also show Make-A-Video an existing video and be presented with several new interpretations.

We'll take all these examples with a grain of salt, since Make-A-Video isn't yet available to the public, but it is a wild new potential development for artificial intelligence.

Meta has published a paper about the tool which you can read at this link. It details how it was trained, along with the technical limitations of the tool, which include its inability to generate clips longer than five seconds and deliver resolutions higher than 768 by 768 pixels at 16 frames per second. The Verge notes that the only text-to-video model available to the public, called CogVideo, is burdened by the same limitations.



from Mashable https://ift.tt/3sPN0Mz
via IFTTT

Comments

Popular posts from this blog

Instagram accidentally reinstated Pornhub’s banned account

After years of on-and-off temporary suspensions, Instagram permanently banned Pornhub’s account in September. Then, for a short period of time this weekend, the account was reinstated. By Tuesday, it was permanently banned again. “This was done in error,” an Instagram spokesperson told TechCrunch. “As we’ve said previously, we permanently disabled this Instagram account for repeatedly violating our policies.” Instagram’s content guidelines prohibit  nudity and sexual solicitation . A Pornhub spokesperson told TechCrunch, though, that they believe the adult streaming platform’s account did not violate any guidelines. Instagram has not commented on the exact reasoning for the ban, or which policies the account violated. It’s worrying from a moderation perspective if a permanently banned Instagram account can accidentally get switched back on. Pornhub told TechCrunch that its account even received a notice from Instagram, stating that its ban had been a mistake (that message itse...

The Nintendo Switch has been the US’s bestselling console for 23 straight months

Photo by James Bareham / The Verge It’s been a good two years for the Nintendo Switch. According to Nintendo, the gaming tablet has been the bestselling console in the US for 23 straight months. And according to data from the NPD Group, it just had its best October ever, moving 735,926 units of both the Switch and Switch Lite in the US. The company says that represents a 136 percent increase compared to last year. To date, the Switch has sold 22.5 million units in the US, and last week Nintendo revealed that more than 68 million units have been sold globally . “We’re excited about our momentum,” says Nick Chavez, Nintendo of America’s SVP of sales and marketing. Chavez puts the company’s big October down to two main factors. One is a better supply of stock; this year in particular, it’s often been hard to find a Switch on store shelves. This has only been exacerbated by increased demand due to a combination of the pandemic and the breakout success of Animal Crossing: New Horizons . ...

Richard Branson is renting out his private estate on his second Caribbean island for the first time at $25,000 a night. Take a look inside the 3-villa compound.

The Branson Estate. Virgin Limited Edition Richard Branson's private Caribbean island, Moskito Island, is opening to the public for the first time. Guests can rent Branson's entire personal estate - which can house 22 guests in three villas - starting at $25,000 per night. It's just 2.5 miles from his other private island, Necker Island. See more stories on Insider's business page . Richard Branson, billionaire business magnate and Virgin Group founder, is opening up his private estate on his second Caribbean island to the public for the first time. Richard Branson in Australia in November 2019. Getty Images/Don Arnold/WireImage Branson, who's worth $4.9 billion and whose businesses ventures span airlines, luxury travel, space travel, telecom, and more, bought Moskito Island for a reported $10 million in 2007. Moskito Island is not to be confused with Branson's  other private Caribbean island, Necker Island, which Branson bought in 1978 and wh...