Luma AI releases Ray2 video generator with better physics

giraffe-surfing.png

Subscribe to our daily and weekly newsletters to receive the latest updates and exclusive content on industry-leading AI reporting. Learn more


Luma AI caused a stir with its introduction Dream machine Generative AI video creation platform last summer.

Although it was only seven months ago, the AI video space has evolved rapidly with the release of many new AI video creation models from competing startups in the US and China, including runway, Sound, Pika 2.0, Sora from OpenAI, On Google I see 2, Hailuo by MiniMax and open source alternatives like Hotshot And Genmo’s Mochi 1to name just a few. Even Luma itself recently updated it Dream Machine Platform to integrate new still image generation and brainstorming boards and also launch an iOS app.

But the updates continue: Today the San Francisco-based startup published Ray2, its latest generation video AI model, available now via the Dream Machine website and mobile apps to paying subscribers (initially).

The model offers “fast, natural coherent motion and physics,” according to co-founder and CEO Says Amit Jain on his X accountand was trained with ten times more processing power than the original Luma AI video model Ray1.

“This skyrockets the success rate of usable production-ready generations and makes video storytelling accessible to many more people,” he added.

Luma’s Dream Machine web platform offers a free tier with 720 pixel generations capped at a variable number each month: Paid plans start at $6.99 per month: From “Lite,” which offers 1080p images, to Plus ($20.99/month) up to Unlimited ($66.49/month) and Enterprise ($1,672.92/year).

A leap forward in the video generation

Currently, Ray2 is limited to text-to-video, allowing users to enter descriptions that are converted into 5 or 10 second video clips.

The model can generate new videos in seconds, although it can currently take several minutes due to high demand from new users.

Examples shared by Luma and early testers in its Creators program show the model’s versatility, including a man running through an Antarctic snowstorm surrounded by explosions and a ballerina performing on an ice floe in the Arctic.

What’s impressive is that all the movements in the sample videos appear lifelike and fluid – and the subjects often move much faster and more naturally than videos from competing AI generators, which often appear to be generated in slow motion.

The model can even create realistic versions of surreal ideas, such as: Giraffe surfingas an X user @JeffSynthesized demonstrated. “Ray 2 is the real deal,” he said wrote on X.

Other AI creators who have tried the new model seem to largely agree Jerrod Lew posts on X: “Improved cinematography, lighting and realism have arrived and it’s great.”

“…it’s so good!” AI video artist Heather Cooper intervened.

My own testing was mixed, with some more complex prompts producing unnatural and erroneous results. But when there were clips that were more similar to what I had in mind in my prompts – like Fencers cross their swords aboard a space station orbiting Jupiter – It was undeniably impressive.

Jain said Luma will also add image-to-video, video-to-video and editing capabilities to Ray2 in the future, further expanding the tool’s creative capabilities.

To celebrate the launch of Ray2, Luma Labs is hosting the Ray2 Awards, offering developers the chance to win prizes worth up to $7,000. This includes:

  1. An award on a grand scale: The creator whose Ray2 content receives the most views on a single platform in the first week of publication will win $5,000. The submission deadline is January 22, 2025.
  2. A raffle for $3,000: Developers can participate by sharing Ray2 content on social media and engaging with Luma AI’s introductory video. The deadline for participation is also January 22nd.

The winners of both awards will be announced on January 27th. Submissions can be uploaded using the forms provided by Luma Labs. Creators are encouraged to use the hashtags #Ray2 and #DreamMachine when sharing their work.

Additionally, Luma Labs has launched an affiliate program that allows participants to earn commissions by promoting its tools.



Source link
Spread the love

Leave a Reply

Your email address will not be published. Required fields are marked *