Luma AI Launches AI-Powered Textual content-to-Video Technology Platform Dream Machine

Luma AI launched its synthetic intelligence (AI) text-to-video technology mannequin, Dream Machine, globally on Wednesday. The platform can generate as much as five-second-long movies from easy or descriptive textual content prompts. The AI mannequin can generate movies in numerous kinds resembling cinematic, animation, life like, and extra. The AI agency claims that Dream Machine was skilled completely on movies, and is able to producing “bodily correct, constant and eventful pictures.” The platform is at the moment free to entry and use, however it’s prone to have a each day technology restrict.

Luma AI debuts Dream Machine

In accordance with the web site, the Dream Machine AI mannequin is constructed on a transformer mannequin and was skilled straight on movies. Normally, massive language fashions (LLMs) are skilled on textual content and pictures after which are moved to movies, as they require a deeper spatial and movement understanding. “Dream Machine is our first step in direction of constructing a common creativeness engine,” the corporate added.

Dream Machine joins video technology platforms resembling Runway AI and Pika 1.0 that are additionally accessible within the public area and provide video technology between three to 5 seconds. Devices 360 tried the platform and located that the immediate adherence of the platform is sub-par. It struggles with a number of characters or when the immediate is simply too advanced. Nevertheless, in comparison with the opposite two, it’s able to producing higher-quality cinematic movies.

The AI platform takes 120 seconds to generate a video which the corporate claims could have 120 completely different frames. Dream Machine can be mentioned to know how individuals, animals, and objects work together with the bodily world and create movies with correct physics and character consistency.

Nevertheless, Luma AI additionally highlighted a number of limitations within the present mode resembling motion, textual content, morphing, and the well-known Janus downside, the place as an alternative of exhibiting a constant 3D output, the AI mannequin reveals a number of canonical views of an object in several instructions.

Luma AI’s Dream Machine creates a video about Stormtroopers
Picture Credit score: Luma AI/Dream Machine

 

Luma AI has not shared any technical particulars concerning the AI mannequin, so details about parameter dimension, benchmarks, structure, and coaching strategies is just not identified. The corporate additionally didn’t share any particulars concerning the procurement of the coaching knowledge. Notably, Devices 360 was in a position to generate a number of movies with copyrighted characters in them.

To check out the platform, fans can go to the web site and click on on the ‘Strive Now’ button. Customers could have to join the platform earlier than they will generate movies.

---