Nvidia today announced the release of a family of basic AI models called Cosmos that can be used for training HumanoidsIndustrial robots and self-driving cars. While language models learn how to generate text through training from numerous books, articles and social media posts, Cosmos is designed to generate images and 3D models of the physical world.
During a keynote presentation at the annual CES conference in Las Vegas, Nvidia’s CEO said Jensen Huang showed examples of using Cosmos to simulate activities in warehouses. Cosmos was trained on 20 million hours of real footage of “people walking, hands moving and manipulating things,” Jensen said. “It’s not about generating creative content, but rather teaching AI to understand the physical world.”
Researchers and startups hope that such basic models could Enter robots used in factories and private homes more sophisticated functions. For example, Cosmos can produce realistic video footage of boxes falling from shelves in a warehouse, which can be used to train a robot to detect accidents. Users can also refine the models using their own data.
According to Nvidia, a number of companies are already using Cosmos, including humanoid robot startups Agility and Figure AI, as well as self-driving car companies such as Uber, Waabi and Wayve.
Nvidia also announced software to help different types of robots perform new tasks more efficiently. The new feature is part of Nvidia’s existing Isaac robot simulation platform, which allows robot builders to use a small number of examples of a desired task, such as grasping a specific object, and generate large amounts of synthetic training data.
Nvidia hopes that Cosmos and Isaac will appeal to companies that want to build and deploy humanoid robots. Jensen was accompanied on stage at CES by life-size images of 14 different humanoid robots developed by companies such as Tesla, Boston Dynamics, Agility and Figure.
In addition to Cosmos, Nvidia also announced Project Digits, a $3,000 “personal AI supercomputer” which can run a large language model with up to 200 billion parameters without requiring cloud services from AWS or Microsoft. The highly anticipated next-generation RTX Blackwell GPUs and new software tools to support development were also announced AI agents.
Stay Ahead of the Curve!