Nvidia integrates generative AI for next-gen humanoid robot technologies

Nvidia integrates generative AI for next-gen humanoid robot technologies

Nvidia integrates generative AI for next-gen humanoid robot technologies

Nvidia has unveiled a general-purpose foundation model for humanoid robots, Project GR00T, to advance the field’s embodied AI and robotics research efforts. The announcements were made at the firm’s annual developers conference in San Francisco on March 18.



GR00T (Generalist Robot 00 Technology)-enabled robots will be built to mimic human movements and comprehend natural language. According to Nvidia, they will quickly pick up coordination, dexterity, and other skills, enabling them to navigate, adapt, and engage with the real world.

In conjunction with the initiative, the company also unveiled major enhancements to the Nvidia IsaacTM robotics platform, including generative AI foundation models, tools for simulation, and AI workflow infrastructure, as well as a new computer, Jetson Thor, for humanoid robots based on the Nvidia Thor system-on-a-chip (SoC).

“Building foundation models for general humanoid robots is one of the most exciting problems to solve in AI today. The enabling technologies are coming together for leading roboticists around the world to take giant leaps towards artificial general robotics,” said Jensen Huang, founder and CEO of Nvidia, in a statement.

Customized for future humanoid robots

As a foundation of the project, Nvidia has developed a new computing platform called Jetson Thor, which can carry out complicated tasks and engage in safe, natural interactions with humans and other machines. Its modular architecture is maximized for power, size, and performance.

To run multimodal generative AI models like GR00T, the SoC has a next-generation GPU based on the Nvidia Blackwell architecture with an engine that delivers 800 teraflops of 8-bit floating point AI capability.

Nvidia claims it greatly streamlines design and integration efforts with its integrated functional safety processor, 100GB of Ethernet bandwidth, and high-performance CPU cluster.

For top humanoid robot firms, including 1X Technologies, Agility Robotics, Apptronik, Boston Dynamics, Figure AI, Fourier Intelligence, Sanctuary AI, Unitree Robotics, and XPENG Robotics, among others, Nvidia is developing a comprehensive AI platform.

Advancing the Isaac platform

Using the Isaac tools, GR00T may generate new foundation models for any robot embodiment in any environment. These resources include the computational orchestration service OSMO and the reinforcement learning tool Isaac Lab.

Large volumes of synthetic and real data are needed to build embodied AI models. Built on top of Isaac Sim, which is an extensible robotics simulation platform, the new Isaac Lab is a lightweight, performance-optimized, GPU-accelerated program designed to execute thousands of concurrent simulations for robot learning.

According to Nvidia, OSMO coordinates the data collection, model training, and software/hardware-in-the-loop workflows across distributed settings to scale robot development workloads across heterogeneous computation.

Additionally, Nvidia unveiled Isaac Manipulator and Isaac Perceptor, a set of reference hardware, libraries, and pre-trained robotics models.

With a large library of foundation models and GPU-accelerated libraries, Isaac Manipulator provides robotic arms with cutting-edge dexterity and customizable AI capabilities. Path planning can be accelerated by up to 80x, and zero-shot perception boosts productivity and throughput, allowing developers to automate more novel robotic jobs.

Yaskawa, Universal Robots, a Teradyne business, PickNik Robotics, Solomon, READY Robotics, and Franka Robotics are a few of the early ecosystem partners.

The Isaac Perceptor is a multi-camera 3D surround-vision device increasingly used in autonomous mobile robots in fulfillment and manufacturing processes to lower costs and increase worker safety while enhancing efficiency. According to Nvidia, ArcBest, BYD, and KION Group are among the early adopters who want unprecedented degrees of autonomy in material handling operations and other areas.

Nvidia plans to make the new Isaac platform features accessible in the upcoming quarter.

Source: Interesting Engineering

A wearable sticker turns slight movements into communication

Nvidia integrates generative AI for next-gen humanoid robot technologies

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Çok Okunan Yazılar