NVIDIA announced Project GR00T, a general-purpose foundation model for humanoid robots, designed to further its work driving breakthroughs in robotics and embodied AI.

The following report is a press release from Nvidia, published March 18th:

As part of the initiative, the company also unveiled a new computer, Jetson Thor, for humanoid robots based on the NVIDIA Thor system-on-a-chip (SoC), as well as significant upgrades to the NVIDIA Isaac™ robotics platform, including generative AI foundation models and tools for simulation and AI workflow infrastructure.

Courtesy: Nvidia

“Building foundation models for general humanoid robots is one of the most exciting problems to solve in AI today,” said Jensen Huang, founder and CEO of NVIDIA. “The enabling technologies are coming together for leading roboticists around the world to take giant leaps towards artificial general robotics.”

Robots powered by GR00T, which stands for Generalist Robot 00 Technology, will be designed to understand natural language and emulate movements by observing human actions — quickly learning coordination, dexterity and other skills in order to navigate, adapt and interact with the real world. In his GTC keynote, Huang demonstrated several such robots completing a variety of tasks.

Built for Humanoid Robots
Jetson Thor was created as a new computing platform capable of performing complex tasks and interacting safely and naturally with people and machines. It has a modular architecture optimized for performance, power and size.

The SoC includes a next-generation GPU based on the NVIDIA Blackwell architecture with a transformer engine delivering 800 teraflops of 8-bit floating point AI performance to run multimodal generative AI models like GR00T. With an integrated functional safety processor, a high-performance CPU cluster and 100GB of ethernet bandwidth, it significantly simplifies design and integration efforts.

NVIDIA is building a comprehensive AI platform for leading humanoid robot companies such as 1X Technologies, Agility Robotics, Apptronik, Boston Dynamics, Figure AI, Fourier Intelligence, Sanctuary AI, Unitree Robotics and XPENG Robotics, among others.

We are at an inflection point in history, with human-centric robots like Digit poised to change labor forever. Modern AI will accelerate development, paving the way for robots like Digit to help people in all aspects of daily life. We’re excited to partner with NVIDIA to invest in the computing, simulation tools, machine learning environments and other necessary infrastructure to enable the dream of robots being a part of daily life.

said Jonathan Hurst, cofounder and chief robot officer at Agility Robotics.

Embodied AI will not only help address some of humanity’s biggest challenges, but also create innovations which are currently beyond our reach or imagination. Technology this important shouldn’t be built in silos, which is why we prioritize long-term partners like NVIDIA.

said Geordie Rose, cofounder and CEO of Sanctuary AI.

Major Updates to Isaac Platform
The Isaac tools that GR00T utilizes are capable of creating new foundation models for any robot embodiment in any environment. Among these tools are Isaac Lab for reinforcement learning, and OSMO, a compute orchestration service.

Embodied AI models require massive amounts of real and synthetic data. The new Isaac Lab is a GPU-accelerated, lightweight, performance-optimized application built on Isaac Sim specifically for running thousands of parallel simulations for robot learning.

To scale robot development workloads across heterogeneous compute, OSMO coordinates the data generation, model training and software/hardware-in-the-loop workflows across distributed environments.

NVIDIA also announced Isaac Manipulator and Isaac Perceptor — a collection of robotics pretrained models, libraries and reference hardware.

Isaac Manipulator offers state-of-the-art dexterity and modular AI capabilities for robotic arms, with a robust collection of foundation models and GPU-accelerated libraries. It provides up to an 80x speedup in path planning and zero-shot perception increases efficiency and throughput, enabling developers to automate a greater number of new robotic tasks. Among early ecosystem partners are Yaskawa, Universal Robots, a Teradyne company, PickNik Robotics, Solomon, READY Robotics and Franka Robotics.

Isaac Perceptor provides multi-camera, 3D surround-vision capabilities, which are increasingly being used in autonomous mobile robots adopted in manufacturing and fulfillment operations to improve efficiency and worker safety as well as reduce error rates and costs. Early adopters include ArcBest, BYD and KION Group as they aim to achieve new levels of autonomy in material handling operations and more.

The new Isaac platform capabilities are expected to be available in the next quarter. Learn more about Project GR00T.


AUTHOR COMMENTARY

Check out Nvidia’s other press releases to learn about the other high-tech gizmos and processors they are working on, dated March 18th.

But thou, O Daniel, shut up the words, and seal the book, even to the time of the end: many shall run to and fro, and knowledge shall be increased.

Daniel 12:4

Very recently we examined the humanoid robots from Figure and Tesla, and how they are primed to replace most menial tasks and work. Well, now we can add Nvidia’s androids to the mix; which will only serve to displace workers, and further make this world even more artificial than it has become. SEE: Humanoid Androids Are Officially Here To Takeover People’s Jobs And Perform The Most Basic Of Tasks


[7] Who goeth a warfare any time at his own charges? who planteth a vineyard, and eateth not of the fruit thereof? or who feedeth a flock, and eateth not of the milk of the flock? [8] Say I these things as a man? or saith not the law the same also? [9] For it is written in the law of Moses, Thou shalt not muzzle the mouth of the ox that treadeth out the corn. Doth God take care for oxen? [10] Or saith he it altogether for our sakes? For our sakes, no doubt, this is written: that he that ploweth should plow in hope; and that he that thresheth in hope should be partaker of his hope. (1 Corinthians 9:7-10).

The WinePress needs your support! If God has laid it on your heart to want to contribute, please prayerfully consider donating to this ministry. If you cannot gift a monetary donation, then please donate your fervent prayers to keep this ministry going! Thank you and may God bless you.

CLICK HERE TO DONATE

1,139 Comments

  • Heya i’m for the first time here. I found this board and I find It really helpful & it helped me out a lot. I’m hoping to provide something back and aid others like you helped me.

  • Hello there I am so delighted I found your weblog, I really found you by accident, while I was researching on Digg for something else, Nonetheless I am here now and would just like to say thanks for a marvelous post and a all round entertaining blog (I also love the theme/design), I don’t have time to read through it all at the minute but I have saved it and also added in your RSS feeds, so when I have time I will be back to read a lot more, Please do keep up the fantastic work.

  • Its great as your other blog posts : D, thankyou for posting. “Reason is the substance of the universe. The design of the world is absolutely rational.” by Georg Wilhelm Friedrich Hegel.

  • Trà Xanh Thái Nguyên — Chè Thái Nguyên Vì Sao Được Mệnh Danh “Đệ Nhất Danh Trà”Nhắc đến trà Việt Nam, người ta nghĩ ngay đến Thái Nguyên. Không phải ngẫu nhiên mà vùng đất trung du này được xem là cái nôi của trà xanh Việt, với câu ví quen thuộc “chè Thái, gái Tuyên” vốn dùng để tôn vinh những đặc sản nổi tiếng của vùng trung du miền núi phía Bắc.

  • The following time I read a blog, I hope that it doesnt disappoint me as a lot as this one. I imply, I know it was my choice to read, but I really thought youd have something interesting to say. All I hear is a bunch of whining about one thing that you could possibly repair should you werent too busy in search of attention.

  • There are actually a lot of particulars like that to take into consideration. That could be a great point to deliver up. I provide the ideas above as basic inspiration but clearly there are questions just like the one you carry up where crucial factor will likely be working in honest good faith. I don?t know if best practices have emerged around issues like that, however I’m certain that your job is clearly identified as a good game. Each girls and boys feel the influence of just a moment’s pleasure, for the remainder of their lives.

  • We are a group of volunteers and opening a brand new scheme in our community. Your website offered us with valuable information to paintings on. You’ve performed a formidable task and our entire group will probably be grateful to you.

  • Hey there this is kind of of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding experience so I wanted to get advice from someone with experience. Any help would be enormously appreciated!

  • Hi there! This post couldn’t be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this article to him. Pretty sure he will have a good read. Thank you for sharing!

  • Hi there, just became aware of your blog through Google, and found that it is truly informative. I am going to watch out for brussels. I’ll be grateful if you continue this in future. Many people will be benefited from your writing. Cheers!

  • I was wondering if you ever thought of changing the structure of your website? Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having one or 2 pictures. Maybe you could space it out better?

  • Hello just wanted to give you a quick heads up. The words in your post seem to be running off the screen in Ie. I’m not sure if this is a formatting issue or something to do with browser compatibility but I thought I’d post to let you know. The design and style look great though! Hope you get the issue fixed soon. Many thanks

  • Hi there! I just wanted to ask if you ever have any issues with hackers? My last blog (wordpress) was hacked and I ended up losing several weeks of hard work due to no data backup. Do you have any solutions to prevent hackers?

  • I was very pleased to find this web-site.I wanted to thanks for your time for this wonderful read!! I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you blog post.

  • Very good website you have here but I was wondering if you knew of any community forums that cover the same topics discussed in this article? I’d really like to be a part of community where I can get comments from other experienced people that share the same interest. If you have any suggestions, please let me know. Kudos!

  • You actually make it appear really easy with your presentation but I find this matter to be actually one thing that I believe I might by no means understand. It seems too complex and very large for me. I’m looking ahead to your subsequent submit, I will attempt to get the cling of it!

  • I loved as much as you’ll receive carried out right here. The sketch is tasteful, your authored subject matter stylish. nonetheless, you command get got an edginess over that you wish be delivering the following. unwell unquestionably come more formerly again since exactly the same nearly a lot often inside case you shield this increase.

  • Hey there, I think your site might be having browser compatibility issues. When I look at your blog in Opera, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, superb blog!

  • of course like your web site but you have to test the spelling on several of your posts. Several of them are rife with spelling problems and I find it very troublesome to inform the reality on the other hand I’ll definitely come back again.

  • Thanks so much for sharing this wonderful article. I truly enjoy your blog. Thanks again for giving me the opportunity to comment on your web page. I hope more useful content from you soon.

  • After I originally commented I clicked the -Notify me when new feedback are added- checkbox and now each time a comment is added I get 4 emails with the same comment. Is there any method you’ll be able to remove me from that service? Thanks!

  • Whats up very cool web site!! Man .. Beautiful .. Amazing .. I will bookmark your blog and take the feeds additionally?KI’m glad to search out so many helpful info here within the put up, we want develop more techniques in this regard, thanks for sharing. . . . . .

Leave a Comment