NVIDIA announced Project GR00T, a general-purpose foundation model for humanoid robots, designed to further its work driving breakthroughs in robotics and embodied AI.

The following report is a press release from Nvidia, published March 18th:

As part of the initiative, the company also unveiled a new computer, Jetson Thor, for humanoid robots based on the NVIDIA Thor system-on-a-chip (SoC), as well as significant upgrades to the NVIDIA Isaac™ robotics platform, including generative AI foundation models and tools for simulation and AI workflow infrastructure.

Courtesy: Nvidia

“Building foundation models for general humanoid robots is one of the most exciting problems to solve in AI today,” said Jensen Huang, founder and CEO of NVIDIA. “The enabling technologies are coming together for leading roboticists around the world to take giant leaps towards artificial general robotics.”

Robots powered by GR00T, which stands for Generalist Robot 00 Technology, will be designed to understand natural language and emulate movements by observing human actions — quickly learning coordination, dexterity and other skills in order to navigate, adapt and interact with the real world. In his GTC keynote, Huang demonstrated several such robots completing a variety of tasks.

Built for Humanoid Robots
Jetson Thor was created as a new computing platform capable of performing complex tasks and interacting safely and naturally with people and machines. It has a modular architecture optimized for performance, power and size.

The SoC includes a next-generation GPU based on the NVIDIA Blackwell architecture with a transformer engine delivering 800 teraflops of 8-bit floating point AI performance to run multimodal generative AI models like GR00T. With an integrated functional safety processor, a high-performance CPU cluster and 100GB of ethernet bandwidth, it significantly simplifies design and integration efforts.

NVIDIA is building a comprehensive AI platform for leading humanoid robot companies such as 1X Technologies, Agility Robotics, Apptronik, Boston Dynamics, Figure AI, Fourier Intelligence, Sanctuary AI, Unitree Robotics and XPENG Robotics, among others.

We are at an inflection point in history, with human-centric robots like Digit poised to change labor forever. Modern AI will accelerate development, paving the way for robots like Digit to help people in all aspects of daily life. We’re excited to partner with NVIDIA to invest in the computing, simulation tools, machine learning environments and other necessary infrastructure to enable the dream of robots being a part of daily life.

said Jonathan Hurst, cofounder and chief robot officer at Agility Robotics.

Embodied AI will not only help address some of humanity’s biggest challenges, but also create innovations which are currently beyond our reach or imagination. Technology this important shouldn’t be built in silos, which is why we prioritize long-term partners like NVIDIA.

said Geordie Rose, cofounder and CEO of Sanctuary AI.

Major Updates to Isaac Platform
The Isaac tools that GR00T utilizes are capable of creating new foundation models for any robot embodiment in any environment. Among these tools are Isaac Lab for reinforcement learning, and OSMO, a compute orchestration service.

Embodied AI models require massive amounts of real and synthetic data. The new Isaac Lab is a GPU-accelerated, lightweight, performance-optimized application built on Isaac Sim specifically for running thousands of parallel simulations for robot learning.

To scale robot development workloads across heterogeneous compute, OSMO coordinates the data generation, model training and software/hardware-in-the-loop workflows across distributed environments.

NVIDIA also announced Isaac Manipulator and Isaac Perceptor — a collection of robotics pretrained models, libraries and reference hardware.

Isaac Manipulator offers state-of-the-art dexterity and modular AI capabilities for robotic arms, with a robust collection of foundation models and GPU-accelerated libraries. It provides up to an 80x speedup in path planning and zero-shot perception increases efficiency and throughput, enabling developers to automate a greater number of new robotic tasks. Among early ecosystem partners are Yaskawa, Universal Robots, a Teradyne company, PickNik Robotics, Solomon, READY Robotics and Franka Robotics.

Isaac Perceptor provides multi-camera, 3D surround-vision capabilities, which are increasingly being used in autonomous mobile robots adopted in manufacturing and fulfillment operations to improve efficiency and worker safety as well as reduce error rates and costs. Early adopters include ArcBest, BYD and KION Group as they aim to achieve new levels of autonomy in material handling operations and more.

The new Isaac platform capabilities are expected to be available in the next quarter. Learn more about Project GR00T.


AUTHOR COMMENTARY

Check out Nvidia’s other press releases to learn about the other high-tech gizmos and processors they are working on, dated March 18th.

But thou, O Daniel, shut up the words, and seal the book, even to the time of the end: many shall run to and fro, and knowledge shall be increased.

Daniel 12:4

Very recently we examined the humanoid robots from Figure and Tesla, and how they are primed to replace most menial tasks and work. Well, now we can add Nvidia’s androids to the mix; which will only serve to displace workers, and further make this world even more artificial than it has become. SEE: Humanoid Androids Are Officially Here To Takeover People’s Jobs And Perform The Most Basic Of Tasks


[7] Who goeth a warfare any time at his own charges? who planteth a vineyard, and eateth not of the fruit thereof? or who feedeth a flock, and eateth not of the milk of the flock? [8] Say I these things as a man? or saith not the law the same also? [9] For it is written in the law of Moses, Thou shalt not muzzle the mouth of the ox that treadeth out the corn. Doth God take care for oxen? [10] Or saith he it altogether for our sakes? For our sakes, no doubt, this is written: that he that ploweth should plow in hope; and that he that thresheth in hope should be partaker of his hope. (1 Corinthians 9:7-10).

The WinePress needs your support! If God has laid it on your heart to want to contribute, please prayerfully consider donating to this ministry. If you cannot gift a monetary donation, then please donate your fervent prayers to keep this ministry going! Thank you and may God bless you.

CLICK HERE TO DONATE

1,029 Comments

  • This is really interesting, You’re a very skilled blogger. I have joined your rss feed and look forward to seeking more of your fantastic post. Also, I’ve shared your website in my social networks!

  • Hi, i read your blog from time to time and i own a similar one and i was just curious if you get a lot of spam comments? If so how do you protect against it, any plugin or anything you can recommend? I get so much lately it’s driving me mad so any support is very much appreciated.

  • I would like to thnkx for the efforts you have put in writing this blog. I am hoping the same high-grade blog post from you in the upcoming as well. In fact your creative writing abilities has inspired me to get my own blog now. Really the blogging is spreading its wings quickly. Your write up is a good example of it.

  • Can I simply say what a reduction to seek out someone who truly knows what theyre speaking about on the internet. You definitely know the way to convey an issue to gentle and make it important. More people must read this and perceive this facet of the story. I cant consider youre not more popular since you definitely have the gift.

  • What i don’t understood is in fact how you are now not actually much more neatly-appreciated than you might be now. You’re so intelligent. You realize thus considerably on the subject of this matter, made me individually imagine it from so many various angles. Its like men and women aren’t fascinated except it¦s one thing to do with Woman gaga! Your personal stuffs great. At all times handle it up!

  • I was just looking for this information for a while. After six hours of continuous Googleing, finally I got it in your website. I wonder what is the lack of Google strategy that don’t rank this kind of informative websites in top of the list. Usually the top sites are full of garbage.

  • I have not checked in here for a while because I thought it was getting boring, but the last several posts are good quality so I guess I¦ll add you back to my everyday bloglist. You deserve it my friend 🙂

  • At this time it appears like Movable Type is the best blogging platform out there right now. (from what I’ve read) Is that what you’re using on your blog?

  • Thank you, I’ve recently been looking for info about this subject for ages and yours is the best I’ve discovered so far. However, what concerning the conclusion? Are you sure about the supply?

  • Thank you for any other magnificent post. Where else may anybody get that type of information in such an ideal means of writing? I have a presentation subsequent week, and I’m on the search for such info.

  • With the whole thing which appears to be developing within this area, a significant percentage of opinions are actually very stimulating. Having said that, I appologize, but I do not subscribe to your whole plan, all be it refreshing none the less. It seems to me that your remarks are generally not completely rationalized and in reality you are generally yourself not really thoroughly certain of your assertion. In any case I did appreciate reading through it.

  • I have read some good stuff here. Definitely worth bookmarking for revisiting. I surprise how so much attempt you place to make this kind of great informative web site.

  • Do you mind if I quote a couple of your posts as long as I provide credit and sources back to your weblog? My website is in the very same area of interest as yours and my visitors would genuinely benefit from some of the information you provide here. Please let me know if this okay with you. Many thanks!

  • Wow, awesome blog layout! How long have you been blogging for? you made blogging look easy. The overall look of your website is fantastic, let alone the content!

  • Have you ever considered about adding a little bit more than just your articles? I mean, what you say is valuable and everything. But think of if you added some great images or videos to give your posts more, “pop”! Your content is excellent but with pics and clips, this site could definitely be one of the best in its field. Amazing blog!

  • I was very pleased to find this web-site.I wanted to thanks for your time for this wonderful read!! I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you blog post.

  • Magnificent web site. A lot of helpful info here. I¦m sending it to several friends ans additionally sharing in delicious. And naturally, thanks in your sweat!

  • Hey there would you mind stating which blog platform you’re working with? I’m looking to start my own blog soon but I’m having a difficult time deciding between BlogEngine/Wordpress/B2evolution and Drupal. The reason I ask is because your design seems different then most blogs and I’m looking for something completely unique. P.S My apologies for getting off-topic but I had to ask!

  • Hmm is anyone else experiencing problems with the pictures on this blog loading? I’m trying to determine if its a problem on my end or if it’s the blog. Any responses would be greatly appreciated.

  • I loved as much as you’ll receive carried out right here. The sketch is tasteful, your authored material stylish. nonetheless, you command get got an shakiness over that you wish be delivering the following. unwell unquestionably come more formerly again since exactly the same nearly a lot often inside case you shield this increase.

  • Hi, just required you to know I he added your site to my Google bookmarks due to your layout. But seriously, I believe your internet site has 1 in the freshest theme I??ve came across. It extremely helps make reading your blog significantly easier.

  • Hello! I could have sworn I’ve been to this blog before but after browsing through some of the post I realized it’s new to me. Anyways, I’m definitely happy I found it and I’ll be book-marking and checking back frequently!

  • Its like you read my mind! You seem to know a lot about this, like you wrote the book in it or something. I think that you could do with a few pics to drive the message home a bit, but other than that, this is fantastic blog. A great read. I’ll definitely be back.

  • Hello, i believe that i noticed you visited my blog thus i came to “go back the favor”.I’m attempting to find issues to enhance my site!I guess its good enough to use some of your ideas!!

  • You could definitely see your skills in the work you write. The world hopes for even more passionate writers like you who aren’t afraid to say how they believe. Always go after your heart.

  • Hey there! I’ve been following your web site for a while now and finally got the bravery to go ahead and give you a shout out from Huffman Tx! Just wanted to mention keep up the great work!

Leave a Comment