Huang made this announcement and many more during a 90-minute presentation at the tech expo.
Cosmos will reportedly be used to train humanoids, industrial robots, and self-driving cars, after copying and learning from 20 million hours of real footage of “humans walking, hands moving, manipulating things,” Jensen said. “It’s not about generating creative content, but teaching the AI to understand the physical world.”
The ChatGPT moment for robotics is coming. Like large language models, world foundation models are fundamental to advancing robot and AV development, yet not all developers have the expertise and resources to train their own. We created Cosmos to democratize physical AI and put general robotics in reach of every developer.
Huang added
According to a press release from the company:
Physical AI models are costly to develop, and require vast amounts of real-world data and testing. Cosmos world foundation models, or WFMs, offer developers an easy way to generate massive amounts of photoreal, physics-based synthetic data to train and evaluate their existing models. Developers can also build custom models by fine-tuning Cosmos WFMs.
NVIDIA Cosmos’ suite of open models means developers can customize the WFMs with datasets, such as video recordings of AV trips or robots navigating a warehouse, according to the needs of their target application.
Cosmos WFMs are purpose-built for physical AI research and development, and can generate physics-based videos from a combination of inputs, like text, image and video, as well as robot sensor or motion data. The models are built for physically based interactions, object permanence, and high-quality generation of simulated industrial environments — like warehouses or factories — and of driving environments, including various road conditions.
In his opening keynote at CES, NVIDIA founder and CEO Jensen Huang showcased ways physical AI developers can use Cosmos models, including for:
- Video search and understanding, enabling developers to easily find specific training scenarios, like snowy road conditions or warehouse congestion, from video data.
- Physics-based photoreal synthetic data generation, using Cosmos models to generate photoreal videos from controlled 3D scenarios developed in the NVIDIA Omniverse™ platform.
- Physical AI model development and evaluation, whether building a custom model on the foundation models, improving the models using Cosmos for reinforcement learning or testing how they perform given a specific simulated scenario.
- Foresight and “multiverse” simulation, using Cosmos and Omniverse to generate every possible future outcome an AI model could take to help it select the best and most accurate path.
AUTHOR COMMENTARY
Last year was a huge year for Nvidia and other tech giants, particularly in the space of AI and pairing it with robotics. The same will be true for 2025 especially.
SEE:
- Nvidia Executive Says ‘AI Will Acquire A Human Form’ And Will Be Integrated Into Everything. ‘The Machine Is To The Body What AI Is To The Brain’
- Nvidia Debuts Next Wave Of AI Called ‘Physical AI.’ CEO Says ‘Everyone Will Have AI Assistant.’ Showcases Humanoid Robots And More
- Nvidia Launches “Project GROOT” To Create Highly Advanced AI-Powered Robots
Nothing is sacred anymore; all of our actions are being tracked, monitored, and then sold and tokenized for the highest bidder for big-tech – to make our lives better and more efficient, of course, so they tell us.
Ecclesiastes 7:29 Lo, this only have I found, that God hath made man upright; but they have sought out many inventions.
[7] Who goeth a warfare any time at his own charges? who planteth a vineyard, and eateth not of the fruit thereof? or who feedeth a flock, and eateth not of the milk of the flock? [8] Say I these things as a man? or saith not the law the same also? [9] For it is written in the law of Moses, Thou shalt not muzzle the mouth of the ox that treadeth out the corn. Doth God take care for oxen? [10] Or saith he it altogether for our sakes? For our sakes, no doubt, this is written: that he that ploweth should plow in hope; and that he that thresheth in hope should be partaker of his hope. (1 Corinthians 9:7-10).
The WinePress needs your support! If God has laid it on your heart to want to contribute, please prayerfully consider donating to this ministry. If you cannot gift a monetary donation, then please donate your fervent prayers to keep this ministry going! Thank you and may God bless you.
Hey there, You’ve performed a great job. I’ll definitely digg it and in my opinion suggest to my friends. I am sure they’ll be benefited from this site.
I used to be recommended this web site through my cousin. I’m not certain whether or not this publish is written by means of him as no one else understand such certain about my trouble. You are wonderful! Thanks!
Utterly written subject material, Really enjoyed examining.
It’s really a cool and useful piece of information. I’m glad that you shared this useful information with us. Please keep us up to date like this. Thanks for sharing.
Some genuinely nice and utilitarian info on this website , likewise I conceive the design has got fantastic features.
Pretty! This was a really wonderful post. Thank you for your provided information.
Thanks for helping out, great info. “Riches cover a multitude of woes.” by Menander.
Hi there! This post couldn’t be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this article to him. Pretty sure he will have a good read. Thank you for sharing!
Hmm is anyone else experiencing problems with the pictures on this blog loading? I’m trying to find out if its a problem on my end or if it’s the blog. Any suggestions would be greatly appreciated.
I love what you guys are up too. This type of clever work and reporting! Keep up the awesome works guys I’ve incorporated you guys to my blogroll.
I think other website proprietors should take this web site as an example , very clean and great user pleasant style.
Some truly nice stuff on this internet site, I like it.
Hello! I could have sworn I’ve been to this blog before but after browsing through some of the post I realized it’s new to me. Anyways, I’m definitely happy I found it and I’ll be book-marking and checking back frequently!
Hi there, I found your website via Google while searching for a related topic, your site came up, it looks good. I have bookmarked it in my google bookmarks.
I have been absent for some time, but now I remember why I used to love this site. Thank you, I’ll try and check back more often. How frequently you update your website?
excellent post, very informative. I wonder why the other experts of this sector do not notice this. You must continue your writing. I’m confident, you’ve a huge readers’ base already!
I discovered your blog website on google and verify a few of your early posts. Proceed to keep up the excellent operate. I simply extra up your RSS feed to my MSN News Reader. Looking for ahead to reading more from you later on!…
After study a few of the blog posts on your website now, and I truly like your way of blogging. I bookmarked it to my bookmark website list and will be checking back soon. Pls check out my web site as well and let me know what you think.
It’s hard to find knowledgeable people on this topic, but you sound like you know what you’re talking about! Thanks
Real nice layout and good content material, practically nothing else we require : D.
Hi! I’ve been following your weblog for some time now and finally got the bravery to go ahead and give you a shout out from Atascocita Tx! Just wanted to mention keep up the excellent job!
Its excellent as your other posts : D, appreciate it for putting up. “A gift in season is a double favor to the needy.” by Publilius Syrus.
Great post. I used to be checking continuously this weblog and I’m inspired! Extremely useful info particularly the last part 🙂 I maintain such information a lot. I used to be seeking this particular information for a very long time. Thank you and best of luck.
I wanted to write a brief comment in order to express gratitude to you for some of the great techniques you are giving at this website. My incredibly long internet look up has finally been rewarded with good suggestions to share with my pals. I ‘d express that most of us visitors are very endowed to live in a notable network with so many awesome people with good strategies. I feel very much lucky to have come across your webpage and look forward to tons of more exciting times reading here. Thank you once again for a lot of things.
Good site! I truly love how it is easy on my eyes and the data are well written. I am wondering how I might be notified when a new post has been made. I’ve subscribed to your RSS which must do the trick! Have a nice day!
With havin so much content and articles do you ever run into any problems of plagorism or copyright violation? My site has a lot of unique content I’ve either created myself or outsourced but it seems a lot of it is popping it up all over the internet without my agreement. Do you know any solutions to help protect against content from being stolen? I’d certainly appreciate it.
I needed to compose you that little remark just to say thanks again with your pretty basics you’ve documented above. This is quite surprisingly generous of you to provide unreservedly all a lot of folks could have sold as an electronic book to end up making some cash for themselves, precisely now that you could possibly have tried it in the event you decided. Those pointers as well worked like a great way to realize that some people have a similar zeal similar to my very own to know significantly more when considering this issue. I am sure there are millions of more pleasurable times ahead for folks who see your blog post.
Hey very nice website!! Man .. Excellent .. Superb .. I’ll bookmark your web site and take the feeds additionally…I’m happy to seek out numerous helpful info right here in the publish, we’d like work out more strategies on this regard, thank you for sharing.
Thank you for sharing superb informations. Your website is very cool. I’m impressed by the details that you have on this blog. It reveals how nicely you perceive this subject. Bookmarked this web page, will come back for more articles. You, my friend, ROCK! I found just the information I already searched everywhere and just couldn’t come across. What a great web-site.
I love the efforts you have put in this, thanks for all the great blog posts.
Only wanna input on few general things, The website pattern is perfect, the articles is very great : D.
I reckon something really special in this site.
Magnificent website. Plenty of helpful information here. I am sending it to several friends ans additionally sharing in delicious. And certainly, thank you in your sweat!
This is a very good tips especially to those new to blogosphere, brief and accurate information… Thanks for sharing this one. A must read article.
Excellent site. Lots of helpful information here. I’m sending it to several friends ans also sharing in delicious. And naturally, thanks to your sweat!
I’m really loving the theme/design of your web site. Do you ever run into any internet browser compatibility problems? A few of my blog visitors have complained about my website not working correctly in Explorer but looks great in Opera. Do you have any solutions to help fix this issue?
I feel that is among the so much vital info for me. And i am satisfied studying your article. But want to remark on some normal issues, The web site style is perfect, the articles is in point of fact excellent : D. Excellent process, cheers
What i do not understood is in fact how you’re now not actually a lot more neatly-liked than you may be right now. You are very intelligent. You understand thus considerably in relation to this subject, made me in my view imagine it from so many varied angles. Its like women and men don’t seem to be fascinated until it?¦s one thing to do with Woman gaga! Your individual stuffs excellent. Always take care of it up!
Some genuinely excellent information, Glad I noticed this. “Things we not hope for often come to pass than things we wish.” by Titus Maccius Plautus.
Hi! Someone in my Myspace group shared this website with us so I came to take a look. I’m definitely loving the information. I’m book-marking and will be tweeting this to my followers! Outstanding blog and great design and style.
Great – I should definitely pronounce, impressed with your site. I had no trouble navigating through all the tabs and related information ended up being truly easy to do to access. I recently found what I hoped for before you know it at all. Reasonably unusual. Is likely to appreciate it for those who add forums or anything, site theme . a tones way for your customer to communicate. Nice task..
Hi there very cool web site!! Guy .. Excellent .. Superb .. I’ll bookmark your web site and take the feeds also?KI am happy to seek out so many helpful information here in the put up, we’d like work out more techniques in this regard, thanks for sharing. . . . . .
hey there and thanks on your information – I have definitely picked up something new from proper here. I did alternatively experience a few technical issues the use of this site, as I experienced to reload the website lots of instances prior to I may get it to load correctly. I were puzzling over if your web hosting is OK? Not that I’m complaining, but sluggish loading instances times will often impact your placement in google and can damage your quality rating if ads and ***********|advertising|advertising|advertising and *********** with Adwords. Well I am including this RSS to my e-mail and could look out for a lot more of your respective exciting content. Make sure you replace this once more very soon..
It’s really a great and helpful piece of info. I am glad that you shared this useful info with us. Please keep us informed like this. Thank you for sharing.
Great work! That is the type of information that should be shared across the net. Disgrace on the seek engines for not positioning this post upper! Come on over and visit my website . Thanks =)
Just a smiling visitant here to share the love (:, btw outstanding design.
Excellent post. I was checking constantly this blog and I am impressed! Extremely helpful info particularly the last part 🙂 I care for such information much. I was looking for this particular information for a very long time. Thank you and best of luck.
Very interesting info !Perfect just what I was searching for!
Admiring the dedication you put into your site and in depth information you present. It’s awesome to come across a blog every once in a while that isn’t the same old rehashed material. Wonderful read! I’ve saved your site and I’m adding your RSS feeds to my Google account.
I’ve read some excellent stuff here. Definitely value bookmarking for revisiting. I wonder how so much attempt you set to create any such wonderful informative website.