Huang made this announcement and many more during a 90-minute presentation at the tech expo.
Cosmos will reportedly be used to train humanoids, industrial robots, and self-driving cars, after copying and learning from 20 million hours of real footage of “humans walking, hands moving, manipulating things,” Jensen said. “It’s not about generating creative content, but teaching the AI to understand the physical world.”
The ChatGPT moment for robotics is coming. Like large language models, world foundation models are fundamental to advancing robot and AV development, yet not all developers have the expertise and resources to train their own. We created Cosmos to democratize physical AI and put general robotics in reach of every developer.
Huang added
According to a press release from the company:
Physical AI models are costly to develop, and require vast amounts of real-world data and testing. Cosmos world foundation models, or WFMs, offer developers an easy way to generate massive amounts of photoreal, physics-based synthetic data to train and evaluate their existing models. Developers can also build custom models by fine-tuning Cosmos WFMs.
NVIDIA Cosmos’ suite of open models means developers can customize the WFMs with datasets, such as video recordings of AV trips or robots navigating a warehouse, according to the needs of their target application.
Cosmos WFMs are purpose-built for physical AI research and development, and can generate physics-based videos from a combination of inputs, like text, image and video, as well as robot sensor or motion data. The models are built for physically based interactions, object permanence, and high-quality generation of simulated industrial environments — like warehouses or factories — and of driving environments, including various road conditions.
In his opening keynote at CES, NVIDIA founder and CEO Jensen Huang showcased ways physical AI developers can use Cosmos models, including for:
- Video search and understanding, enabling developers to easily find specific training scenarios, like snowy road conditions or warehouse congestion, from video data.
- Physics-based photoreal synthetic data generation, using Cosmos models to generate photoreal videos from controlled 3D scenarios developed in the NVIDIA Omniverse™ platform.
- Physical AI model development and evaluation, whether building a custom model on the foundation models, improving the models using Cosmos for reinforcement learning or testing how they perform given a specific simulated scenario.
- Foresight and “multiverse” simulation, using Cosmos and Omniverse to generate every possible future outcome an AI model could take to help it select the best and most accurate path.
AUTHOR COMMENTARY
Last year was a huge year for Nvidia and other tech giants, particularly in the space of AI and pairing it with robotics. The same will be true for 2025 especially.
SEE:
- Nvidia Executive Says ‘AI Will Acquire A Human Form’ And Will Be Integrated Into Everything. ‘The Machine Is To The Body What AI Is To The Brain’
- Nvidia Debuts Next Wave Of AI Called ‘Physical AI.’ CEO Says ‘Everyone Will Have AI Assistant.’ Showcases Humanoid Robots And More
- Nvidia Launches “Project GROOT” To Create Highly Advanced AI-Powered Robots
Nothing is sacred anymore; all of our actions are being tracked, monitored, and then sold and tokenized for the highest bidder for big-tech – to make our lives better and more efficient, of course, so they tell us.
Ecclesiastes 7:29 Lo, this only have I found, that God hath made man upright; but they have sought out many inventions.
[7] Who goeth a warfare any time at his own charges? who planteth a vineyard, and eateth not of the fruit thereof? or who feedeth a flock, and eateth not of the milk of the flock? [8] Say I these things as a man? or saith not the law the same also? [9] For it is written in the law of Moses, Thou shalt not muzzle the mouth of the ox that treadeth out the corn. Doth God take care for oxen? [10] Or saith he it altogether for our sakes? For our sakes, no doubt, this is written: that he that ploweth should plow in hope; and that he that thresheth in hope should be partaker of his hope. (1 Corinthians 9:7-10).
The WinePress needs your support! If God has laid it on your heart to want to contribute, please prayerfully consider donating to this ministry. If you cannot gift a monetary donation, then please donate your fervent prayers to keep this ministry going! Thank you and may God bless you.
Fantastic website. A lot of helpful info here. I?¦m sending it to some friends ans also sharing in delicious. And naturally, thanks in your sweat!
Appreciate it for this post, I am a big fan of this web site would like to go on updated.
Hey! I just wanted to ask if you ever have any problems with hackers? My last blog (wordpress) was hacked and I ended up losing a few months of hard work due to no backup. Do you have any solutions to prevent hackers?
It is really a nice and helpful piece of info. I am glad that you simply shared this useful information with us. Please keep us informed like this. Thank you for sharing.
Very interesting topic, thankyou for putting up. “Welcome to President Bush, Mrs. Bush, and my fellow astronauts.” by Dan Quayle.
Your place is valueble for me. Thanks!…
A large percentage of of the things you claim happens to be supprisingly precise and that makes me wonder why I had not looked at this in this light before. This piece truly did turn the light on for me personally as far as this subject goes. But there is actually 1 point I am not too cozy with so whilst I try to reconcile that with the central theme of your point, permit me observe just what all the rest of your visitors have to point out.Nicely done.
It’s in point of fact a great and useful piece of information. I’m happy that you shared this helpful information with us. Please stay us up to date like this. Thanks for sharing.
Very good website you have here but I was wondering if you knew of any discussion boards that cover the same topics discussed here? I’d really like to be a part of group where I can get feedback from other knowledgeable individuals that share the same interest. If you have any recommendations, please let me know. Thanks a lot!
Greetings from Ohio! I’m bored to tears at work so I decided to browse your site on my iphone during lunch break. I love the knowledge you provide here and can’t wait to take a look when I get home. I’m amazed at how quick your blog loaded on my cell phone .. I’m not even using WIFI, just 3G .. Anyways, fantastic blog!
I used to be suggested this blog by means of my cousin. I’m not positive whether or not this submit is written through him as no one else realize such unique about my difficulty. You’re incredible! Thank you!
Pretty element of content. I simply stumbled upon your site and in accession capital to assert that I acquire in fact enjoyed account your blog posts. Any way I will be subscribing to your augment or even I achievement you get right of entry to persistently fast.
This really answered my downside, thanks!
Hi there very nice blog!! Guy .. Excellent .. Superb .. I will bookmark your blog and take the feeds also…I’m happy to find a lot of helpful info right here in the post, we’d like work out more strategies on this regard, thank you for sharing.
I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post…
There are some fascinating points in time on this article however I don’t know if I see all of them heart to heart. There may be some validity however I’ll take maintain opinion until I look into it further. Good article , thanks and we wish more! Added to FeedBurner as properly
I really value your work, Great post.
I simply desired to thank you so much yet again. I’m not certain the things I might have accomplished in the absence of the actual information contributed by you about my topic. It previously was an absolute intimidating scenario in my circumstances, however , looking at a specialized avenue you processed that made me to leap over gladness. Now i am happier for your information and as well , hope you know what a great job you are always carrying out educating many others with the aid of your blog post. I’m certain you’ve never got to know all of us.
Exactly what I was searching for, thanks for putting up.
I like this weblog its a master peace ! Glad I noticed this on google .
Great write-up, I’m regular visitor of one’s website, maintain up the excellent operate, and It’s going to be a regular visitor for a long time.
It?¦s really a cool and helpful piece of information. I am happy that you shared this useful information with us. Please stay us informed like this. Thank you for sharing.
Yeah bookmaking this wasn’t a risky decision outstanding post! .
Thanks for any other informative site. The place else could I am getting that kind of information written in such an ideal manner? I have a undertaking that I am simply now running on, and I’ve been on the glance out for such info.
Very interesting information!Perfect just what I was searching for!
I have been surfing on-line greater than 3 hours as of late, yet I never found any attention-grabbing article like yours. It is lovely worth enough for me. In my view, if all website owners and bloggers made good content material as you probably did, the net will likely be much more helpful than ever before.
Some genuinely nice and utilitarian information on this internet site, also I believe the style and design has excellent features.
Wow, fantastic blog structure! How long have you been blogging for? you make blogging glance easy. The overall glance of your web site is great, let alone the content!
Valuable information. Lucky me I found your site by accident, and I am shocked why this accident did not happened earlier! I bookmarked it.
We are a bunch of volunteers and opening a brand new scheme in our community. Your web site provided us with helpful information to work on. You have performed a formidable job and our entire community will probably be grateful to you.
Thank you a lot for giving everyone remarkably breathtaking possiblity to read articles and blog posts from this website. It really is very brilliant plus full of a good time for me and my office mates to search your site at minimum three times a week to find out the fresh secrets you will have. And indeed, I’m just actually amazed with the attractive points served by you. Selected two areas on this page are certainly the most beneficial we have all had.
Hello. magnificent job. I did not anticipate this. This is a impressive story. Thanks!
Thanks for helping out, fantastic information.
I would like to thnkx for the efforts you have put in writing this blog. I am hoping the same high-grade blog post from you in the upcoming as well. In fact your creative writing abilities has inspired me to get my own blog now. Really the blogging is spreading its wings quickly. Your write up is a good example of it.
I do enjoy the manner in which you have presented this specific matter plus it does give us some fodder for thought. On the other hand, from what I have experienced, I simply just hope as other responses pack on that people today continue to be on point and in no way start on a soap box regarding the news du jour. Still, thank you for this superb point and although I can not necessarily concur with it in totality, I value your perspective.
Some truly nice and useful info on this website, as well I conceive the style and design has got great features.
Amazing! This blog looks exactly like my old one! It’s on a entirely different subject but it has pretty much the same layout and design. Outstanding choice of colors!
F*ckin’ tremendous things here. I’m very glad to see your post. Thanks a lot and i’m looking forward to contact you. Will you please drop me a mail?
You completed a number of fine points there. I did a search on the topic and found nearly all people will have the same opinion with your blog.
certainly like your web site but you have to take a look at the spelling on several of your posts. Many of them are rife with spelling problems and I to find it very troublesome to inform the truth however I will definitely come again again.
I really like your writing style, superb info , appreciate it for posting : D.
Good V I should definitely pronounce, impressed with your web site. I had no trouble navigating through all the tabs as well as related information ended up being truly easy to do to access. I recently found what I hoped for before you know it in the least. Reasonably unusual. Is likely to appreciate it for those who add forums or something, website theme . a tones way for your customer to communicate. Excellent task..
Woah! I’m really enjoying the template/theme of this blog. It’s simple, yet effective. A lot of times it’s very difficult to get that “perfect balance” between superb usability and visual appearance. I must say you have done a fantastic job with this. Also, the blog loads super fast for me on Firefox. Exceptional Blog!
What¦s Taking place i am new to this, I stumbled upon this I’ve discovered It absolutely useful and it has helped me out loads. I hope to contribute & aid different customers like its aided me. Good job.
he blog was how do i say it… relevant, finally something that helped me. Thanks
It’s really a cool and helpful piece of info. I am glad that you shared this helpful info with us. Please keep us up to date like this. Thanks for sharing.
Good day very nice blog!! Man .. Beautiful .. Amazing .. I’ll bookmark your website and take the feeds additionally?KI am happy to find numerous helpful information here in the put up, we need work out extra techniques in this regard, thanks for sharing. . . . . .
I¦ve read a few good stuff here. Definitely worth bookmarking for revisiting. I wonder how much attempt you place to create such a magnificent informative web site.
Greetings from Colorado! I’m bored to tears at work so I decided to browse your site on my iphone during lunch break. I really like the information you present here and can’t wait to take a look when I get home. I’m shocked at how fast your blog loaded on my mobile .. I’m not even using WIFI, just 3G .. Anyways, awesome blog!
Wow! Thank you! I continually wanted to write on my site something like that. Can I take a fragment of your post to my blog?