Huang made this announcement and many more during a 90-minute presentation at the tech expo.
Cosmos will reportedly be used to train humanoids, industrial robots, and self-driving cars, after copying and learning from 20 million hours of real footage of “humans walking, hands moving, manipulating things,” Jensen said. “It’s not about generating creative content, but teaching the AI to understand the physical world.”
The ChatGPT moment for robotics is coming. Like large language models, world foundation models are fundamental to advancing robot and AV development, yet not all developers have the expertise and resources to train their own. We created Cosmos to democratize physical AI and put general robotics in reach of every developer.
Huang added
According to a press release from the company:
Physical AI models are costly to develop, and require vast amounts of real-world data and testing. Cosmos world foundation models, or WFMs, offer developers an easy way to generate massive amounts of photoreal, physics-based synthetic data to train and evaluate their existing models. Developers can also build custom models by fine-tuning Cosmos WFMs.
NVIDIA Cosmos’ suite of open models means developers can customize the WFMs with datasets, such as video recordings of AV trips or robots navigating a warehouse, according to the needs of their target application.
Cosmos WFMs are purpose-built for physical AI research and development, and can generate physics-based videos from a combination of inputs, like text, image and video, as well as robot sensor or motion data. The models are built for physically based interactions, object permanence, and high-quality generation of simulated industrial environments — like warehouses or factories — and of driving environments, including various road conditions.
In his opening keynote at CES, NVIDIA founder and CEO Jensen Huang showcased ways physical AI developers can use Cosmos models, including for:
- Video search and understanding, enabling developers to easily find specific training scenarios, like snowy road conditions or warehouse congestion, from video data.
- Physics-based photoreal synthetic data generation, using Cosmos models to generate photoreal videos from controlled 3D scenarios developed in the NVIDIA Omniverse™ platform.
- Physical AI model development and evaluation, whether building a custom model on the foundation models, improving the models using Cosmos for reinforcement learning or testing how they perform given a specific simulated scenario.
- Foresight and “multiverse” simulation, using Cosmos and Omniverse to generate every possible future outcome an AI model could take to help it select the best and most accurate path.
AUTHOR COMMENTARY
Last year was a huge year for Nvidia and other tech giants, particularly in the space of AI and pairing it with robotics. The same will be true for 2025 especially.
SEE:
- Nvidia Executive Says ‘AI Will Acquire A Human Form’ And Will Be Integrated Into Everything. ‘The Machine Is To The Body What AI Is To The Brain’
- Nvidia Debuts Next Wave Of AI Called ‘Physical AI.’ CEO Says ‘Everyone Will Have AI Assistant.’ Showcases Humanoid Robots And More
- Nvidia Launches “Project GROOT” To Create Highly Advanced AI-Powered Robots
Nothing is sacred anymore; all of our actions are being tracked, monitored, and then sold and tokenized for the highest bidder for big-tech – to make our lives better and more efficient, of course, so they tell us.
Ecclesiastes 7:29 Lo, this only have I found, that God hath made man upright; but they have sought out many inventions.
[7] Who goeth a warfare any time at his own charges? who planteth a vineyard, and eateth not of the fruit thereof? or who feedeth a flock, and eateth not of the milk of the flock? [8] Say I these things as a man? or saith not the law the same also? [9] For it is written in the law of Moses, Thou shalt not muzzle the mouth of the ox that treadeth out the corn. Doth God take care for oxen? [10] Or saith he it altogether for our sakes? For our sakes, no doubt, this is written: that he that ploweth should plow in hope; and that he that thresheth in hope should be partaker of his hope. (1 Corinthians 9:7-10).
The WinePress needs your support! If God has laid it on your heart to want to contribute, please prayerfully consider donating to this ministry. If you cannot gift a monetary donation, then please donate your fervent prayers to keep this ministry going! Thank you and may God bless you.
I have been absent for a while, but now I remember why I used to love this site. Thanks , I¦ll try and check back more frequently. How frequently you update your website?
This actually answered my problem, thanks!
I have recently started a web site, the information you offer on this site has helped me tremendously. Thanks for all of your time & work.
You made several nice points there. I did a search on the issue and found a good number of folks will agree with your blog.
Great wordpress blog here.. It’s hard to find quality writing like yours these days. I really appreciate people like you! take care
It?¦s really a nice and helpful piece of information. I?¦m happy that you just shared this useful information with us. Please stay us up to date like this. Thanks for sharing.
Hi, just required you to know I he added your site to my Google bookmarks due to your layout. But seriously, I believe your internet site has 1 in the freshest theme I??ve came across. It extremely helps make reading your blog significantly easier.
Does your site have a contact page? I’m having problems locating it but, I’d like to shoot you an e-mail. I’ve got some recommendations for your blog you might be interested in hearing. Either way, great website and I look forward to seeing it improve over time.
I love it when people come together and share opinions, great blog, keep it up.
I’ve been exploring for a bit for any high-quality articles or blog posts on this sort of area . Exploring in Yahoo I at last stumbled upon this site. Reading this information So i’m happy to convey that I’ve a very good uncanny feeling I discovered just what I needed. I most certainly will make sure to don’t forget this website and give it a look regularly.
I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post…
Once I originally commented I clicked the -Notify me when new comments are added- checkbox and now every time a remark is added I get four emails with the identical comment. Is there any method you can remove me from that service? Thanks!
Enjoyed reading through this, very good stuff, thankyou.
Whats Going down i’m new to this, I stumbled upon this I have found It positively useful and it has aided me out loads. I’m hoping to give a contribution & aid different users like its helped me. Great job.
Its excellent as your other content : D, appreciate it for posting.
I like what you guys are up also. Such intelligent work and reporting! Carry on the excellent works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site :).
Well I definitely liked reading it. This article provided by you is very helpful for proper planning.
I like what you guys are up also. Such smart work and reporting! Carry on the excellent works guys I’ve incorporated you guys to my blogroll. I think it will improve the value of my site 🙂
Very interesting subject, thanks for putting up. “Wrinkles should merely indicate where smiles have been.” by Mark Twain.
I¦ve recently started a website, the information you offer on this web site has helped me greatly. Thank you for all of your time & work.
Whats Taking place i am new to this, I stumbled upon this I have found It positively useful and it has helped me out loads. I am hoping to contribute & assist different customers like its aided me. Good job.
Great write-up, I’m regular visitor of one’s site, maintain up the nice operate, and It’s going to be a regular visitor for a long time.
Dead written subject material, Really enjoyed reading through.
certainly like your web site but you have to test the spelling on several of your posts. Many of them are rife with spelling problems and I in finding it very bothersome to inform the truth however I will certainly come again again.
You got a very superb website, Gladiolus I observed it through yahoo.
A lot of thanks for every one of your hard work on this website. My mom really likes managing investigation and it’s really easy to understand why. My spouse and i notice all regarding the lively ways you produce functional tips and tricks on the web site and in addition foster participation from the others about this situation so our daughter is without a doubt being taught a lot. Have fun with the remaining portion of the year. You are always performing a really great job.
Have you ever considered writing an e-book or guest authoring on other sites? I have a blog centered on the same topics you discuss and would love to have you share some stories/information. I know my visitors would value your work. If you are even remotely interested, feel free to shoot me an e mail.
Simply wanna comment on few general things, The website design and style is perfect, the subject material is very wonderful : D.
My wife and i have been really more than happy that Albert could do his homework because of the precious recommendations he came across while using the site. It’s not at all simplistic to just possibly be giving out guides which other people could have been selling. So we consider we now have the blog owner to appreciate for that. These explanations you made, the easy blog menu, the friendships you can make it easier to engender – it is everything spectacular, and it’s really assisting our son and the family do think the situation is brilliant, and that is exceptionally pressing. Many thanks for all the pieces!
You are my aspiration, I possess few web logs and sometimes run out from post :). “Yet do I fear thy nature It is too full o’ the milk of human kindness.” by William Shakespeare.
There is obviously a bunch to realize about this. I think you made various nice points in features also.
I’m really enjoying the design and layout of your blog. It’s a very easy on the eyes which makes it much more enjoyable for me to come here and visit more often. Did you hire out a designer to create your theme? Superb work!
It’s truly a nice and useful piece of information. I am satisfied that you just shared this useful information with us. Please stay us informed like this. Thanks for sharing.
You are a very clever person!
Great V I should definitely pronounce, impressed with your website. I had no trouble navigating through all the tabs and related info ended up being truly easy to do to access. I recently found what I hoped for before you know it at all. Quite unusual. Is likely to appreciate it for those who add forums or something, site theme . a tones way for your customer to communicate. Nice task..
Hey! I’m at work browsing your blog from my new iphone! Just wanted to say I love reading through your blog and look forward to all your posts! Carry on the great work!
I do not even know how I finished up right here, but I assumed this post was good. I don’t know who you might be however certainly you are going to a famous blogger if you happen to aren’t already 😉 Cheers!
great points altogether, you just gained a new reader. What would you suggest in regards to your post that you made some days ago? Any positive?
You have noted very interesting details ! ps decent website .
I have read some excellent stuff here. Definitely worth bookmarking for revisiting. I surprise how so much effort you place to create the sort of magnificent informative website.
Super-Duper blog! I am loving it!! Will come back again. I am bookmarking your feeds also
Helpful information. Fortunate me I found your website by chance, and I’m surprised why this coincidence did not took place earlier! I bookmarked it.
Hola! I’ve been following your web site for a while now and finally got the courage to go ahead and give you a shout out from Porter Texas! Just wanted to mention keep up the excellent job!
hello!,I really like your writing so so much! proportion we keep in touch extra approximately your article on AOL? I need a specialist on this space to resolve my problem. Maybe that’s you! Having a look forward to peer you.
This is the right blog for anyone who wants to find out about this topic. You realize so much its almost hard to argue with you (not that I actually would want…HaHa). You definitely put a new spin on a topic thats been written about for years. Great stuff, just great!
I wish to show some appreciation to the writer for bailing me out of such a instance. Because of looking through the search engines and obtaining views which are not beneficial, I thought my entire life was done. Being alive minus the approaches to the problems you’ve sorted out by means of your good article content is a crucial case, as well as the kind that might have in a wrong way affected my entire career if I had not encountered your blog post. That understanding and kindness in taking care of all things was invaluable. I’m not sure what I would’ve done if I had not come upon such a thing like this. I’m able to at this moment relish my future. Thanks for your time so much for your expert and result oriented help. I won’t think twice to refer the website to anyone who will need guidelines about this problem.
My brother suggested I might like this blog. He was entirely right. This post truly made my day. You can not imagine just how much time I had spent for this info! Thanks!
Great post. I used to be checking constantly this blog and I’m inspired! Extremely helpful information particularly the closing section 🙂 I maintain such information a lot. I was seeking this certain information for a very long time. Thanks and best of luck.
I was suggested this website by my cousin. I’m not sure whether this post is written by him as no one else know such detailed about my trouble. You’re amazing! Thanks!
Great work! This is the type of info that should be shared around the web. Shame on the search engines for not positioning this post higher! Come on over and visit my website . Thanks =)