Huang made this announcement and many more during a 90-minute presentation at the tech expo.
Cosmos will reportedly be used to train humanoids, industrial robots, and self-driving cars, after copying and learning from 20 million hours of real footage of “humans walking, hands moving, manipulating things,” Jensen said. “It’s not about generating creative content, but teaching the AI to understand the physical world.”
The ChatGPT moment for robotics is coming. Like large language models, world foundation models are fundamental to advancing robot and AV development, yet not all developers have the expertise and resources to train their own. We created Cosmos to democratize physical AI and put general robotics in reach of every developer.
Huang added
According to a press release from the company:
Physical AI models are costly to develop, and require vast amounts of real-world data and testing. Cosmos world foundation models, or WFMs, offer developers an easy way to generate massive amounts of photoreal, physics-based synthetic data to train and evaluate their existing models. Developers can also build custom models by fine-tuning Cosmos WFMs.
NVIDIA Cosmos’ suite of open models means developers can customize the WFMs with datasets, such as video recordings of AV trips or robots navigating a warehouse, according to the needs of their target application.
Cosmos WFMs are purpose-built for physical AI research and development, and can generate physics-based videos from a combination of inputs, like text, image and video, as well as robot sensor or motion data. The models are built for physically based interactions, object permanence, and high-quality generation of simulated industrial environments — like warehouses or factories — and of driving environments, including various road conditions.
In his opening keynote at CES, NVIDIA founder and CEO Jensen Huang showcased ways physical AI developers can use Cosmos models, including for:
- Video search and understanding, enabling developers to easily find specific training scenarios, like snowy road conditions or warehouse congestion, from video data.
- Physics-based photoreal synthetic data generation, using Cosmos models to generate photoreal videos from controlled 3D scenarios developed in the NVIDIA Omniverse™ platform.
- Physical AI model development and evaluation, whether building a custom model on the foundation models, improving the models using Cosmos for reinforcement learning or testing how they perform given a specific simulated scenario.
- Foresight and “multiverse” simulation, using Cosmos and Omniverse to generate every possible future outcome an AI model could take to help it select the best and most accurate path.
AUTHOR COMMENTARY
Last year was a huge year for Nvidia and other tech giants, particularly in the space of AI and pairing it with robotics. The same will be true for 2025 especially.
SEE:
- Nvidia Executive Says ‘AI Will Acquire A Human Form’ And Will Be Integrated Into Everything. ‘The Machine Is To The Body What AI Is To The Brain’
- Nvidia Debuts Next Wave Of AI Called ‘Physical AI.’ CEO Says ‘Everyone Will Have AI Assistant.’ Showcases Humanoid Robots And More
- Nvidia Launches “Project GROOT” To Create Highly Advanced AI-Powered Robots
Nothing is sacred anymore; all of our actions are being tracked, monitored, and then sold and tokenized for the highest bidder for big-tech – to make our lives better and more efficient, of course, so they tell us.
Ecclesiastes 7:29 Lo, this only have I found, that God hath made man upright; but they have sought out many inventions.
[7] Who goeth a warfare any time at his own charges? who planteth a vineyard, and eateth not of the fruit thereof? or who feedeth a flock, and eateth not of the milk of the flock? [8] Say I these things as a man? or saith not the law the same also? [9] For it is written in the law of Moses, Thou shalt not muzzle the mouth of the ox that treadeth out the corn. Doth God take care for oxen? [10] Or saith he it altogether for our sakes? For our sakes, no doubt, this is written: that he that ploweth should plow in hope; and that he that thresheth in hope should be partaker of his hope. (1 Corinthians 9:7-10).
The WinePress needs your support! If God has laid it on your heart to want to contribute, please prayerfully consider donating to this ministry. If you cannot gift a monetary donation, then please donate your fervent prayers to keep this ministry going! Thank you and may God bless you.
I really appreciate this post. I have been looking all over for this! Thank goodness I found it on Bing. You’ve made my day! Thank you again!
Excellent goods from you, man. I’ve understand your stuff previous to and you’re just extremely excellent. I really like what you have acquired here, really like what you are stating and the way in which you say it. You make it enjoyable and you still take care of to keep it smart. I cant wait to read much more from you. This is really a tremendous web site.
I?¦ve been exploring for a little for any high-quality articles or weblog posts on this sort of space . Exploring in Yahoo I finally stumbled upon this site. Reading this information So i am glad to show that I have a very excellent uncanny feeling I found out exactly what I needed. I most undoubtedly will make certain to don?¦t put out of your mind this web site and give it a look regularly.
I have been exploring for a little bit for any high-quality articles or blog posts on this sort of house . Exploring in Yahoo I eventually stumbled upon this website. Studying this information So i¦m happy to exhibit that I’ve a very good uncanny feeling I found out just what I needed. I such a lot unquestionably will make sure to don¦t forget this web site and give it a look regularly.
You are a very intelligent person!
Admiring the time and effort you put into your website and detailed information you present. It’s awesome to come across a blog every once in a while that isn’t the same out of date rehashed material. Fantastic read! I’ve bookmarked your site and I’m adding your RSS feeds to my Google account.
I would like to thnkx for the efforts you have put in writing this blog. I am hoping the same high-grade blog post from you in the upcoming as well. In fact your creative writing abilities has inspired me to get my own blog now. Really the blogging is spreading its wings quickly. Your write up is a good example of it.
Hello very nice web site!! Guy .. Beautiful .. Superb .. I will bookmark your blog and take the feeds also?KI’m glad to search out a lot of helpful information right here in the submit, we want develop more techniques in this regard, thanks for sharing. . . . . .
Thank you for the auspicious writeup. It in fact was a amusement account it. Look advanced to far added agreeable from you! However, how can we communicate?
I really like your writing style, good info , thankyou for putting up : D.
I was curious if you ever considered changing the page layout of your website? Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having 1 or 2 pictures. Maybe you could space it out better?
Thank you for every other informative web site. The place else may just I get that type of info written in such a perfect method? I have a undertaking that I’m just now operating on, and I have been on the glance out for such information.
I?¦m not sure the place you are getting your info, however great topic. I needs to spend a while studying much more or understanding more. Thank you for great info I used to be in search of this info for my mission.
Wow! Thank you! I always needed to write on my website something like that. Can I implement a portion of your post to my website?
Thank you for another great article. Where else could anyone get that type of info in such an ideal way of writing? I’ve a presentation next week, and I am on the look for such info.
This web page is really a stroll-by means of for all of the data you wished about this and didn’t know who to ask. Glimpse here, and also you’ll undoubtedly discover it.
I truly enjoy looking through on this web site, it contains excellent posts. “Beware lest in your anxiety to avoid war you obtain a master.” by Demosthenes.
Can I just say what a reduction to search out somebody who truly is aware of what theyre speaking about on the internet. You undoubtedly know the best way to bring an issue to mild and make it important. Extra people need to read this and perceive this side of the story. I cant believe youre no more common since you undoubtedly have the gift.
Pretty section of content. I just stumbled upon your blog and in accession capital to assert that I get in fact enjoyed account your blog posts. Anyway I will be subscribing to your feeds and even I achievement you access consistently rapidly.
I want meeting utile information , this post has got me even more info! .
I haven?¦t checked in here for a while since I thought it was getting boring, but the last few posts are good quality so I guess I?¦ll add you back to my daily bloglist. You deserve it my friend 🙂
You really make it seem really easy along with your presentation but I to find this matter to be actually one thing that I feel I would never understand. It seems too complex and extremely huge for me. I’m having a look forward on your next post, I will try to get the cling of it!
You have remarked very interesting points! ps decent website .
Hello, Neat post. There is a problem along with your web site in web explorer, might test this… IE nonetheless is the market leader and a good part of other folks will leave out your fantastic writing due to this problem.
I like this blog its a master peace ! Glad I noticed this on google .
I have been reading out a few of your posts and i can state pretty nice stuff. I will surely bookmark your site.
Thankyou for this post, I am a big fan of this site would like to keep updated.
Its such as you read my mind! You seem to understand a lot approximately this, like you wrote the guide in it or something. I think that you just could do with a few to power the message home a bit, however other than that, this is magnificent blog. An excellent read. I’ll certainly be back.
Hi, Neat post. There’s a problem with your web site in internet explorer, would test this… IE still is the market leader and a big portion of people will miss your magnificent writing due to this problem.
An interesting dialogue is price comment. I feel that it’s best to write extra on this matter, it may not be a taboo subject but generally individuals are not enough to speak on such topics. To the next. Cheers
Hi there, I found your website by way of Google even as looking for a similar topic, your website came up, it seems to be good. I have bookmarked it in my google bookmarks.
Whats Taking place i am new to this, I stumbled upon this I’ve found It absolutely useful and it has helped me out loads. I hope to contribute & aid different customers like its helped me. Great job.
Very nice post. I just stumbled upon your weblog and wanted to say that I have truly enjoyed browsing your blog posts. After all I’ll be subscribing to your rss feed and I hope you write again soon!
Hey, you used to write excellent, but the last several posts have been kinda boring?K I miss your super writings. Past few posts are just a little out of track! come on!
Hi! Someone in my Facebook group shared this website with us so I came to look it over. I’m definitely enjoying the information. I’m bookmarking and will be tweeting this to my followers! Excellent blog and great design.
Very well written story. It will be valuable to everyone who utilizes it, including yours truly :). Keep up the good work – for sure i will check out more posts.
This is very fascinating, You’re a very professional blogger. I’ve joined your feed and stay up for in quest of more of your great post. Additionally, I’ve shared your website in my social networks!
Whats Happening i’m new to this, I stumbled upon this I’ve discovered It absolutely useful and it has aided me out loads. I hope to contribute & assist other customers like its helped me. Great job.
Very interesting details you have observed, thanks for putting up.
Hello.This post was really remarkable, particularly because I was browsing for thoughts on this matter last Sunday.
you are really a good webmaster. The site loading speed is incredible. It seems that you are doing any unique trick. Also, The contents are masterwork. you have done a magnificent job on this topic!
Hey, I think your blog might be having browser compatibility issues. When I look at your blog site in Chrome, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, great blog!
Lovely website! I am loving it!! Will come back again. I am taking your feeds also
Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point. You definitely know what youre talking about, why throw away your intelligence on just posting videos to your blog when you could be giving us something enlightening to read?
certainly like your website however you need to take a look at the spelling on quite a few of your posts. Several of them are rife with spelling problems and I find it very bothersome to tell the reality however I?¦ll definitely come again again.
Would love to constantly get updated great website! .
Thanks for another magnificent article. Where else could anybody get that type of information in such an ideal way of writing? I have a presentation next week, and I am on the look for such information.
Its like you read my thoughts! You appear to grasp a lot about this, like you wrote the ebook in it or something. I believe that you just could do with a few to power the message home a bit, however instead of that, this is great blog. A great read. I’ll definitely be back.
Good day! Do you use Twitter? I’d like to follow you if that would be okay. I’m definitely enjoying your blog and look forward to new updates.
This internet site is my breathing in, very good style and design and perfect subject material.