If you look up the nvidia keynote from 2024, omniverse, robotics, and digital twins are discussed at length [1]. The relevant parts are near timestamp: 1 hour 34 minutes
You are probably thinking of gaea - not gaia. Gaia is also a world generator but not as widely recognised as gaea (and gaia is only implemented as a unity plugin IIRC).
The fact that this is possible feels like it says something about the universe— that there is not as much information in our environment as we think there is.
This in turn could explain the unreasonable effectiveness of brains — especially small ones like animal brains — at modeling and operating in the world.
That's a very superficial way of looking at the universe.
Existence is not limited to whether or not it's observed. Brains have evolved to only gather the minimum amount of information required to keep the organism alive in its particular environment. But there is an unfathomable amount of complexity in the universe, even in the things we _can_ perceive.
For 3D modeling specifically these details don't matter, which is why we're able to approach photorealism. The renders look good enough to fool our brains into thinking that we're looking at the object as it would appear in the real world. They're a good approximation of visual aspects, but they're far from a good representation of real world objects. We don't have nearly enough compute for that. We've only recently gained the ability to model how light behaves in the real world in real-time, and even that is an approximation.
Anyway, Infinigen looks like a cool product. It's great to see classical simulations instead of AI for a change.
>The fact that this is possible feels like it says something about the universe
Similarly, the character models in Final Fantasy 7 say something about the human endocrine system. Aeris clearly reads as human despite you not being able to see her adrenal glands so maybe they don’t exist in real life
Some questions to ML/AI researchers here on HN:
- Are there any ML/AI papers out there that trained on this? E.g. training robots in virtual environments?
- What data sets are used today in the ML/AI space to train robots?