GPTs are stuck in the ‘world of words’, it's almost a word game, and the same principle for images. It will never, at least in its current iteration, ever write a new scientific paper or contribute anything new. Samo.

How does Google get its robot cars to drive? It produces an extremely detailed, laborious digital map. Other than the collision sensors, Waymo cars are driving in a halucination of SF, it's just that that VR is painstakingly kept 1-to-1 matching the world.