How big is the space of possible things a car can encounter?

It’s practically infinite, your domain is 3D space and time

You can’t just generate every possible scenario

That would be a combinatorially insane amount of data