What's crazy is that with enough learning from being trained by these freak scenarios, we'll eventually be seeing reactions that actually turn an unavoidable collision for a human into a near miss for the ai.
This collision was avoidable with good and attentive driver. Notice dangerous situation on opposite lane @2 seconds into the video and starts paying careful attention, @4 seconds its obvious whats going to happen, slam the brakes/speed up/change to right lane. From watching enough dashcams on YT you could probably estimate 1/100 of similar situations ends in lucky dodge. AI has a chance of turning that ratio closer to 90/100.
I think Waymo has explicitly said it does not use learning to control the vehicle and that the learning is limited to building a model of the world around it.
I'm of two Mondays about this crash, on one hand, I would like it to be able to avoid crashes where it can, but I would also like it to not create multi-car pile ups by swerving to try and avoid a crash.