This sounds like a problem well suited for ML, which is basically the thing most of us expect Tesla to be best at. Just throw sensor data at cases and let the situations in which certain values should get precedence manifest in the weights and biases.
I expect Waymo to be the best at it. Waymo has a bunch of sensors on their cars to provide accurate information, because they know that cameras aren't always reliable. Tesla may not be right here.
