I don't understand. You seem to think that the car can do something a human can't. Any driver hitting TULE fog immediately slows down, but as long as they're moving there's a chance they'll plow into the car in front. We just drive on, hoping the car ahead will drive on too. Stopping in the road almost guarantees you'll be rear-ended. These are all situations where a human is going to risk everything just as much as a car on autopilot will. Humans don't have radar, yet they've been navigating through these scenarios for years, vision only.
I don't think the issue is the actual vision. I would argue that with the number of cameras available, a Tesla can "see" a lot more than humans can. The challenge is how to properly interpret what is being seen and how to react accordingly to it. Sometimes we as drivers just know or feel how to reach to something as you correctly pointed out.
Until true AI exists (and I don't mean a calculated probability of events based on past events), we will not be able to reach fully autonomous driving.