We do quite well (well that's debatable) at L5 driving, with much less sensitive, and poorer/faulty sensors than the car already has.
Not really.
For example your eyes aren't covered in mud or slush in bad weather. Since they're inside the car.
The cameras-not so much.
Your eyes also don't fog up like the B-pillar cameras do in some weather.
Also your neck and body can move if you need better visibility around a corner than your normal seating position- the car cameras can't (which is why some FSD beta videos show the car nearly pulling into traffic to get a better view when making turns and still having issues)
I know I don't have radar which can see through fog/rain/snow, under other cars, and have eyes in the back of my head, and in my temples.
My ears also aren't very good at sonar range finding.
My brain, makes up for the deficiencies in my senses.
If I had better senses, I wouldn't need so much brain-power to make up for the poor sensor set.
Yes- when the car sensors are working well, the car absolutely should have better objective observational abilities than you in many, but not all, cases... (your eyes have much longer range and better resolution than the cameras as a contrast)
But the sensors are often not working well in bad weather and have no way to compensate for it- and no redundancy if even one camera on either side is obscured.
How does a person drive, when they can't see the road markings through the snow? Follow the leader, Follow the tracks, look at the other markers which indicate where the drivable area is. No doubt, the car can't do that yet. We also get it very wrong, much of the time in the snow, and probably just get away with it the rest of the time.
Ah, but L5 can't just "hope it gets away with it"
Too much liability.
Right now even just NoA, which is a
long long long way from L5, turns itself off in even moderate rain because the sensors can't see well enough.
In BAD rain even basic AP turns itself off sometimes.
The current sensor suite could ABSOLUTELY be good enough for L3 on the highway (which in my personal case is enough to satisfy me with the $ I spent on FSD, since that'd cover 95% of my driving and I could read a book while "driving)
It MIGHT be good enough for L4, with one of the restrictions on ODD being "No worse than light or moderate bad weather" and the car pulls itself over and parks if the weather worsens (since L4 there's no human required to take over).
If you want me to buy that it has any shot at L5 you're gonna need to add some more sensors.
The suggestions I've made in this regard are:
Rear radar (which would also enable the cross traffic alert folks always complain the car lacks)
Side-facing cameras on the front of the car (to see sideways on intersections without needing to pull partly INTO the intersection as the B-pillar cameras occasionally need too.... and also providing redundancy to the sides)
I think that'd be a minimum...
In an ideal world there'd also be a second pair of redundant rear/side facing fender cameras maybe on the rear fenders to back up the ones on the front fenders.... and maybe a couple of low-mounted fisheye cameras to offer a legit 360 parking view the car lacks HW to offer today.
(note at no point do I suggest Lidar's needed- I don't think it is- but the current suite ain't getting you better than L4 with weather restrictions)