I’ve been using AP and now NOA in my 3 for the past year. In that time I have seen significant improvements. I use it almost all the time on freeways, even on short trips. It is not perfect, and I keep at least one hand on the steering wheel and my eyes on the road, but I find that in general it works remarkably well. My wonderful spouse is usually okay with it though sometimes it alarms her.
In my opinion, passengers may be less comfortable with AP than drivers who are experienced with it because the passenger of course has no way to control the car and AP can sometimes make steering corrections that feel different to the passenger than corrections made by a human driver. That does not necessarily mean such corrections are unsafe; they are just different.
Humans resist change, and sometimes their perception of the change leads them to conclude that the change is a problem even when in reality it is simply different from what they are used to.
Those who expect AP to drive exactly like they would drive in every situation are operating under a mistaken assumption. There are plenty of lousy human drivers on the road who drift around in their lane and even cross the lane line, don’t signal, speed, tailgate, cut across multiple lanes, change lanes into other cars, and drive while talking/eating/fixing their hair. Yet a strong majority of drivers will, when asked, tell you that their driving skills are “above average”. They are operating under a delusion.
AP when used properly on controlled-access roads (e.g. freeways) is likely safer than most human drivers.
I welcome reasoned criticism of my point of view on this issue.