Since it seems to be theme here, and maybe Tesla is counting...
My spouse also is less comfortable as a passenger when I'm using Autopilot than when I'm driving myself.
This is for many reasons - the big one is phantom braking, but also the not-smooth starts and stop, the darting towards the guardrail on exits, the swerving around in the lane position based on small changes in road type, markings, or exit/entry ramps, the abrupt speed-up when changing lanes, etc.
Through it's actions and inactions, Autopilot does not make passengers feel confident in it, and Tesla really needs to fix that. I do think it's possible with further refinements to the algorithms, but it needs to include human factors teams that understand how system behaviors lead to user confidence. I could make a list of some changes that would help, if I felt like they would improve the implementation. But anytime Tesla talks about complaints they say they don't need input -- they know what needs improving, but then don't do it. Here's a super simple one: When you override Autosteer by steering, the system should not "let go" all at once, but rather over a short period of time (just a fraction of second). The current system fights you and fights you and then let's go like an upset child. The causes a lurch, and the passenger feels it. No driver, regardless of skill, can use the wheel to disengage without the lurch. The software could easily make that better, and passengers won't feel like the driver and the car are not getting along.
I don't claim to be a perfect driver, but I do try to give a nice smooth, safe ride that might rival that of a good car service. A passenger should be able to read a book or use their phone without feeling nervous or in any kind of danger.
She actually has a sliding scale that costs me a glass of wine for a small startling event (like darting towards a guardrail) to a whole bottle for something major (like a big phantom braking event on a highway in traffic -- there was also some swearing for that one).
You might laugh, but Tesla is going to lose new sales and replacement/upgrade sales if people don't like being a passenger in the car. Most car buying decisions need some level of spouse approval.