Well, since we live in different locations and different commutes in different road ways, here is my experience with AP legit "Phantom Braking" as you describe it to be:
1. Road construction where it was a normal road (60kph) and the highway is being expanded into that space (geo tagged as 60 zone).
2. There's a bump in the road and the radar thinks there's something there.
Both of these situations occur on roads I've very familiar with as it's on the commute. I don't have any issues with engaging AP as I know when to add in some throttle.
Each driver have their own style and risk profiles, I'm okay with AP, you're not. Nothing wrong with that. You do what you need to do to feel safe behind the wheel. Have fun and enjoy the car