I've read many a thread regarding AP and it's failing etc, but I persevered for the last 2 years, and thought had a handle on it's peculiarities.
Main challenge was phantom braking, learnt to watch out for bridges, passing lorries, crest's in road's, sharpish turns with oncoming traffic...