I've had my M3 for just over two weeks, driven over 1k miles since then with over 60% of that being on Autopilot.
No major issues at all, I think I've had about 4 slight slowdowns (~3mph) but they were all in areas where it made sense.
Happened 3 times when a junction joined the dual carriage way, and once when a car infront indicated left to pull infront of a truck beside me. (It looked to me like AP saw the indicators reflecting off the side of the truck and though that the truck was about to move into my lane)
It's also worked perfectly in pretty heavy rain and fog.
I wonder if recalibrating the cameras on the cars where AP isn't working properly would help fix the issue?
Also, how far is your follow distance generally? Mine is usually around 4-5 unless traffic is going pretty slow and then I'll have it lower.