I wouldn't mind as much if it (a) actually engaged only when the driver was being unsafe, and (b) was easy enough to get rid of.
The problem, for one, is that Autopilot is complete *sugar* at detecting when your hands are actually *on* the wheel. And if it starts to miss you, yanking the wheel is...