Yes this is extremely annoying and I notice it often. My usual drives I am not aiming for "zero intervention". I just want it to help reduce the drudgery of driving. But when I want to change lanes - I WANT TO CHANGE LANES. I don't want it to cancel my lane change just because it doesn't want...