Also, make sure that the speed limit sign is one that the car recognizes. It usually does not recognize yellow school zone speed limit signs or others that are not formatted in a particular way.
Also, could it have anything to do with the fact that AP is not made for city street driving?