That's my experience too. I have to go out of my way to stare at the screen for several second to get the "Pay attention to the road" prompt, and single blue pulse, but that's it. I presume you have to carry on ignoring the request to actually get a lockout.I’ve had the occasional “pay attention to the road” warning when digging deeper into the navigation than I should have done, but very rarely and never to the extent of being locked out (whether for the one drive or a week).
I do 99% of my driving with Autopilot engaged so your car either has a faulty / misaligned camera, or you’re genuinely taking your eyes off the road for a significant amount of time.
It leaves me concerned about just how inattentive some people must be on AP, or even generally, that they're hitting these lockouts even once, let alone multiple times.