You have described level 3 and above which Tesla aren't at.My own take (independent of regulations in place) is: if you don’t have any control over the steering and movement of the vehicle while it performs an automated task, and not prompted to “take back control” you shouldn’t be held accountable….
Level 1 and 2 are different, the driver needs to pay attention and take over when/if they feel the car's autonomous system is doing something wrong.
Your mindset is part of the reason the regulators are concerned, your expectation is out of line with the reality.