Thank you all for your responses! Some have been quite comical.
The overwhelming answer is obviously to not trust it without watching.
Do you guys think that this will get better once the FSD features start rolling out and the car is able to use all of it's sensors?
Technically you can never trust it even with FSD. As we saw this year there was a bad update that ended up killing a driver of a model X even thought Autopilot had safely navigated the same stretch of highway 85,000 times before