That is a good point, because normally you don’t need to worry, that cars without drivers start to move by themselves.Yes, it's probably just as difficult. However the speeds are very low so it should be possible to just not run into anything.
The scenario I'm worried about is a kid or stroller right next to a front wheel. Will that be picked up by the pillar side cameras and will the NN be able to recognize it?