Knightshade
Well-Known Member
No. The E2E model creates its own policy diffused implicitly across neural networks. We don't know where it is any more than someone can look into your grey goo on your head and change a specific behavior. There's no known way to "Put that stuff in". All we get is video in and control outputs out.
Of course there's put stuff in. It's the video.
If you ONLY train it on video where the car makes a full stop at a stop sign then you won't get rolling stops. That's the whole point they were making about only training against "good" drivers.
Of course this does not, as they suggested, totally eliminate the whole human labeling job- it just moves it from labeling objects in footage to labeling which clips are good driving o not.