What does Karpathy mean in this video at 11:45 when he says “Build a single model”?
At 12:28, he re-states it: “Train 1 model to solve all tasks”.
I think he means there is only one model/ NN that all developers are working with. There is not a driving model, sign recognition model, oject recognition model, lane recognition model that are later combined. Only one big NN. That means the training data and tests must be part of the repository and, at each check in, the entire network gets rebuilt from scratch based on the latest changes and validated against all test cases.
No post modification integration of different group's efforts.