Tesla is going to see an explosion of training signal as the FSD Beta gets pushed fleet-wide.
First, this will enhance data curation: when a disengagement occurs, there is a high probability that the sensors or vector space representations show a novel training example that can be added to a training set.
Second, this will increase data labelling: when a disengagement occurs, the driver's subsequent behaviour gives a lot of signal about what are the correct predictions the neural networks should have made. This applies to both perception and planning.
There are a few ways (at least in theory) to collect useful data passively, without a driving automation system being engaged. But nothing beats a driving robot actually acting in the world, under human guidance.
The work falls on the AI team to build the data curation and labelling pipelines to make efficient and scalable use of this firehose of novel training examples and accompanying training signal from human drivers. I believe it is rocket science to do so (it isn't a foolproof task), but rocket science is something the Tesla AI team is capable of.
First, this will enhance data curation: when a disengagement occurs, there is a high probability that the sensors or vector space representations show a novel training example that can be added to a training set.
Second, this will increase data labelling: when a disengagement occurs, the driver's subsequent behaviour gives a lot of signal about what are the correct predictions the neural networks should have made. This applies to both perception and planning.
There are a few ways (at least in theory) to collect useful data passively, without a driving automation system being engaged. But nothing beats a driving robot actually acting in the world, under human guidance.
The work falls on the AI team to build the data curation and labelling pipelines to make efficient and scalable use of this firehose of novel training examples and accompanying training signal from human drivers. I believe it is rocket science to do so (it isn't a foolproof task), but rocket science is something the Tesla AI team is capable of.
