lack of problem identification (which you need to know in order to design an effective neural net).
Even that's not always necessary, see
unsupervised learning.
Besides the image identification and a few other aspects which are simply labeled by humans, the driving itself is learned from watching humans plus simulated trial and error using reinforcement learning.
The "algorithms" meaning the weights of the DNNs are generated by the machine learning process and go into the final product. Any algorithm used to manipulate images is not necessarily needed in the final product.
Here's a pretty decent write up on some common self-driving misconceptions
Top misconceptions of autonomous cars and self-driving vehicles | Driverless car market watch
Consider a teenage driver, you make them read a book on some laws and safe practices but that same book doesn't necessarily tell them what to do in every circumstance. There are only a few basic rules which are location/government dependent. After they get their license then they learn by doing and observing others. Teens make mistakes and either correct them or Darwin catches up to them. This make the teens left living better drivers. The more miles they drive the more situations they encounter and the more reinforcement they get and they become even better.
The teen uses his sensors (eyes, ears, fluid in the inner ears, and sense of touch) and his DNN (brain made up of smaller neural networks that specialize in certain tasks) to interpret the sensor data and respond accordingly. Besides reading that drivers manual and maybe getting yelled at by an adult a few times the human brain doesn't need to be "programmed" in the traditional sense. Is it silly that a teen can handle all driving tasks by his black-box neural net? At first yes, of course, it's a teen, but with time and experience that black-box neural net can become a decent, if not great, driver.
An artificial dnn is not nearly as advanced as the human brain so it needs a lot more real world data. Once it has this, then it's only a matter of showing it's statistically safer than a human and having regulators make a decision on the matter.
Tesla has already shown they are leaders in the Level 2 dept. compared to volvo, mercedes, etc. Google is not going to sell cars, Uber's self driving cars are not for sale either. There is no one selling cars in the level 4/5 space until next year when Volvo starts selling a few Drive PX 2 powered cars.
In the machine learning world those who collect the most data are in the best shape. The current best neural net designs for recognition are pretty well defined in academic circles. Tesla can even iterate through custom designs quickly with enough computing power.
In the end we will only truly know they are a leader in level 4/5 tech and/or DNNs when they release statistical data to the government late next year. They are, however, first to market with the full hardware suite in a production vehicle.