Welcome to Tesla Motors Club
Discuss Tesla's Model S, Model 3, Model X, Model Y, Cybertruck, Roadster and More.
Register
This site may earn commission on affiliate links.
A few people in this thread talk about v12 as if it shares zero in common with v11. I can't believe that the NNs trained in V11 are not the same ones being used in v12, of course with code changes and some improvements.
If it's really end to end training where human driving is the primary training signal along with generative video prediction (that is what is being demoed) then no they are not the same ones at all.

The key element in any neural network training is the supervision signal. If that changes, then all sorts of things change, even if the neural architecture blocks are the same (and what works for one case doesn't necessarily work for the other so it's likely they change those too).
 
  • Like
Reactions: HitchHiker71
Tesla is identifying objects with their neural networks with rules *right now*.
Yes, that's the existing Karpathy solution on the perception side. It is trained against a large database of labelled video with human derived interpretation of 'objects', and then a rules & optimizer based policy planner is run with those features to drive the car.

That gives what we see today.

The end to end training with generative video is quite an entirely different architecture.

There’s no reason they can’t be running any of those networks in parallel with an e2e network.
Computational budget and power. They were already at the limits and gave up on the double-redundant so that each processor now does independent computation.

And even if you did---what would you do with the results of the two systems? Like how do you 'merge' one planner with another?

I’m curious how you think you know what the computational budget is, and how close Tesla is to the limit of that budget?
They are computationally limited now even after they do heavy sparsification and quantization.

How many clock cycles were freed up by eliminating all that C++ code?
The policy side likely consumed much less computation than anything neural.

How many other networks do not need to run *in series* in an end-to-end solution? Do you have a working e2e network yourself? If not you’re just making stuff up.
E2E is far away from a production form, it's an entirely new approach and major architecture.

Tesla has done things to reduce latency—one example is bypassing the signal processing of the image data coming from the camera sensors—but that is to reduce the overall delay from photons in to processing and to remove unnecessary delays that neural networks don’t need. Processing adds noise relative to the raw signal input, so there’s a benefit too.
OK that's fine, but it also shows that they are budgeting microseconds.
But you have zero evidence whatsoever that they will be at the limit of their computational budget and will be unable to have any layers running on top of the e2e network.
Whatever the 'it' is it is years away in the future. They will always try to max out the computational ability of any hardware, you can always scale each net to a size with a given budget, but bigger nets have better performance and reliability. GPT-2 sucks at writing compared to GPT-4. Rats suck at quantum mechanics compared to humans.

Maybe the system would perform beautifully with 10x the computation budget? Doing more things at once (like two simultaneous architectures) will require each one to be cut down and have lower performance.
 
Last edited:
I expect that V12 will be even more of a headache. V11 uses human coding to control the vehicle. When issues crop up they reprogram to try and correct them. With v12 and end to end AI, they can't reprogram. They have to retrain which will take much more time and effort to correct problems. It's possible that some of the persistent problems are because they are controlled partially by AI right now and they've not been able to retrain them away.
I don't know anything about AI and E2E. But can the car move without being programmed? For example the system tells the car: stop in 100 m with deceleration rate of 10 miles/sec^2, turn 13 degree in the next 10 ft, turn on a curvature of 50 ft radius with speed of 25 miles/sec,...
 
I don't know anything about AI and E2E. But can the car move without being programmed? For example the system tells the car: stop in 100 m with deceleration rate of 10 miles/sec^2, turn 13 degree in the next 10 ft, turn on a curvature of 50 ft radius with speed of 25 miles/sec,...
I'm a little concerned that my reflexes may not be able to up to dealing with 25 miles/sec when it suddenly decides to take an unexpected exit short lane?
 
But you have zero evidence whatsoever that they will be at the limit of their computational budget and will be unable to have any layers running on top of the e2e network.
While not a direct correlation, it's a pretty easy road to travel, largely based upon what Musk and others at Tesla have said, that the entire reason for Dojo is to address computational performance and budget. In essence, Tesla dumping billions into the Dojo architecture proves out exactly what we're talking about here - that there are currently limits to both computational budget and associated costs at present - and that Dojo is being built to help address the current computational and cost limitations of the E2E NN.
 
I'm frustrated by people who excuse FSD's poor performance, when for years now Tesla has been promoting FSD as already being better and safer than human drivers. That's simply not true. I don't know anybody who's not intoxicated who can't decide which of two left turn lanes to use, veering wildly between them all the while, when approaching a signal with the intent to turn left. The way things seem to be going, it may never be true. They dodge the tidal wave of lawsuits that should be drowning them by pointing to obfuscatory language in their sales contracts and what they now quietly publish around the clear limitations of FSD (hint, FSD simply isn't), but their sales and marketing departments, including Tesla's one-man version of that headed by the muskrat, continue spinning what can only be called confabulations, exaggerations, and outright lies. At some point there really should be some accountability for the company and its CEO (Chief Exaggeration Officer) after years and years of this behavior. I like my car, I really do, but this particular nonsense has to stop.
 
...And Elon's public decompensating and mandating in-office 5 days a week, and declining stock price, are not at all helpful to attract and retain these kinds of 1% employees who are stunningly talented in a hot field and stunningly recruited by employers who are nicer and pay much more.
This right here. With the CEO behaving like a decompensating mental patient, there's no way any company he leads is getting the very best talent, because that talent will go where it's more fully appreciated, rewarded, etc., without fear of having to deal with an overweening, preening, nasty, vindictive, lying blowhard.
 
This right here. With the CEO behaving like a decompensating mental patient, there's no way any company he leads is getting the very best talent, because that talent will go where it's more fully appreciated, rewarded, etc., without fear of having to deal with an overweening, preening, nasty, vindictive, lying blowhard.
Can you explain why Tesla has the market lead (beating BMW), best selling car (Model Y beating Toyota), and highest margin of any consumer EV being sold, all while having a CEO who's "overweening, preening, nasty, vindictive, and a lying blowhard"? Apparently he's doing it with substandard talent, because the very best talent isn't working there.
 
Can you explain why Tesla has the market lead (beating BMW), best selling car (Model Y beating Toyota), and highest margin of any consumer EV being sold, all while having a CEO who's "overweening, preening, nasty, vindictive, and a lying blowhard"? Apparently he's doing it with substandard talent, because the very best talent isn't working there.
Because the manufacturing and mechanical engineering talent is really good, and there aren't wealthier competitors with tons of VC capital or gobs of cash flow trying to hire them away. And dealerships of course.

And because most of the time Elon's instincts in mechanical engineering are better than in machine learning and they are following the right course in mech engineering. The power train and thermal HVAC and motor cooling are superb engineering with no downsides to the driver. The biggest fails are where Elon thinks machine learning can substitute for the hardware: rain sensors and ultrasonic.

Some of the competition's ADAS is or soon will be as good or better than basic/enhanced Autopilot right now which is what most people experience. This is a problem but management is obsessed with a false dream of L4-5 imminently instead of making a very reliable and consistent product for ADAS.

Why should I have to withstand an unreliable ADAS to get a great powertrain?

I'm seriously thinking about the BMW Neue Klasse for my next car, for less interior squeaks and groans, and also for what will probably be a decent 2/3 ADAS, I think mobileye.
 
Last edited:
Some of the competition's ADAS is or soon will be as good or better than basic/enhanced Autopilot right now which is what most people experience. This is a problem but management is obsessed with a false dream of L4-5 imminently instead of making a very reliable and consistent product for ADAS.

Why should I have to withstand an unreliable ADAS to get a great powertrain?

I'm seriously thinking about the BMW Neue Klasse for my next car, for less interior squeaks and groans, and also for what will probably be a decent 2/3 ADAS, I think mobileye.
And this will be yet another excellent lesson on how the free market works. If what you say is true for the majority of buyers, the market will shift away from Tesla and towards the competition. Tesla will then either pivot and compete, or shrink in the market and eventually fail.

I'll point to Toyota for recent decisions. Their management was adamant that Hydrogen is the future and they would not produce a BEV. And now they have 10 models announced by 2026. They bowed (pun not intended) to market pressure.
 
While not a direct correlation, it's a pretty easy road to travel, largely based upon what Musk and others at Tesla have said, that the entire reason for Dojo is to address computational performance and budget. In essence, Tesla dumping billions into the Dojo architecture proves out exactly what we're talking about here - that there are currently limits to both computational budget and associated costs at present - and that Dojo is being built to help address the current computational and cost limitations of the E2E NN.
We are talking about runtime budget on the car, not offline compute when crunching numbers to weight the neural nets.
 
We are talking about runtime budget on the car, not offline compute when crunching numbers to weight the neural nets.
It would not surprise me in the least if Tesla uses it's own processors designed specifically for the vehicles. If Tesla is going to the trouble to build it's own processor network for AI NN central processing - it's not a stretch to see Tesla design it's own vehicle processors to complement specific needs at that layer.
 
I expect that V12 will be even more of a headache. V11 uses human coding to control the vehicle. When issues crop up they reprogram to try and correct them. With v12 and end to end AI, they can't reprogram. They have to retrain which will take much more time and effort to correct problems. It's possible that some of the persistent problems are because they are controlled partially by AI right now and they've not been able to retrain them away.

If they find a problem, they might have to retrain, then it might fail some other place, then retrain again. They launch it in another region and it misbehaves there. Retrain again.
I am not sure if they can get the robustness / safety balance right, but we'll see.

bear-knee.gif
 
It would not surprise me in the least if Tesla uses it's own processors designed specifically for the vehicles. If Tesla is going to the trouble to build it's own processor network for AI NN central processing - it's not a stretch to see Tesla design it's own vehicle processors to complement specific needs at that layer.
? It did. Tesla hired Jim Keller to design its first in-car processor, and ever since then (all the way up through the current HW4) Tesla has been running their own chip design in the car.
 
I expect that V12 will be even more of a headache. V11 uses human coding to control the vehicle. When issues crop up they reprogram to try and correct them. With v12 and end to end AI, they can't reprogram. They have to retrain which will take much more time and effort to correct problems. It's possible that some of the persistent problems are because they are controlled partially by AI right now and they've not been able to retrain them away.
I was of the impression machine learning is pervasive all throughout the code and without it nobody could possible hope to actually write self-drivable code.
 
I'm frustrated by people who excuse FSD's poor performance, when for years now Tesla has been promoting FSD as already being better and safer than human drivers. That's simply not true. I don't know anybody who's not intoxicated who can't decide which of two left turn lanes to use, veering wildly between them all the while, when approaching a signal with the intent to turn left.
The systems are better at detecting fast-moving objects, particularly out of front view, than many humans, particularly at night. I like using it for freeway driving at night for this reason.
The routing and decisioning and planning is obviously worse, and it appears to be too much like the Memento movie, memoryless in short term.
Other vendors bypass this with more detailed and likely expensive curated maps.

The way things seem to be going, it may never be true. They dodge the tidal wave of lawsuits that should be drowning them by pointing to obfuscatory language in their sales contracts and what they now quietly publish around the clear limitations of FSD (hint, FSD simply isn't), but their sales and marketing departments, including Tesla's one-man version of that headed by the muskrat, continue spinning what can only be called confabulations, exaggerations, and outright lies. At some point there really should be some accountability for the company and its CEO (Chief Exaggeration Officer) after years and years of this behavior. I like my car, I really do, but this particular nonsense has to stop.
Elon has personally stated that the high stock market valuation of Telsa is entirely dependent on FSD. He really really cares about his own money so he won't ever stop hyping it.

Look at previous statements....

Musk: FSD Beta Version 10.13 Will Handle Roads With No Map Data​


Musk: Tesla FSD 9.2 Is ‘Not Great’ But Version 9.3 Is Much Better​


Specialists Say Tesla Is Further Away From Level 5 FSD Than From Mars​

 
And this will be yet another excellent lesson on how the free market works. If what you say is true for the majority of buyers, the market will shift away from Tesla and towards the competition. Tesla will then either pivot and compete, or shrink in the market and eventually fail.
With current management, pressure on margins and sales will likely lead to even more decontenting. That's the point of complaining about it before it happens.
 
  • Like
Reactions: Dracaris
With current management, pressure on margins and sales will likely lead to even more decontenting. That's the point of complaining about it before it happens.
And how is the complaining getting to current management? Surely you don't mean here on TMC. Are people submitting feedback to Tesla? Is Tesla holding focus groups to gauge reaction to potential changes? Typically, the free market is reactive, not proactive. A company makes a change to a product, and if sales decline beyond expected values, the company pivots and corrects the product (with or without feedback from the customer base - but usually with).

My point is that the market will take care of Tesla. All you can do, as a consumer, is attempt to submit your feedback directly to the company, and vote with your dollars. These forums are simply cathartic spaces to share experiences, educate people who need help, and/or commiserate with others.