George Hotz manages to run his 3 camera input end-to-end NN on a mobile phone CPU (Qualcomm Snapdragon 845 for crying out loud) and drive to the nearest Taco Bell. So I highly doubt these "experts" who say that Tesla FSDBeta cannot run on one node.
It's not them "saying" it- it's them having actually modeled and measured and observed the actual code and behavior. It's not an opinion- it's a fact. The current (and for the past 2+ years) code
can not run on one node and has been (in fact, not in guesswork) using extended compute (ie cross-node and all the performance penalty that entails because they had no other choice) all that time.
Again this has been covered, exhaustively, in the proper forum for it- it's baffling people keep throwing out random "I don't believe this thing I've read like 2 total paragraphs about ever no matter how many facts I'm unaware of prove it" in this thread when there's a wealth of knowledge available on it elsewhere if you actually care to avail yourself of it. Doubly so when it's such an important part of many folks future valuation models.
Also it should've been clear from just the Douma/Green cites- but it's specifically the NNs that are having this issue- which as a couple folks pointed out run on the NPUs not the CPUs... so getting rid of C code that was hitting the CPUs not only won't help this problem, the fact they're moving that work to NNs means the out-of-compute-for-NNs single node issue will be
worse with that transition. (It might well improve the systems capabilities of course, but at cost of being even less able to ever fit back in a single node)
Not saying FSD computer didn't run out of compute 2 years ago, but this back and forth doesn't really matter as they optimize how they utilize their resources and have IMPROVED FSDB drastically over the last 2 years.
It does matter in terms of it ever being capable of robotaxi on HW3 though- because they need redundancy to do that and that's not possible in those constraints.
"The code is now more compute intensive today" implies that FSDb would be underperforming as it's being choked by the hardware that was obsolete 2 years ago but this is simply not the case.
It doesn't imply that at all.
It implies it was choked by ONE NODE, and they've made all those gains by using cross-node compute.
Which is great for improving things overall- and when they port that to HW4 and it all fits back in 1 node again that's great... But it implies it's never going to be redundant on HW3 cars. And since the system is still missing entire sections of capability needed for L3 or higher we've no idea if adding those eventually will push it beyond single-node on HW4 either. Nobody knows that yet because they haven't done it yet. We DO know it can't be done single-node on 3 though.
Performance drastically decrease if there's a severe bottleneck in the hardware as it runs out of resources. When a game runs out of Vram by 10%, frame rate drops to single digits...it doesn't just slow down by 10%, but by 95%. So if current code requires 120% of what the FSD computer can give, then FSDB wouldn't even work. It doesn't work @80% until there's enough compute in HW4 to make up the difference.
You're conflating traditional compute with NN compute. They're...very different as others have suggested.
On top of that, there's videos now showing the camera inputs from HW3 vs HW4... keep in mind today FSDb
can not read most signs beyond a very few large highly legible ones like standard speed, stop, and yield.... There's like 100 traffic control signs a driver needs to be able to read and obey in the federal manual- Tesla does like 3 of the 100 today. To ever operate L3 or higher it'll need to do all of them that might be encountered in whatever ODD they set. The footage makes it even clearer how many smaller (but needed to drive at L3 or above) signs are illegible with the HW3 cams- but clearly visible in the high res HW4 ones--- so that'll be another limitation but one you haven't seen yet because they haven't bothered addressing this capability with the HW3 cams that can't really do it properly anyway.
Anyway- markets open in a few minutes- again there's a world of info folks seem unaware of over here:
Discussion about AI, Tesla Bot, Tesla Autopilot (AP), the promise of Full Self Driving (FSD), as well as other Autonomous Vehicles.
teslamotorsclub.com