It's not. For one thing, we've known for years only one of the two nodes can do campaign triggers at all (gathering fleet data)- they're not entirely identical you see. For another- Both Green and James Douma have confirmed it's actually them needing to cross nodes because the NN stuff can't fit on one node- not for years now.
The "cost" in terms of compute by crossing dies is high, there'd be
no reason at all to eat that cost if they had a choice.. (they'd instead run the "active" NNs on one die, and any "gathering data" code on the second die). Instead they have code using extended compute that crosses dies, and have ever since they ran out of fits-in-one-node stuff several years ago on HW3)
This isn't speculation- here's green remarking on it and also mentioning what Douma found:
again that's from over 2 years ago- the code hasn't gotten LESS intensive since, it's gotten moreso, with significantly more extended-compute request stuff (ie things it
can not run in one node and is forced to take the performance hit of crossing nodes to borrow from the other nodes NPU.)
Ultimate-
nobody knows "how much is enough" for generalized L5 driving until someone actually achieves it-- Tesla has been wrong about the answer at least 3 times now (HW2, HW2.5, and HW3- all of which they claimed were enough and clearly are not)-HW4 may be enough- it also may NOT be-- because anyone who says they know how much IS is just guessing until they actually do it.
FYI- one of the "big" deals in Dojos design was the super fast interconnects so you do NOT take the normal "this has to leave the die" penalty most stuff does- but that's no help to HW3 (or HW4 for that matter though each node has more compute than the total HW3 system had- but should they need to cross nodes there eventually they'll see the same types of cross-die performance penalties because the basic architecture hasn't changed).
Again all this has been covering, in detail, for years now, in various threads over here:
Discussion about AI, Tesla Bot, Tesla Autopilot (AP), the promise of Full Self Driving (FSD), as well as other Autonomous Vehicles.
teslamotorsclub.com
Anybody factoring FSD into their investment thesis and not current on this stuff and what's in that forum are doing themselves a great disservice simply speculating in here on stuff we already know pretty well.... (doubly so for anyone who isn't and hasn't been actively testing FSDb for a while)