Wicket
Member
Elon’s tweet this AM regarding 9.2 updates. Nice technical look at what’s happening behind the scenes. He also commented on button (wide release) happening with 10.1. Next beta updates he stated are 9.3, 9.4, then jump to 10 with major architecture changes. So if 2 week timeline for each, then 10.1 is closer to roughly 2+ months. Fingers crossed.
View attachment 696855
I spent a good couple years tinkering with NNs back about 10 years ago. The above might send me down the rabbithole of how they are pulling off Int8 math these days. Back in the 'old days' when you had to multiply two numbers uphill both ways in the snow they tended to be at least 32 bit floats which were always sufficient (and thus probably too much) but 8 bits doesn't give you much to work with. Premature optimization is a major trap for engineering minds. Elon talks about this in general for all engineering in his recent Starbase tour video. If they are adding mitigation efforts just now then clearly the optimization hasn't come for free. Would be delightful if a chunk of the presentation is on this since it relates a lot to the custom hardware on both Dojo/car and represents a 'real-world' optimization that doesn't necessarily exist in academic work.