FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[jeremymc7]

I'm still waiting for a CCS1 charge module retrofit almost a year and a half since I took delivery. That's for one little circuit card.

I’m sure you want to do this the right way and though official (warrantied) changes but I thought there were also several self service options if needed, UNOFFICIALLY.

 

[powertoold]

True single stack = smart summon, city streets, and highway run the fsd stack

Initial release of 11.3 likely won't include ASS (assuming this is running on the fsd stack), so it won't be the true single stack.

But for our intents and purposes, city streets and highway on fsd is single stacky enough.

 

[JulienW]

True single stack = smart summon, city streets, and highway run the fsd stack

Initial release of 11.3 likely won't include ASS (assuming this is running on the fsd stack), so it won't be the true single stack.

But for our intents and purposes, city streets and highway on fsd is single stacky enough.

Oddly Elon didn't use one of his usual wiggle room qualifiers like "should" or "expect' but actually said "definitely" for Single Stack on V11. Of course this is almost prehistory now.

 

[Madmolecule]

It’s not like he’s saying are internal testers have been using the latest version, on single stack, and it is amazing. We should be rolling it out as a product soon. Should be getting to the regulatory folks this qtr for approval.
It sounds more like they are saying we are starting to program it with the neural networks and it has lots of promise. Buy stock now before this game changer competition crushing checkmate software is released. Will somebody write the single stack song

 

[GlmnAlyAirCar]

It’s not like he’s saying are internal testers have been using the latest version, on single stack, and it is amazing. We should be rolling it out as a product soon. Should be getting to the regulatory folks this qtr for approval.
It sounds more like they are saying we are starting to program it with the neural networks and it has lots of promise. Buy stock now before this game changer competition crushing checkmate software is released. Will somebody write the single stack song

Do you think the track might bend?

 

[eli_]

I wonder which version will have single-stack with highway, parking lots, plus cooking and cleaning (Tesla Bot).

 

[TenKOhms]

I’m sure you want to do this the right way and though official (warrantied) changes but I thought there were also several self service options if needed, UNOFFICIALLY.

Off topic but yes you can DIY the retrofit yourself in about 15 minutes. You can pick up the new charging board from a service center (Р1537264 - 00 - B) then all you’ll need is a “bundle of wires” harness.

 

[Supcom]

Off topic but yes you can DIY the retrofit yourself in about 15 minutes. You can pick up the new charging board from a service center (Р1537264 - 00 - B) then all you’ll need is a “bundle of wires” harness.

If I had a great need to try to find a functioning CCS charger, I'd do the retrofit myself, but I'm in no hurry. My point was that, despite Tesla having made a fairly limited number of cars without the CCS charge module, appointments for retrofits are taking a long time. So, extrapolating that to large numbers of FSD cars that potentially would be eligible for a HW4 update, we may be discussing HW5 by the time they all get upgraded.

 

[Scott Chapman]

Looks like 10.69.25.2 is now going out more broadly. I assume no one thinks this is actually V11?

 

[JulienW]

Looks like 10.69.25.2 is now going out more broadly. I assume no one thinks this is actually V11?

Anyone who assumes or thinks 10=11 is obtuse and I have a bridge to sell them.

 

[Gbills]

Anyone who assumes or thinks 10=11 is obtuse and I have a bridge to sell

I’m sure he appreciated your informative post and the likes that went with them.

 

[boonedocks]

You can’t make this up:

https://twitter.com/x/status/1615880034950205440

 

[dramsey]

If this were the case, one would expect that Elon wouldn’t be tweeting about much sooner releases.

Then again: Elon.

 

[Mardak]

There's probably some hardcoded control behaviors that were added to be safe/conservative such as slowing down to 0 when one of multiple overlapping roads has an intersection

Here's an example from DirtyTesla today testing 10.69.25.2 with FSD Beta still wanting to slow down on a bridge potentially for the intersection below:

Notice the visualization shows a lighter blue line next to the speed limit sign indicating it wants to stop there. Google Street View helpfully shows an immediately adjacent Carey St with a stop sign for Depot St intersection very close to the bridge with the speed limit sign above:

Hopefully @DirtyT3sla will be able to test it if getting FSD Beta 11.x before the rest of us to see if neural networks for "control" makes any difference.

 

[BobDolesGhost]

I get more and more anxious for V11 for something different. I haven't observed FSD improve or even behave differently for about 6 months or more. Primary 2 gripes have always been that making turns is as spastic jerky as if South Park's Tweek is driving and that it makes drug addled retard teenager lane choices

 

[kriskros91]

Maybe V11 will be the first 2023.x.x branch - that would be exciting.

 

[JulienW]

Maybe V11 will be the first 2023.x.x branch - that would be exciting.

With enough "in two weeks" announcements it could be 23.48.x. That doesn't sound so exciting.

 

[EVNow]

I get more and more anxious for V11 for something different. I haven't observed FSD improve or even behave differently for about 6 months or more. Primary 2 gripes have always been that making turns is as spastic jerky as if South Park's Tweek is driving and that it makes drug addled retard teenager lane choices

I think thats an exaggeration. Definitely seen a lot of improvements over the last 6 months - including ULT. After CULT, all ULTs are way better, for eg.

6 months back I used to have disengagements on a ULT out of my neighborhood on a 2 lane street (one each way) @ 25 mph

 

[jj3884]

I think thats an exaggeration. Definitely seen a lot of improvements over the last 6 months - including ULT. After CULT, all ULTs are way better, for eg.

I think I'll give v11 a chance with the tweet about NN being involved in control/driving inputs and path planning, but if there isn't an improvement in at least the control aspect in the first beta release I'll tap out for awhile.

 

[EVNow]

I think I'll give v11 a chance with the tweet about NN being involved in control/driving inputs and path planning, but if there isn't an improvement in at least the control aspect in the first beta release I'll tap out for awhile.

I can "assure" you there won't be a big improvement. I just hope there won't be many regressions.