FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[thewishmaster]

400+ pending on teslafi. Hopefully rolls out to the rest of us soon.

 

[Pdubs]

This thread devolved into meaningless banter between folks that are waiting for 11.3.2!

Where is it already??

Conversation always drops to the lowest common denominator.

In most cases, that is me. In this case, I have a lot of help.

 

[Pdubs]

That and my vibrating Plaid!!!

Nothing new here. Old girlfriend of mine had one of those in the 80's. (not the sheriffs daughter)

But I'm not judging.

 

[Pdubs]

Oh yeah. But I don’t even have to pay any attention because it’s fully self driving.

Is it out? I haven’t driven my Tesla in a couple days so don’t know if I got an update.

Your sig. I think one of his other quotes is more fitting for how I feel about FSD.

"...Buy the ticket, take the ride."

 

[Sameer]

Installing 11.3.3 right now. Seems like a small patch on 11.3.2.

Will try it in a couple of hours. 11.3.2 was already so good. No phantom breaking, more assertive turns on unprotected roads, more confident.. let's see.

 

[JulienW]

Installing 11.3.3 right now. Seems like a small patch on 11.3.2....

Hope it is ONLY about the UI display partial crashes. This would likely make it a quicker to test update and hopefully it will start rolling to more people soon after all the 11.3.2 people get it.

 

[JulienW]

More like 4+ months….

Keep in mind while a ways back it is only 2 versions behind. Since 22.45.x only 23.2.x and 23.6.x have been released.

Again not my choice BUT it is where we are so lets get it this done. Then the day after we instal 11.3.3 we can start bitching about Tesla needed to bring 11.4.x to a more current branch. Maybe even 23.10.x.

Also my friends Lexus is still on 84 month old firmware and it is the most current version available.

 

[LowlyOilBurner]

Installing 11.3.3 now as well. Funny, I had no issues with the UI or crashing on 11.3.2?

 

[Chris_1856]

Whomever is in control of pushing the versions for my area is always asleep at the wheel (hope THEIR FSD is up to date).

Still @ 10.69.25.2 2022.44.30.10, NA-2022.28.14046

 

[kylinblue]

Whomever is in control of pushing the versions for my area is always asleep at the wheel (hope THEIR FSD is up to date).

Still @ 10.69.25.2 2022.44.30.10, NA-2022.28.14046

So far the 1133 push is only to the existing 1132 cars.

 

[archae86]

Hope it is ONLY about the UI display partial crashes. This would likely make it a quicker to test update and hopefully it will start rolling to more people soon after all the 11.3.2 people get it.

My model Y got 11.3.2 in the first (and only) big push Sunday late night Monday early morning. It was offered 11.3.3 just after midnight this morning, and I'm installing it now. I have a different guess as to a possible motivation for pushing on to a next version instead of just broadening. 11.3.2 was far more inclined to push itself into pretty tight traffic availability at situations such as an intersection with counter-streams of traffic than before. While it is likely that it had correctly computed that it had enough room to "make it" if all went well and vigorous acceleration was used I thought it rude to other traffic and lacked confidence it would complete the maneuver enough that I disengaged about four times for this alone. For at least two of these I filed voice reports.

If my experience was remotely typical, they may have judged that owners were too uncomfortable with that behavior to just let us get used to it. Maybe they even thought it something of a hazard.

 

[zoomer0056]

I filed voice reports

How is a voice report filed?

 

[archae86]

How is a voice report filed?

On 11.3.2 (and never before) any disengagement is immediately followed by an annunciation in the lower left of the left screen. It reads something similar to "you just disengaged. Do you want to tell us why? Press the voice input button now and say something short if you wish"
Then if you press the button you see a count-down of your allocated ten seconds, and an annunciation asking you to press the voice button again if you are finished early.
Lastly there is an annunciation of "Report sent".

All of my text claims are approximate only.

The challenge is that commonly immediately after a disengagement one can be a bit "busy" and composing a thoughtful and accurate report instantly is a bit challenging. Nevertheless, I think it a good system. The biggest criticism might be that it could be a contribution to distracted driving in particularly dangerous situations. For that reason they may withdraw it soon, I guess.

 

[Scott Chapman]

So far the 1133 push is only to the existing 1132 cars.

Yea, so that means to me that they did find something specific and fixable (they moved pretty quickly to do so). I suspect now they will be looking for some evidence that whatever the issue was is now resolved before considering moving forward. Might not take terribly long since it seems like they discovered the problem pretty quickly.

I assume this is all done by the telemetry they get from the fleet itself and not anecdotal feedback they might get from posts made by users?

 

[jebinc]

Installing 11.3.3 now as well. Funny, I had no issues with the UI or crashing on 11.3.2?

But will you now? That’s the operative question!

 

[willow_hiller]

When 11.3.3 will brake for a rabbit, I'd like to see Dan O'Dowd try and fool it with a baby doll:

https://twitter.com/x/status/1639551347988090881

 

[FSDtester#1]

When 11.3.3 will brake for a rabbit, I'd like to see Dan O'Dowd try and fool it with a baby doll:

https://twitter.com/x/status/1639551347988090881

Impressive, can avoid a rabbit? Now I know what to expect when wife is in the road pulling into house.
Maybe skip this update?

 

[TK211X]

If current trend doesn’t drop dead by Monday then we should see a truly wide release unless they decide to make another version change for the USS-less vehicles.

 

[TK211X]

Ideally they merge Main and FSDb into like “2023.11.x” or something and go from there with the only special versions being factory builds and very specific vehicles.

 

[EVNow]

When 11.3.3 will brake for a rabbit, I'd like to see Dan O'Dowd try and fool it with a baby doll:

https://twitter.com/x/status/1639551347988090881

As usual FSD slows down after going past the spot !

Happens with pedestrians too ... when there are a lot of people, FSD will pass a spot even as someone is stepping on to the road (pedestrian would be doing that after seeing the car pass) and then FSD will freak out and stop blocking the pedestrian.