FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[SSDTester#1]

Just 1, Elon

I honestly wouldn’t be surprised if it was just 3 dudes with Elon telling them to do the wrong things

 

[FSDtester#1]

I honestly wouldn’t be surprised if it was just 3 dudes with Elon telling them to do the wrong things

Why do they always have to be dudes... that's a sexist comment and now my feelings are hurt and have to go to my safe room for 3 hours. Thanks a lot!

Where's the doc when you are in need.... paging @PACEMD

 

[SSDTester#1]

Why do they always have to be dudes... that's a sexist comment and now my feelings are hurt and have to go to my safe room for 3 hours. Thanks a lot!

Just ask a lib to report it and I’m sure Krash will come here and change it to some gender neutral word

 

[FSDtester#1]

Just ask a lib to report it and I’m sure Krash will come here and change it to some gender neutral word

Set your stopwatch ... that last one will be moved to Snippiness shortly !

 

[AlanSubie4Life]

Actually seems like they need a human-machine interface expert.

I am hopeful we’ll see some evidence of that in this release, with the car doing a better job of speaking to the driver. It’s a critical part of an L2 system and something currently lacking especially on turns and stops. Getting this sort of speed transition smooth and imperceptible (there is no reason the driver really needs to be made aware of the limit changing) is part of developing and perfecting that language.

I’m hopeful, because they have talked about making stops perceptible so they may be understanding this now (or prioritizing it…presumably they already understood it?). But it is extremely difficult to glean from videos since accelerometer displays are limited.

 

[FSDtester#1]

Actually seems like they need a human-machine interface expert.

I am hopeful we’ll see some evidence of that in this release, with the car doing a better job of speaking to the driver. It’s a critical part of an L2 system and something currently lacking especially on turns and stops. Getting this sort of speed transition smooth and imperceptible (there is no reason the driver really needs to be made aware of the limit changing) is part of developing and perfecting that language.

Alan, you on V11 yet?

 

[SSDTester#1]

Not sure if Alan has us muted or he’s just doing his own thing speaking his random thoughts lol

 

[FSDtester#1]

Not sure if Alan has us muted or he’s just doing his own thing speaking his random thoughts lol

We have been put on ignore by most a long time ago!

 

[SSDTester#1]

We have been put on ignore by most a long time ago!

I wish there was a stat in the profile to see the # of people you’re ignored by

 

[FSDtester#1]

I wish there was a stat in the profile to see the # of people you’re ignored by

If there was, you would be near the top of the list... that 2101 person probably is #1.. so you have some work to do.

 

[SSDTester#1]

If there was, you would be near the top of the list... that 2101 person probably is #1.. so you have some work to do.

I miss that guy, where’s he at?!

 

[SSDTester#1]

Paging @2101Guy
Paging @2101Guy

 

[FSDtester#1]

I miss that guy, where’s he at?!

Wouldn't know, I learned how to use the ignore button because of him

 

[SSDTester#1]

Wouldn't know, I learned how to use the ignore button because of him

I’ve never ignored anyone on here, no matter how much I might not like someone, I still want to know what they have to say

 

[FSDtester#1]

Paging @2101Guy
Paging @2101Guy

Great, now this whole page is going to Snippiness

 

[JulienW]

BACK to V11. A little funny (or sad for me and most). Installs of 10.69.25.2 have been closing in on 11.3.2 and today thay are on parody. Feels almost like we are backing up.

 

[LowlyOilBurner]

How’s the jerk profile on slowdowns due to limit changes?

Is it the standard extremely high jerk Tesla response from AP team, or do they actually phase the deceleration in (and out) like they are easily capable of doing, as demonstrated in other scenarios?

I’m hoping the slowdowns are substantial prompt and minimally perceptible. A very reasonable ask and fairly trivial I think.

The adjustments to changes in speed limits are as they should be, except when it blatantly ignores 45mph signs and reverts to 25mph.

 

[SSDTester#1]

BACK to V11. A little funny (or sad for me and most). Installs of 10.69.25.2 have been closing in on 11.3.2 and today thay are on parody. Feels almost like we are backing up.

View attachment 920668

BACK to unrelated content. Alright, I got nothing right now, just wanted to say that.

 

[FSDtester#1]

BACK to unrelated content. Alright, I got nothing right now, just wanted to say that.

So pretty much like most of your posts

 

[AlanSubie4Life]

Alan, you on V11 yet?

Nope. Otherwise I would not be asking about this.

adjustments to changes in speed limits are as they should be,

Cool, so buttery smooth you don’t even know they are happening! Great to hear.