FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[LowlyOilBurner]

The latest version is actually doing pretty well for me with the exception of during rain. It limited my speed to the actual speed limit and had problems going around Amish buggies.

Amish buggies have been an issue for me right off of jump street. The speed limit in the rain thing is new for 11.4.4, and sucks.

 

[Electroman]

Maintaining speed limit during rain ?? Wow that’s a huge bummer. Ya right.

 

[EVNow]

It can be hard to check with the way It works now. Stops at a sign with a brick building to the left and a bush to the right. Stops at the line, creeps forward a bit, I still can't see, but I assume (hope?) It can see as it darts out with a brisk acceleration. I have my foot near the brake but I was just wondering if it can see what I can't, or it's pulling out on hopes and dreams.

The way it works it seems is, in 4.4, the car starts creeping towards the creep wall and if doesn’t see any issues will start accelerating.

Ofcourse the wall may not be at the right place and it may not perceive correctly. If you lean forward and can’t be sure crossing the road is safe as the car starts accelerating, you could disengage.

 

[LowlyOilBurner]

Maintaining speed limit during rain ?? Wow that’s a huge bummer. Ya right.

Yeah, it is.

 

[PVia]

Were you watching adjacent lanes as well? There's one new undocumented feature of 11.4.4 that I haven't seen discussed: it actively yields to cars with their turn signals on, now.

My 2022 Model 3 did this even with EAP, and did it yesterday with FSDb 11.3.6

 

[Pdubs]

V12 won’t be beta

 

[jebinc]

V12 won’t be beta

It might be.... auto wipers and headlights are still beta after nearly a decade...

 

[Knightshade]

It might be.... auto wipers and headlights are still beta after nearly a decade...

To be fair, vision auto wipers are barely 5 years old (Jan 1 2018 is when vision auto wipers rolled out)

TACC would be a better example, but still not even 7 years old (AP2 having launched end of Oct 2016).

That said- we still have to read his comment as v12 is years away for it to have any shot at being true.

 

[zazim]

The GW Parkway in DC now presents a complicated freeway construction scenario (concrete walls or pylons on both sides of the lanes) and traffic coming in the opposite direction in a reversible lane. Left to its own devices, FSD will slow down to 20 miles an hour. I find that I have to apply gentle acceleration the entire trip to keep the speed at 40 or higher. FSD appears to be working, but I get messages that the car will not brake with cruise control. It’s the start of a two-year project so hopefully it will improve.

 

[Tronguy]

The GW Parkway in DC now presents a complicated freeway construction scenario (concrete walls or pylons on both sides of the lanes) and traffic coming in the opposite direction in a reversible lane. Left to its own devices, FSD will slow down to 20 miles an hour. I find that I have to apply gentle acceleration the entire trip to keep the speed at 40 or higher. FSD appears to be working, but I get messages that the car will not brake with cruise control. It’s the start of a two-year project so hopefully it will improve.

Curious: Construction on the Garden State Parkway is always proceeded by a traffic speed limit sign to some unreasonably slow limit; typically, 45 mph on a road where the limit is supposedly 55, but everybody blows by at 65. And doesn't slow down for that sign.

When FSD sees the 45 mph sign it slows down for it. It feels like phantom braking, but it's not: It's just the car slowing down at the NHTSA-approved rate. In heavy, high-speed traffic.

So: When the car goes to 25 mph on the GW Parkway, is that in response to a construction speed limit sign? One can tell because the speed limit indicator in the Tesla changes.

 

[fasteddie7]

V12 won’t be beta

Hopefully that's the holiday update and we don't actually end up on 11.9.999 in 5 years.

 

[Pdubs]

It might be.... auto wipers and headlights are still beta after nearly a decade...

What was funny about that tweet is it was the big E in response to the holemars lemmings question, “is v12 coming out this year?” E didn’t answer it. Just said it wouldn’t be Beta.

 

[JulienW]

Hopefully that's the holiday update and we don't actually end up on 11.9.999 in 5 years.

Elon has already said there will be a 11.420.x So if 11.9.999 is 5 years then 11.420.x must be a century.

 

[fasteddie7]

Wouldn't it be something if all the errors were on purpose and Tesla was closer to removing the beta with version 12 than we think and the mistakes are to gather data on what a human would do in just in case scenarios.

 

[uscbucsfan]

Wouldn't it be something if all the errors were on purpose and Tesla was closer to removing the beta with version 12 than we think and the mistakes are to gather data on what a human would do in just in case scenarios.

Maybe the cars can actually fly, too, right?

 

[D Good]

Those of you who are still on 11.3.6, consider yourself lucky. Yes, V11.4 is an improvement toward driving itself, but lane selection is abysmal. I got 11.4.4 yesterday and took it out for a drive and it was no better at lane selection than 11.4.2 was.

 

[JulienW]

Those of you who are still on 11.3.6, consider yourself lucky. Yes, V11.4 is an improvement toward driving itself, but lane selection is abysmal. I got 11.4.4 yesterday and took it out for a drive and it was no better at lane selection than 11.4.2 was.

I have had a lot of very good drives on 11.4.2. However today was one of the worst FSD Beta drives EVER and it was all about lane selection failures OVER and OVER and OVER and OVER and OVER and ......... I finely gave up and canceled my destination so it would stay in the hell in the HOV lane and when I needed to turn went manually.

 

[D Good]

I have had a lot of very good drives on 11.4.2. However today was one of the worst FSD Beta drives EVER and it was all about lane selection failures OVER and OVER and OVER and OVER and OVER and ......... I finely gave up and canceled my destination so it would stay in the hell in the HOV lane and when I needed to turn went manually.

Yeah lane selection sucks right now.

 

[TK211X]

You can now downgrade if you unsubscribe from FSD, go to 20.4.2, subscribe and go on 20.6 (11.3.6)

 

[fasteddie7]

Maybe the cars can actually fly, too, right?

In beta at first. Possibly Three months until it’s ready, six months definitely.