FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[sleepydoc]

I drive daily a route where a traffic light was replaced with an overpass about a year ago.

In FSDb the vehicle will display a "stopping for traffic control in 600/500/400 ft etc" until I tap the accelerator.

When I transit the same interchange on TACC it will display a red "stop line" until I tap the accelerator and then it changes to green, but is still present.

There are no markings on the road and the signal is completely gone - overpass is up and over.

Behavior is unchanged wether or not it is following or lead.

In this case, it is clearly using map data that hasn't been updated. Works the same both directions.

as a converse (inverse?) example, they put up some temporary stop signs on a road near me that had increased construction detour traffic. They were huge - about 4 feet across so people wouldn't miss them and FSD would visualize them but either not stop or wait until the very last minute then slam on the brakes. It was clearly trusting it's map 'memory' over what it's cameras were giving it.

OTOH, speed limit signs seem to have gone back and forth. Previously it seemed to rely almost exclusively on map data, now it does the reverse. The problem is it often misses signs and doesn't speed up or slow down appropriately.

 

[sleepydoc]

Nope. A few mins of that gives the flavor. Plus I watched another of his videos and his motto could be safe driving isn't as important as getting there.

isn't that the motto of everyone in NYC?

 

[jebinc]

11.4.8.1 seems like it's pretty much dead, my guess is they're working on some bugfix and roll it into the holiday release. I just want my single pull to engage FSDb.

View attachment 998555

8.1.1 on a 2023.27.25FU Holiday Update branch.... Let's hope not, but I wouldn't put it past them...

 

[jebinc]

Man, do you guys really watch these hour long videos of people driving around?

No. I only watch "Black Tesla," because he has an S, tells it pretty straight, and whose runs are the same 9 minute run every time.

 

[EVNow]

11.4.8.1 seems like it's pretty much dead, my guess is they're working on some bugfix and roll it into the holiday release. I just want my single pull to engage FSDb.

View attachment 998555

Its possible they are happy with it - but will rollout with the holiday release to everyone in ... 2 weeks !

 

[Supcom]

Its possible they are happy with it - but will rollout with the holiday release to everyone in ... 2 weeks !

I'm expecting the holiday update for those on 11.4.8.1 may come with 11.4.8.2 with added left turn lane usage and even more dry wipes.

It's all part of a cunning plan to increase dissatisfaction with FSDb 11.x to guarantee FSD12.x will be an improvement.

 

[EVNow]

I'm expecting the holiday update for those on 11.4.8.1 may come with 11.4.8.2 with added left turn lane usage and even more dry wipes.

It's all part of a cunning plan to increase dissatisfaction with FSDb 11.x to guarantee FSD12.x will be an improvement.

Holiday update will be 11.4.8.25 or 11.4.25.

 

[aronth5]

Holiday update will be 11.4.8.25 or 11.4.25.

And for HW4 cars is everyone just assuming FSD 11.4.4 with a holiday build?

 

[Supcom]

And for HW4 cars is everyone just assuming FSD 11.4.4 with a holiday build?

That is a good question. There has been no hints regarding what version FSD will go to the production branch.

If Tesla believes that V12 will be out in the next month or two, then perhaps it would be best not to release a newer version at this time. The latest version of FSD isn't all that much better than 11.4.4, and is, in some ways (wipers, lane selection) worse.

 

[EVNow]

And for HW4 cars is everyone just assuming FSD 11.4.4 with a holiday build?

If they can’t fix wipers, they won’t release version to main branch.

 

[fasteddie7]

And for HW4 cars is everyone just assuming FSD 11.4.4 with a holiday build?

I hope not since a few of us are on 11.4.7.3. Hopefully there’s a build for us.

 

[aronth5]

I hope not since a few of us are on 11.4.7.3. Hopefully there’s a build for us.

You're an outlier so I wasn't referring to the few HW4 cars with 11.4.7x builds. I'm sure there will be a build for you since you're clearly a special group.

 

[kabin]

isn't that the motto of everyone in NYC?

Yes as well as singing 'staying alive' while taking mass transit.

 

[jebinc]

Holiday update will be 11.4.8.25 or 11.4.25.

But. What. Firmware. Branch?

 

[JulienW]

But. What. Firmware. Branch?

23.44.25.x

 

[jebinc]

23.44.25.x

For non FSD junkers, I believe.... but for the junkers, I'm dubious.

 

[JulienW]

For non FSD junkers, I believe.... but for the junkers, I'm dubious.

 

[jebinc]

View attachment 998765


View attachment 998764

Not sure how a 2021 holiday release note screen would give us confidence. Of course us junkers will get a holiday release, but what version of FSDj and on what firmware branch will it come? It "should be" 2023.44.25 (or .26), but who knows (when we will get working wipers...)?!

 

[JulienW]

I predict: 23.44.25.4/11.4.8.25 for "Early Access" or 23.44.25.3/11.4.4.25 for everyone else.

 

[jebinc]

I predict: 23.44.25.4/11.4.8.25 for "Early Access" or 23.44.25.3/11.4.4.25 for everyone else.