FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[Acisplat]

I really just want FSD on the highway, everything else like city streets is extra for me.
NoA on these LA freeways is sometimes more hassle than it's worth just driving manually.

 

[PACEMD]

Come to think about it, Elon could have been thinking in geographic terms, in which case California to New York is wide indeed. We just don't know. No sense in splitting fibers.

Right, and remember, this new Pony Express delivery thing is still in its infancy........

 

[PVia]

I really just want FSD on the highway, everything else like city streets is extra for me.
NoA on these LA freeways is sometimes more hassle than it's worth just driving manually.

I like it in stop and go traffic, but in heavy traffic on the 10 or 134 there are usually so many tailgaters who are pissed off that you're not doing 75, it gets brutal. I took a trip to San Diego last weekend and though the traffic was heavy, I used NoA quite a bit, just disengaging when others around me were being idiots and when traffic bunched up ahead. I wish NoA would "see" red lights mounting up ahead and start to slow down a bit rather than waiting for the last few car lengths to put on the brakes.

 

[uscbucsfan]

11.3.3 out to employees

 

[willow_hiller]

11.3.3 out to employees

Looks like identical release notes to .2?

https://twitter.com/x/status/1639386123712749569

 

[JulienW]

11.3.3 out to employees

Now we need to recalibrate our waitress. Looks like we are now on rollout reset and starting over. So likely at least a couple of weeks away before we see many of us with it.

 

[Pdubs]

That’s TGC’s MO; to intentionally be as vague as possible - so he can always say he was being honest. A key trait of a true Charlatan...

You seriously disappointed me with this reply. I set this up for you SPECIFICALLY to reply to with one word.

“Hairs”.

I had to think hard about a synonym for hair and fibers was the closest I could come.

Oh I know where I went wrong. Just dawned on me if I had typed splitting hares” that would have done it.

Just ignore this text.

 

[Acisplat]

Looks like identical release notes to .2?

https://twitter.com/x/status/1639386123712749569

Looking like just undocumented bug fixes.

Would have been nice for Tesla/Elon to say a new build was coming, people have going insane (myself included) because the big Tesla fan accounts have been saying it’s just a normal rollout and 11.3.3 wasn’t coming yet, when we knew it was.

 

[jebinc]

Looking like just undocumented bug fixes.

Would have been nice for Tesla/Elon to say a new build was coming, people have going insane (myself included) because the big Tesla fan accounts have been saying it’s just a normal rollout and 11.3.3 wasn’t coming yet, when we knew it was.

TGC goes out of his way to not say anything, and when he does, he tries his hardest to be as vague as possible. True signs and behavior of a 1st class, A#1 Charlatan!

 

[Ramphex]

Come to think about it, Elon could have been thinking in geographic terms, in which case California to New York is wide indeed. We just don't know. No sense in splitting Adams.

fixed...

 

[jebinc]

fixed...

No, it’s “Adam’s”! Or “hares,” it seems!

 

[cowleggies]

Do we know the version number for the 11.3.3 build yet?

 

[RowdyMY]

Do we know the version number for the 11.3.3 build yet?

It's in the picture on Twitter.

Still on 2022.45 branch.

 

[JulienW]

Do we know the version number for the 11.3.3 build yet?

It is right there in the pic.

 

[cowleggies]

It is right there in the pic.

View attachment 921082

Sorry, was clipped out in the thumbnail. Got it.

 

[jebinc]

It's in the picture on Twitter.

Still on 2022.45 branch.

Booooo - 2022 branch.

 

[JulienW]

Booooo - 2022 branch.

Actually it is yey! While we would all LOVE a more current branch, changing at this point would mean WAY MORE testing time needed. Right now we need the "keep it simple stupid" as much as possible so we can get this thing before the heat death of the universe.

 

[Ramphex]

Booooo - 2022 branch.

Dude it's 3 months old.... come on.... it's BETA.... psshhtttt. The newest public software is like a week old, those losers wish they could get a 3 month old build!

 

[navels]

11.3.3 out to employees

Updated script:

curl -s 'https://www.teslafi.com/firmware.php' |
  grep -m 1 renderLatestUpdatesChart |
  sed 's/.*(\([^)]*\)).*/\1/' |
  jq -r '.latest_updates[] | select(.version | startswith("2022.45.")) | .total' |
  jq -s 'add'

This counts the total pending for all versions starting with 2022.45, which I use to alert me if the count increases by at least 5.

 

[RowdyMY]

Dude it's 3 months old.... come on.... it's BETA.... psshhtttt. The newest public software is like a week old, those losers wish they could get a 3 month old build!

Isn't it like 5 months old?

2022.45 would be the same exact build when he sent the 11th hour on the 11th day of the 11th month tweet.