FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[FSDtester#1]

If I had a nickel for everytime I saw a court document where @Ramphex and @jebinc were mentioned together in the same sentence with "full release", I would be a rich man.

Yes, this!!! I pissed myself....

 

[Ramphex]

Drive from the Best Buy back to the house was pretty good. No spill the coffee incidents, no bad lane changes, no takeovers. Let's see how it performs tomorrow during the day with more traffic around.

 

[FSDtester#1]

Drive from the Best Buy back to the house was pretty good. No spill the coffee incidents, no bad lane changes, no takeovers. Let's see how it performs tomorrow during the day with more traffic around.

The real question is did your record player skip at all?

 

[jebinc]

When @Ramphex and @jebinc are getting it, it's Full Release Baby!
Yes @PACEMD ... that is a layup for you to comment on

 

[jebinc]

If I had a nickel for everytime I saw a court document where @Ramphex and @jebinc were mentioned together in the same sentence with "full release", I would be a rich man.

That’s just “rubbish”!

 

[jebinc]

Yes, this!!! I pissed myself....

Beats a “push” accident….

 

[powertoold]

I was on the highway today and passed by an accident involving an overturned 1-800-GOT-JUNK truck. Maybe it's the beginning of the end for junk.

 

[powertoold]

It's impressive that it works at all, but every drive I intervene and save FSD Beta. Conversely it has never once managed to see something I didn't see and save me. So demonstrably it is not that unreasonable to claim that yeah, a human with two eyes can "see better" than FSD Beta.

Commentary about this:

 

[jebinc]

I was on the highway today and passed by an accident involving an overturned 1-800-GOT-JUNK truck. Maybe it's the beginning of the end for junk.

 

[BnGrm]

Well I just got 2023.7.10 / 11.4.2 and I’m a lame FSD “tester.” I use it a few times a month. So that obviously has no bearing on when you get it. Haven’t had an opportunity to test it but looking forward to reading others reactions. I was previously on 2022.45.15 I believe. Looks like this release is going to go very wide.

It does slow down around the 60% mark but finished install relatively quickly.

 

[jebinc]

Well I just got 2023.7.10 / 11.4.2 and I’m a lame FSD “tester.” I use it a few times a month. So that obviously has no bearing on when you get it. Haven’t had an opportunity to test it but looking forward to reading others reactions. I was previously on 2022.45.15 I believe. Looks like this release is going to go very wide.

It does slow down around the 60% mark but finished install relatively quickly.

I think you will find it an improvement to 11.3.6, but still problematic is some areas. L3 seems years off at this rate of sustained improvement and predictability.

Of course, and as usual, @Ramphex and @FSDtester#1 will say it’s a “mind blowing push,” like their idol, Whole Mars Catelog!

 

[rlsd]

Updating to 11.4.2 now. I got notice to download software 4 hours ago but I was out.
Also my map was updated to 2022.48 yesterday.

 

[LowlyOilBurner]

Record players and optical drives, sigh. And DAT’s….

 

[PACEMD]

Sure we have, she said to say "Hi"

Pictures or it didn't happen..........

 

[PACEMD]

The real question is did your record player skip at all?

And what's on the flip side?

 

[JHCCAZ]

Of course, and as usual, @Ramphex and @FSDtester#1 will say it’s a “mind blowing push,” like their idol, Whole Mars Catelog!

Omar groupies. FSD fanatics. What can you do?

 

[Dutchie]

Just went on a drive with the new version. Going down our street it finally did not go into the shoulder of the road turning. It finally nailed going into our street and also not going into the shoulder. It does stop awkwardly at the roundabout still.

it also disabled radar. I am now on vision only

 

[FSDtester#1]

Pictures or it didn't happen..........

You never fail to deliver Doc. Are you by chance an ob/gyn?

 

[aerodyne]

it also disabled radar. I am now on vision only

Well, if I had a '21 refresh that had not been to SvC to disconnect the radar, this would would be a deal breaker.

Does this explain why no HW4 cars on on 11.4.*?

They haven't figured out how to disable Phoenix Radar, or some engineers are plugging the dike out of fear...

 

[aerodyne]

it also disabled radar. I am now on vision only

11.4.1 or 4.2?

USS still work?