FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[JB47394]

I was shocked to see how low used Tesla's are going for this week. Even just a few months ago they were WAY higher. The value has dropped significantly more than the price drops / rebates.

It's a rising interest rate environment.

 

[EVNow]

Odds we’ll see any updates pushed this weekend? I know “Elon time” was bad before but everything about his v11 timelines seem particularly terrible.

When Elon says "this weekend" .... it means
- The "plan" is to "release" this weekend
- Assuming the quality goals are met
- Release goes to distribution servers
- The Release is distributed in batches according to the plan

It does not mean
- Everyone here (or anyone) would get the release this weekend

 

[black knight 3]

I agree with this. Even with freeway AP I am attentive and often enabling/disabling it to get around known tricky situations. Rarely on a short 10 minute drive do I just let it do it’s thing. There’s always something…need a faster lane change, a known phantom break is going to happen. So for me, FSD on the streets is similar - disengage at this turn because it’s not ideal, disengage here because of a speed bump ( I take them a lot slower than 17mph), etc. it’s fun, but I can empathize with folks who see that things like hw4 may obsolete/limit hw3.

it's not an end state and FSD is always in continuous beta development. HW5 may possibly come out in the next 2 years and obsolete/limit HW4. I don't think we will see L4 autonomy happening under HW4. It's going to take some time.. a long time.... Upon hindsight, it would have been smarter to do the subscription rather than paying for FSD.

 

[kabin]

I agree with this. Even with freeway AP I am attentive and often enabling/disabling it to get around known tricky situations. Rarely on a short 10 minute drive do I just let it do it’s thing. There’s always something…need a faster lane change, a known phantom break is going to happen. So for me, FSD on the streets is similar - disengage at this turn because it’s not ideal, disengage here because of a speed bump ( I take them a lot slower than 17mph), etc. it’s fun, but I can empathize with folks who see that things like hw4 may obsolete/limit hw3.

Yes. I imagine many use FSD this way for comfort, to avoid traffic, busy intersections and FSD issues. It should also skew FSD's accident/mile stat to a more favorable direction.

 

[sleepydoc]

Not to mention the value of all of our cars has been killed with these price cuts...
So Hw3 better gitter done!

Are you blaming Tesla for the market or were you just foolish enough to think a car would be a profitable investment?

 

[Pdubs]

Are you blaming Tesla for the market or were you just foolish enough to think a car would be a profitable investment?

What a snippy little comment.

 

[kabin]

Anyone know if Tesla resets/randomizes all NN weights prior to training or are there short cuts? I always assumed it was the prior in order to optimally capture and weigh new data/scenarios.

In any event gotta wonder how long it takes to optimally train this NN behemoth.

 

[FSDtester#1]

Are you blaming Tesla for the market or were you just foolish enough to think a car would be a profitable investment?

Sleepy is right, I am a fool. But yall already knew that !

 

[FSDtester#1]

I will call it now... V11 is going out tonight to everyone.
Told you I was a fool!

 

[sleepydoc]

What a snippy little comment.

you think Tesla should price their cars based on someone's goal for resale value rather than what the market dictates?

There's an entire thread on this and it baffles me how anyone can legitimately expect to do anything but lose money on a car.

 

[FSDtester#1]

you think Tesla should price their cars based on someone's goal for resale value rather than what the market dictates?

There's an entire thread on this and it baffles me how anyone can legitimately expect to do anything but lose money on a car.

Sleepy loves me and I was being a whiney Lil ....!
We want Tesla to sell as many cars as possible at whatever price they can get.
They will always bring a nice net profit margin
More Tesla's on the road more NN training

 

[Buckminster]

 

[kabin]

Looks like there's a sizeable new 2023.6.8 downloading today.

 

[sleepydoc]

Looks like there's a sizeable new 2023.6.8 downloading today.

That’s not part of the FSDb fork, though.

Out of curiosity - what features are the FSDb folks missing out on these days?

 

[JulienW]

That’s not part of the FSDb fork, though.

Out of curiosity - what features are the FSDb folks missing out on these days?

NHTSA out of sight window up recall.

 

[FSDtester#1]

That’s not part of the FSDb fork, though.

Out of curiosity - what features are the FSDb folks missing out on these days?

Rolling stops.... feels like I am about to get rear ended whenever fsdb stops for 3 seconds... are they illegal, yes, does almost anyone do them, not really
Also boombox... that was fun for the 4 days it lasted

 

[kabin]

That’s not part of the FSDb fork, though.

Out of curiosity - what features are the FSDb folks missing out on these days?

Good question. I think auto steering wheel heat and a sentry mod. I was looking forward to the steering wheel heat mod before winter passed.

 

[PianoAl]

IMO only people who are "happy" with FSD are those with low expectations (like me).

I'm actually thrilled with it. It drives me an hour to surfing and back with few disengagements or interventions necessary. I would not surf this much if I had to drive manually.

It's easy to forget what a phenomenal feat this is. Did we envision this 15 years ago (I forget, did we)?

 

[Mardak]

I wonder why a tweet with the picture from the FSD Beta 11.3.1 release notes?

https://twitter.com/x/status/1637232014729379841

This "employee" usually does get FSD Beta updates early even before the pre-Safety-Score group. So maybe 11.3.2 was released internally?

 

[Pdubs]

Sleepy loves me and I was being a whiney Lil ....!
We want Tesla to sell as many cars as possible at whatever price they can get.
They will always bring a nice net profit margin
More Tesla's on the road more NN training

Carry on