FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[JulienW]

V12 has an optional Auto Speed setting that allows the car to set the speed on city streets based on whatever the NNs decide is best. If enabled, there is no user adjustment via the scroll wheel.

It does not apply to interstates - at least not yet.

Yea looks like we (well NOT me or most yet) are back to 2 stacks. 11 for limited access and 12 for all other.

 

[Supcom]

Yea looks like we (well NOT me or most yet) are back to 2 stacks. 11 for limited access and 12 for all other.

I've also seen comments from people testing V12 to the effect that it seems to drive the same way as V11. For the most part, that's not a problem for me. Other than encountering things like construction zones, I find V11 to be very good on interstate-like highways.

It will be interesting to see exactly which roads, aside from interstates, seem to be V11 and which are definitely V12.

 

[scottf200]

The basic versioning numbers is very strange to me compared to the FSD version. Why wouldn't they start with a new week at least (ie. > 2023.44 ... 2024.XX)

 

[JulienW]

The basic versioning numbers is very strange to me compared to the FSD version. Why wouldn't they start with a new week at least (ie. > 2023.44 ... 2024.XX)

The "week" number corresponds to the subversion number. New features were added in that week. The reason it stays the same is it keeps all the subversion's features and doesn't add any new features.

 

[Dracaris]

So, I'm on "Version 11.1 (2024.2.6)." I have EAP though not FSD, but I should also be getting updates, right? Any thoughts on what the V12 scoop is for EAP customers who could subscribe to FSD for $99 / mo (current price) if they were so inclined?

 

[JulienW]

So, I'm on "Version 11.1 (2024.2.6)." I have EAP though not FSD, but I should also be getting updates, right? Any thoughts on what the V12 scoop is for EAP customers who could subscribe to FSD for $99 / mo (current price) if they were so inclined?

You are past FSD v12 at this time so you can not get it.

 

[JulienW]

....It will be interesting to see exactly which roads, aside from interstates, seem to be V11 and which are definitely V12.

It appears to follow the same pattern as v10 did and all limited access highways run v11 and all other driving is v12.

EDIT: Also in AI DRIVR's video he shows the display changing (much more subtle) from v11 tov12 at about the same times it would do on v10.

 

[Dracaris]

You are past FSD v12 at this time so you can not get it.

I suspect you might mean "can not get it *yet*."
Pretty sure cars in that situation won't be dead-ended WRT FSD. Honestly, waiting for FSD V12 might be for the best anyway, because FSD V11 was a nightmare.

 

[JulienW]

I suspect you might mean "can not get it *yet*."....

Yes but I'm on 44.30.14 and also can't get it yet. Just your "yet" will be longer but how much no one knows.

 

[scottf200]

The "week" number corresponds to the subversion number. New features were added in that week. The reason it stays the same is it keeps all the subversion's features and doesn't add any new features.

The change of "AI end-to-end" is all the improvements videos of it is not a major "new feature"?!?!? I see speed control, speed bump adjustments, parking lot improvements, pedestrian improvements, etc. Seems really odd to me like it is being downplayed intentionally.

 

[scottf200]

The change of "AI end-to-end" is all the improvements videos of it is not a major "new feature"?!?!? I see speed control, speed bump adjustments, parking lot improvements, pedestrian improvements, etc. Seems really odd to me like it is being downplayed intentionally.

 

[JulienW]

The change of "AI end-to-end" is all the improvements videos of it is not a major "new feature"?!?!? I see speed control, speed bump adjustments, parking lot improvements, pedestrian improvements, etc. Seems really odd to me like it is being downplayed intentionally.

Tesla segregates Beta from the update and they have separate numbering. So there are no features added to the update and any "features" added to the Beta are reflected in the Beta number.

For instance 24.2.x added features like Trips Menu redesign and Ultra-wide Phone key that are not related to the Beta part of the software.

 

[Ramphex]

 

[PACEMD]

You are going to have to trust me on this one: If you are still doing 60 when you reach that 40 mph sign, you will be standing on the brakes - hard!

If you are traveling at 60 mph and cross over into a 40 mph zone.........you will die immediately. No exceptions! Happened to me many times. That's just science right there.......

 

[sleepydoc]

If you are traveling at 60 mph and cross over into a 40 mph zone.........you will die immediately. No exceptions! Happened to me many times. That's just science right there.......

Unless you’re going precisely 88 MPH…

 

[Ed Hart]

Just stating based on your center picture the speed reduction is very far from the reduce speed to 40 ahead sign. I would (and likely others do) reduce speed to 40 at the sign that states in a mile ahead.

If you slowed at the "Warning, 40 mph zone ahead" sign, you would have a long lineup of angry drivers behind you.

 

[Ed Hart]

Unless you’re going precisely 88 MPH…

My Flux Capacity is on the fritz.

 

[rlsd]

Maybe the wrong map information is related to what Green discovered:

https://twitter.com/x/status/1760550824605024263

 

[sleepydoc]

Maybe the wrong map information is related to what Green discovered:

https://twitter.com/x/status/1760550824605024263

So the question is how do these maps differ from the NAV maps?

 

[willow_hiller]

So the question is how do these maps differ from the NAV maps?

Custom satellite imagery:

https://twitter.com/x/status/1760550827150721393