FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[Goose66]

To be clear, the car can read that sign, it just ignores it and leaves it to the driver to manually lower the speed if they deem it necessary.

I like that. Just like "the car can see the oncoming traffic, it just ignores it and leaves it to the driver to move out of the path of the oncoming cars if they deem it necessary."

 

[Dewg]

I like that. Just like "the car can see the oncoming traffic, it just ignores it and leaves it to the driver to move out of the path of the oncoming cars if they deem it necessary."

There is a key difference - intent. My comment is designed that way, your comment is an unintentional bug in the software.

 

[Supcom]

Action can vary, if Tesla can read the sign why not signal to the driver with an audible chime or something to remind them it’s there and that they are in a school zone?

There is no indication that the car recognizes a school zone sign.

 

[Mardak]

There is no indication that the car recognizes a school zone sign

There is indication that the car recognizes speed limits signs that have additional text like yellow [SCHOOL] on top. Where the visualization behavior is to not show those signs, so internally Autopilot recognizes it's a speed limit sign that might have extra modifiers. Similarly on highways, Autopilot seems to try to ignore speed limits for trucks, so it'll be interesting to see how that behaves with FSD Beta 11 single stack.

 

[Dewg]

There is no indication that the car recognizes a school zone sign.

Several versions ago when entering a school zone the car would ignore the speed limit but put it up with an exclamation mark on the display. Took me a few trips to realize what the exclamation mark was - it was the school zone. It absolutely recognizes basic school zone limits like these. It just ignores them since it doesn't know if there's kids in a parking lot or soccer field, etc. So it leaves it up to the driver to handle the logic.

 

[Supcom]

Several versions ago when entering a school zone the car would ignore the speed limit but put it up with an exclamation mark on the display. Took me a few trips to realize what the exclamation mark was - it was the school zone. It absolutely recognizes basic school zone limits like these. It just ignores them since it doesn't know if there's kids in a parking lot or soccer field, etc. So it leaves it up to the driver to handle the logic.

View attachment 902156

A mystery exclamation mark with no explanatory text? Helpful.

 

[Joboo7777]

Several versions ago when entering a school zone the car would ignore the speed limit but put it up with an exclamation mark on the display. Took me a few trips to realize what the exclamation mark was - it was the school zone. It absolutely recognizes basic school zone limits like these. It just ignores them since it doesn't know if there's kids in a parking lot or soccer field, etc. So it leaves it up to the driver to handle the logic.

View attachment 902156

I have not seen the exclamation mark on my screen. Is it still part of the base code or has it been removed?

 

[Dewg]

Yes, I haven't seen it in many months. Found what it looked like:

 

[Goose66]

There is a key difference - intent. My comment is designed that way, your comment is an unintentional bug in the software.

Another difference: my comment was (obviously?) tongue-in-cheek.

 

[JulienW]

Not sure why everyone is having a problem with dumb cars. My car just finished reading War and Peace with 98% comprehension. And this was through the rear camera at 25' for a challenge.

 

[Supcom]

Not sure why everyone is having a problem with dumb cars. My car just finished reading War and Peace with 98% comprehension. And this was through the rear camera at 25' for a challenge.

In Russian, I presume?

 

[Supcom]

Yes, I haven't seen it in many months. Found what it looked like:

View attachment 902169

I can confidently say the my car has never displayed that indicator.

 

[EVNow]

Agreed. The problem with acting is it most likely will be too late and the slow down process too long which could result in a potential traffic violation. The other is school zones are dynamic(at least in Texas they are) so it could be difficult to act consistently. In Texas most school zones have blinking yellow lights when active although there are some that only have stating the time of day it’s active.

They will eventually get there. Remember all the traffic light situations they had to work through (also showed on AI day).

 

[sleepydoc]

What good does it do for the car to identify the school zone if it does not take correct and effective action? Better to leave it to the driver. You can clearly see that you are entering a school zone, right?

Identifying school zones is easy. Knowing when then limits apply and when to act is not.

 

[sleepydoc]

In Russian, I presume?

It was only half as long because the peace parts were deleted.

 

[jabloomf1230]

11.420.69

More like 11.i

 

[Twiglett]

We need to not forget the important stuff, you know, the features that make a difference to everyone using FSD and looking for improvements ...

Like keeping the FSD version number on 69 for four months to satisfy the boss' schoolboy humor

 

[Aayyo]

Where is fsd 11.3? 25.2 is a major regression.

 

[JulienW]

Where is fsd 11.3? 25.2 is a major regression.

I'm predicting 10.69.26.x is our next update with V11 coming in a "week or 2 or so" after that.

 

[kabin]

Where is fsd 11.3? 25.2 is a major regression.

Yep. It's gonna be the norm when the NNs are saturated, the processing is overwhelmed, and they try to introduce new training scenarios and/or fix an issue. Unless the team can come up with some processing efficiencies, I imagine V11 will be more of the same.