FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[TK211X]

I just noticed that the pending count is steadily increasing. Like a slow burn.

It fell sub 600 around an hour ago and now it’s up to around 800.

 

[jebinc]

I just noticed that the pending count is steadily increasing. Like a slow burn.

Any S/X installs yet? You know, the flagship models…

 

[TK211X]

Any S/X installs yet? You know, the flagship models…

Yes, but you should really allow the poors to enjoy Christmas.

 

[jebinc]

Yes, but you should really allow the poors to enjoy Christmas.

Touché

 

[powertoold]

I like how the Tesla AP team is trolling LIDAR now:

https://x.com/philduan/status/1736196405398782186?s=20

 

[LowlyOilBurner]

Please do, and please tell!

Duuuuuude, it was life changing! I hit that install button and my mind was blown! next level FSD , magical light show, glove box was full of gold bars, just an absolute miracle!!! For realzzzz! Highly recommend installing 2023.44.1! Five stars!

 

[j0shm1lls]

Well, I went and burned my daily check, no presents under the Tesla tree for me.

 

[TK211X]

1200 now and climbing.

 

[fasteddie7]

1200 now and climbing.

Looks like only the same 10 hw4 from earlier, all model y. Hmm....

 

[bhakan]

Touché

We will get it in 2024 unknown month.

 

[jebinc]

We will get it in 2024 unknown month.

Not necessarily…

 

[sleepydoc]

People without USS would do well to note that a future update will include:

“better persistence of occluded obstacles”

Remember, the park assist which will soon be released is not currently intended to prevent you from running into obstacles. It is not intended to show you all obstacles. You are responsible for making sure your parking spot is clear via means other than the Park Assist. You cannot expect it to tell you whether or not there is an obstacle. That is not its purpose.

It seems weird to have to remind people of this, but here we are. Keep those cars dent free!

It’s not weird at all, in fact, it‘s completely normal. You put an image up on the screen that appears to show everything and fills in unknowns so it appears nothing is there and then are surprised when people don’t realize it’s incomplete and is missing objects?

 

[AlanSubie4Life]

It’s not weird at all, in fact, it‘s completely normal. You put an image up on the screen that appears to show everything and fills in unknowns so it appears nothing is there and then are surprised when people don’t realize it’s incomplete and is missing objects?

Like I said, weird. You’d think people would just see how their car works and realize it’s not magic. But here we are.

 

[Scott Chapman]

looks like a 2023.44.30.2 is coming out

 

[aronth5]

I just did a software update check which initiated a software download of 2023.44.1 with FSD 11.4.4. This doesn't include the recall update according to the release notes. Upgrading from 2023.38.9, FSD 11.4.4.

 

[Mardak]

looks like a 2023.44.30.2 is coming out

The TeslaFi vehicle that received it is the same one that has been getting early updates to software including 2023.44.25 over 10 days ago. It's a 2022 Model Y with HW3, and 2023.44.30.1 rollout seems to have relatively avoided those vehicles so far representing only 20% of Ys installing the holiday update whereas they represent over 35% on 2022.44.1. This could mean this 2023.44.30.2 is intended to go to the audience that hasn't really received the update yet.

For other HW3 Models under sampled in the rollout so far, 2022 S/X as well as 2021 3 are even more significant than 2022 Y. None have gone to S/X Refresh so far and might be waiting for a separate version like .2. What might differentiate Model 3s from 2021- vs 2022+ relevant to 11.4.9 rollout?

 

[sleepydoc]

Like I said, weird. You’d think people would just see how their car works and realize it’s not magic. But here we are.

No, not weird.

Any imaging modality can have artifacts. We use ultrasound for imaging in medicine. Not infrequently, there will be artifacts that appear on the image that don’t exist. Part of the training for using ultrasound is recognizing these artifacts. If you don’t know what to look for you can be fooled. Radiologists deal with artifacts all the time. They also deal with the limitations of the imaging and take pains not to rule out things solely because they can’t be seen. This is no different. Tesla puts a seemingly complete image on the screen that matches the surroundings almost exactly except for a missing object in a spot that you can’t see. It’s far more weird to expect people to know that an object is there when it’s not visualized.

 

[jebinc]

Like I said, weird. You’d think people would just see how their car works and realize it’s not magic. But here we are.

But didn't Elon tell his mass following that it is magic, so therefore it must be, right?

 

[jebinc]

looks like a 2023.44.30.2 is coming out

Ah, as expected/discussed yesterday!

 

[aronth5]

I just did a software update check which initiated a software download of 2023.44.1 with FSD 11.4.4. This doesn't include the recall update according to the release notes. Upgrading from 2023.38.9, FSD 11.4.4.

Not much to this update. Certainly not the holiday release. Perhaps it's a prerequisite for a larger upgrade that will include the holiday release with the recall and the latest FSD release 2023.4.9