FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[bedoig]

I thought pretty much USS had been just disabled via software in the past 1-2 years for cars originally equipped with USS

Radar, yes (for most cars). USS was never disabled on cars that have it.

 

[archae86]

I have a 2022 model Y which has USS, and a 2023 model 3 without. The difference in representation of nearby objects between the two cars when running the same software version is quite clear. I think my model Y USS is active and never yet disabled.

 

[jebinc]

I have a 2022 model Y which has USS, and a 2023 model 3 without. The difference in representation of nearby objects between the two cars when running the same software version is quite clear. I think my model Y USS is active and never yet disabled.

Same for my 2021 Plaid.

 

[Mardak]

TeslaFi 2023.44.30.1 / FSD Beta 11.4.9 stats show with just over 200 installs, only 10 have gone to HW4

Strange rollout pattern that now has more than doubled to 425 installs but still only has the same 10 HW4. Almost 25% of the installs are coming from "early access" 2023.27.x, yet it seems awfully quiet in this thread.

The recall remedy does seem to affect FSD Beta 11.4.9 (and not just plain Autosteer) such as the "pay attention" message with little red hands can show up immediately when activating on city streets just before a stop sign. It doesn't happen every time as it seems to evaluate how long you've been looking forwards as well as if there's traffic lights or stop signs nearby.

A small change carried over as part of the high fidelity park assist is the projected path of the tires are visualized when reversing (similar to the ones displayed on the rear camera) even for vehicles with ultrasonics.

 

[rlsd]

Strange rollout pattern that now has more than doubled to 425 installs but still only has the same 10 HW4. Almost 25% of the installs are coming from "early access" 2023.27.x, yet it seems awfully quiet in this thread.

The recall remedy does seem to affect FSD Beta 11.4.9 (and not just plain Autosteer) such as the "pay attention" message with little red hands can show up immediately when activating on city streets just before a stop sign. It doesn't happen every time as it seems to evaluate how long you've been looking forwards as well as if there's traffic lights or stop signs nearby.

A small change carried over as part of the high fidelity park assist is the projected path of the tires are visualized when reversing (similar to the ones displayed on the rear camera) even for vehicles with ultrasonics.

It looks like they update model 3 two or three times more than model Y.
Teslafi should have more than 1000 updates for today instead of just less than 250.
With this update rate, it may take a month for 2 million cars.

 

[jebinc]

It looks like they update model 3 two or three times more than model Y.
Teslafi should have more than 1000 updates for today instead of just less than 250.
With this update rate, it may take a month for 2 million cars.

Maybe an issue was would and we are now waiting for the 2nd dot release....

 

[rlsd]

Maybe an issue was would and we are now waiting for the 2nd dot release....

Sure. I am happy to have FSD 11.5.0 included

 

[Supcom]

It looks like they update model 3 two or three times more than model Y.
Teslafi should have more than 1000 updates for today instead of just less than 250.
With this update rate, it may take a month for 2 million cars.

Assuming the telemetry from the initial rollout looks good, they'll quickly ramp this up.

 

[Mardak]

Assuming the telemetry from the initial rollout looks good, they'll quickly ramp this up.

The rollout just expanded doubling the rollout from yesterday. TeslaFi shows a total of nearly 1300 pending/installed up from earlier 650. Although the pending version list from Teslascope seems to show the increased rollout is mostly for those on 2023.44.1 so far.

 

[MP3Mike]

They probably just can't reconcile USS and vision park assist together, you'd have proximity lines from USS that don't really line up with what's coming out of the occupancy network, it would be a confusing mess.

They could make it an option to display either the USS arcs or the new High Fidelity Park Assist visualizations. No need to try to combine them.

 

[LowlyOilBurner]

The rollout just expanded doubling the rollout from yesterday. TeslaFi shows a total of nearly 1300 pending/installed up from earlier 650. Although the pending version list from Teslascope seems to show the increased rollout is mostly for those on 2023.44.1 so far.

I just prompted for 2023.44.1, guess I’ll download it.

 

[jebinc]

I just prompted for 2023.44.1, guess I’ll download it.

Please do, and please tell!

 

[ArchHamster]

They probably just can't reconcile USS and vision park assist together, you'd have proximity lines from USS that don't really line up with what's coming out of the occupancy network, it would be a confusing mess.

This is probably the reason. There was also an change a few updates ago which mentioned using uss cars to train parking assist systems. I can't remember if this change was noted in the change log or in a change to the privacy waivers you agree too. In any case, I wouldn't be surprised if they are still using uss cars to train this new vision system and enabling it on uss cars would confound the training data in some way.

 

[TK211X]

Waiting impatiently here. Intend to make the lock sound a priority tone siren to scare ghetto people.

 

[willow_hiller]

They could make it an option to display either the USS arcs or the new High Fidelity Park Assist visualizations. No need to try to combine them.

Ashok explains this is v1 of the hifi park assist, and it will come to vehicles with USS eventually:

https://twitter.com/x/status/1736201652057854236

So maybe at the moment, USS is still more accurate than v1.

 

[AlanSubie4Life]

So maybe at the moment, USS is still more accurate than v1.

People without USS would do well to note that a future update will include:

“better persistence of occluded obstacles”

Remember, the park assist which will soon be released is not currently intended to prevent you from running into obstacles. It is not intended to show you all obstacles. You are responsible for making sure your parking spot is clear via means other than the Park Assist. You cannot expect it to tell you whether or not there is an obstacle. That is not its purpose.

It seems weird to have to remind people of this, but here we are. Keep those cars dent free!

 

[mtndrew1]

The high fidelity thing is pretty cool but it looks like they’ve just given up on trying to estimate and display distance. It just shows hot spots on my display now.

Here are some images of my car in my garage.

 

[rlsd]

The high fidelity thing is pretty cool but it looks like they’ve just given up on trying to estimate and display distance. It just shows hot spots on my display now.

Here are some images of my car in my garage.

View attachment 1000187
View attachment 1000188View attachment 1000189View attachment 1000190View attachment 1000191

Your garage is built with snow or styrofoam?

 

[Supcom]

Ashok explains this is v1 of the hifi park assist, and it will come to vehicles with USS eventually:

https://twitter.com/x/status/1736201652057854236

So maybe at the moment, USS is still more accurate than v1.

Perhaps they will be disabling USS when we get the new park assist?

 

[rlsd]

I can't take it anymore!

TeslaFi.com Firmware Tracker