FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[fasteddie7]

In regards to the wiper function, is anyone using RainX on their windshield? Perhaps this has something to do or not with the wiper function?

I’m a little extreme as I wash my car 3 or 4 days a week, but I get enjoyment out of it, i clean the inside and out with a waffle cloth and a mix of the two chemical guys glass solutions, I think they work really well and don’t streak at all, leaving a really pleasant smell. This might contribute to me never getting a dry wipe. although I don’t get a wet wipe either a lot of times lol..

 

[fasteddie7]

Does FSD have a different UI visualization in Korea?

https://twitter.com/x/status/1715927839466541413

That’s what my old 2016 navigation used to look like in my old model s. I’m pretty sure there is a law against using Google maps there, so they have a separate solution.

 

[sleepydoc]

There are enough reports and documentation of a sudden change with recent software releases that I think it’s safe to assume it’s a software issue.

 

[dflowerz]

Downloaded 11.4.7.3 last night. Biggest interest for me is if the speed limit errors get fixed around my neighborhood on two different streets. Both should be 35mph but FDS/Maps was 55mph which is scary. After 11.4.7.2 one of them switched to 25mph-now to slow but better than too fast. The other is still 55mph. Maybe it is map updates instead of FSD updates. I have always had issues with the stop sign turning into my neighborhood but I only test it when there is no traffic since it is so bad. Never got to test it with 11..4.7.2.

 

[enemji]

While this is true about sports, the wipers have kinda sorta been mostly okay up until the recent updates. Something has significantly changed.

Sometime ago I recall Elon talking about using all cameras to detect rain, and not just the front windshield camera. Are they testing that out?

 

[Gwgan]

one of them switched to 25mph-now to slow but better than too fast

Did you see a popup message about changing the speed due to road type? That is independent of map data.

cameras to detect rain, and not just the front windshield camera. Are they testing that out?

If you consider testing to be releasing it on privately owned production vehicles without asking then yes.

 

[heapmaster]

Hi everyone,

I’m considering a Tesla again and have been primarily waiting for Phantom Braking to go away (mainly on the highways). From what I can tell, it’s significantly better using FSD 11.7.4.3 than the standard, non FSD stack. Is this correct?

How is phantom braking on long road trips now and what does it feel like? Have any major incidents happened to you while on FSD code using Autopilot/TACC on the freeway?

My car with FSD likes to brake around semi trucks if they are close to the car but still in their lane, and its not a small brake event, I have to hit the accelerator when it happens so I dont get rear ended at highway speed.

 

[Gwgan]

why not?

It does not otherwise know what to do at intersections. It ignores my signal input at a T intersection and turns right instead of left. It takes an exit when I want to go straight ahead. It just makes up a path if there is no nav. I’ve only seen this when testing or when canceling and remaking a trip while already in FSDb. Just don’t get the point of Random FSD.

 

[Scott Chapman]

I feel like 2023.27.7 ramped up download pretty aggressively.
Thoughts on why?

 

[rlsd]

I feel like 2023.27.7 ramped up download pretty aggressively.
Thoughts on why?

Besides possible bug fixing, Tesla may want to get other info from the car in the background or fix some potential recalls that have not been discovered yet.

 

[dflowerz]

Did you see a popup message about changing the speed due to road type? That is independent of map data.


If you consider testing to be releasing it on privately owned production vehicles without asking then yes.

Have not noticed. Will check next time. Thanks!

 

[Yelobird]

It does not otherwise know what to do at intersections. It ignores my signal input at a T intersection and turns right instead of left. It takes an exit when I want to go straight ahead. It just makes up a path if there is no nav. I’ve only seen this when testing or when canceling and remaking a trip while already in FSDb. Just don’t get the point of Random FSD.

So don’t understand your complaint and suspect Strongly that the issue with FSD is your understanding of how it works. It needs a Nav path to operate correctly. You don’t simply use the stalks like joy sticks to push it where you want to go. No path no play.

 

[JulienW]

I feel like 2023.27.7 ramped up download pretty aggressively.
Thoughts on why?

As I previously stated it was a super tiny update (only about 300MB) so the changes (just minor tweaking and/or bug fixes) were likely EXTREMELY minimal that it didn't require as much caution and testing.

 

[pimfram]

Definitely a huge push for 2023.27.7 since I'm actually getting it.

 

[old pilot]

11.4.7.3 drove again today, all the same problems as the previous iterations but one positive, when in a multi lane road and following a slower vehicle, when that vehicle begins to move out of the lane the car (ego) starts to accelerate instead of waiting until the lead car is completely out of the lane. I saw this behavior several times, so I don't think it is an accident.

 

[frankvb]

Yea, so I do that yesterday, and it did update to the current date (saying that it was up to date).
Of course I woke up this morning with my car offering to update the software which means that there is really no correlation between when you ask the car to manually check for updates and when an update is actually available for your car?

There is no way to manually check for updates (or at least only anecdotal evidence that you can do that). Though just going into the software screen indeed sometimes seems to update the date it last checked, whether that's just the UI being updated slowly or an actual check is impossible to tell.

 

[Wnuk]

As the rollout has continued and more have been added, sadly something specific to your car.
Maybe worth opening a support ticket.

Yes, not sure what went wrong there as the update has not been pushed again.

 

[rlsd]

First run of 11.4.7.3 today. It seems there was no or less wheel jerking and the wheel stayed straight for turning at the intersection when getting out of the neighborhood. But this was just one time. FSD could get lazy or tired later and do the bad things again.

 

[sleepydoc]

It does not otherwise know what to do at intersections. It ignores my signal input at a T intersection and turns right instead of left. It takes an exit when I want to go straight ahead. It just makes up a path if there is no nav. I’ve only seen this when testing or when canceling and remaking a trip while already in FSDb. Just don’t get the point of Random FSD.

It’s like getting in a taxi and saying “just drive.” If you don’t have a destination in mind, what’s the point of driving?

 

[Twiglett]

Yes, not sure what went wrong there as the update has not been pushed again.

They can usually force a new update to clear it