FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[FSDtester#1]

However I did help the police today with a hit and run using tesla cam.

Emailed the clip this evening

It's funny that cops haven't figured out yet that all teslas are recording everything and they were super surprised to know I had it all on video.

 

[FSDtester#1]

you submit it to wham baam teslacam?! lol

I will be this week and I'll let you know when it comes up

I will use the name @Ramphex who loves @jebinc !!!!

Edit: I will just use @Krash since it was a crash!

 

[Dennisis]

Got 11.3.6. Installing now. Wonder if there will be any any noticeable difference.

Have to take an early morning drive now, fingers crossed!

 

[swedge]

11.3.6 has 980 cars pending or installed as of 9:30 pm pdt. That is around 20% of the FSD fleet.

A quick check found both 2021 and 2023 cars had have installed already, so it is USS agnostic. Merging code branches, cool I suppose, but I was OK with USS. And radar. We'll see....

Anyway, the first 5 installs were completed around 4 PM, and the big wave around 9. This quick jump to 20% suggests this may be a big release, hopefully to all the 11.3.x as well as the remaining 10.69ers. Fingers crossed.

I'm guessing the big accomplishment here was merging the USS and non-use branches. Next might be merging the 2022 and 2023 branches... One can hope.

FSD still needs a lot of work, so continuing quick revisions makes sense, many quick cycles of fix stuff, test it, repeat. It makes sense that these revisions might be simpler and quicker if the base code stayed the same, so having FSD development on it's own branch might make it easier for a while. History would suggest Tesla thinks so.

Tomorrow will be my co-pilot's first decent exposure to FSD beta on highways, Hwy I880/CA17 from Oakland to Santa Cruz and back for Easter egg dying. (Really?) If it goes well, she might be willing enable FSD on her profile and not use it on city streets. More fingers crossed.

Related to that, I gather the nag-bot notices cell phones and such. Does it also nag if I drive with all these fingers crossed? ;-)

 

[Ramphex]

11.3.6 has 980 cars pending or installed as of 9:30 pm pdt. That is around 20% of the FSD fleet.

A quick check found both 2021 and 2023 cars had have installed already, so it is USS agnostic. Merging code branches, cool I suppose, but I was OK with USS. And radar. We'll see....

Anyway, the first 5 installs were completed around 4 PM, and the big wave around 9. This quick jump to 20% suggests this may be a big release, hopefully to all the 11.3.x as well as the remaining 10.69ers. Fingers crossed.

I'm guessing the big accomplishment here was merging the USS and non-use branches. Next might be merging the 2022 and 2023 branches... One can hope.

FSD still needs a lot of work, so continuing quick revisions makes sense, many quick cycles of fix stuff, test it, repeat. It makes sense that these revisions might be simpler and quicker if the base code stayed the same, so having FSD development on it's own branch might make it easier for a while. History would suggest Tesla thinks so.

Tomorrow will be my co-pilot's first decent exposure to FSD beta on highways, Hwy I880/CA17 from Oakland to Santa Cruz and back for Easter egg dying. (Really?) If it goes well, she might be willing enable FSD on her profile and not use it on city streets. More fingers crossed.

Related to that, I gather the nag-bot notices cell phones and such. Does it also nag if I drive with all these fingers crossed? ;-)

Would be cool if they just told us wtf they did.

 

[Supcom]

Would be cool if they just told us wtf they did.

It would be nice if Tesla would include a few high level notes regarding why they are releasing a new version. Obviously, there's something significant enough to be worth the cost of preparing and testing new builds and the server cost of sending out a sqiqqlebyte of data to thousands of cars, so they could summarize why they did it.

It does appear obvious that they merged the USS and non-USS cars into one build. But, I hope they fixed some of the surface street issues that 11.3.4 has been having.

Hopefully, this version goes to everyone.

 

[jebinc]

Alright. Someone here has to have Junk 5.0…

View attachment 926475

Not this “junk” yard dog

 

[jebinc]

Dang, new everything.

New junk as well!

 

[Ramphex]

Alright who’s Elon on here? No way he’s not curious what we have to say about his Junk.

 

[jebinc]

Alright who’s Elon on here? No way he’s not curious what we have to say about his Junk.

 

[Gwgan]

https://twitter.com/x/status/1644942345383673856

I often have no idea what pedestrians are planning while looking at their phones while walking out between cars or loitering at crosswalks and not crossing. Maybe AI will know better after cataloging human sidewalk behavior.

 

[WilliamG]

Just got 11.3.6 downloaded to my car. I’ll probably test it at some point…

 

[Todd Burch]

The news that FSDb currently sees pedestrians as cuboids is actually really good news.

It means that most of the unnecessary hesitation and stopping around pedestrians that we see right now is a (relatively) easily-fixable problem that they just haven’t got to yet.

Currently the system will look at the position and movement of pedestrians as a simple translating bounding box and react based on that.

While this is the most important element of pedestrian avoidance, it leaves much to be desired.

Once they add pose detection, the system will understand that a person standing right near the road but facing away from it, or leaning on a street post, or a pedestrian at the edge of the intersection but facing parallel to your direction of travel is not a collision risk. This will DRAMATICALLY reduce hesitation and false slowdowns.

I had thought FSDb was already doing this and it just wasn’t working well. This is good news! It means Tesla knows what the problem is and what they need to do to fix it.

Tesla has tons of data on this so it should be coming soon. Hopefully the team prioritizes this because it’s one of the bigger reasons for interventions and disengagements.

 

[JulienW]

"Jesus", he has risen. First update since "his" birthday.

 

[Gwgan]

3.3 -> 3.6, no appreciable change noticed yet. Still drives right past turns, gets confused by turn lanes, stops in unexpected places, but is overall smooth

 

[Therealm80]

I have noticed that when I disengage for the car not taking the proper lane and I submit a Voice report on it the next time I go by that same area it doesn’t make the same mistake. It seems like they are fixing things on the fly is that accurate?

 

[Scott Chapman]

Rumor has it 11.3.6 vis 2022.45.15 is going to employee

I have noticed that when I disengage for the car not taking the proper lane and I submit a Voice report on it the next time I go by that same area it doesn’t make the same mistake. It seems like they are fixing things on the fly is that accurate?

I can't imagine the turn around is that quick. Well... Unless you are talking about that section of road you only go past when you go to visit your inlaws

 

[boonedocks]

I have noticed that when I disengage for the car not taking the proper lane and I submit a Voice report on it the next time I go by that same area it doesn’t make the same mistake. It seems like they are fixing things on the fly is that accurate?

Not accurate.

 

[edseloh]

Where on TeslaFi do you find the Maps version?

Some cars on TeslaFi are now reporting new maps so maybe this is the start of a larger map update. NA-2022-44-14515
How much that helps FSD is anybody's guess. No feedback so far.

This morning I took my regular large roundabout and instead of stopping like it's done a hundred times I rolled thru at 8mph. Needless to say I was surprised and checked my maps to see if I had gotten updated. Nope. Next time thru on the same roundabout today it stopped. Go figure!

 

[boonedocks]

Where on TeslaFi do you find the Maps version?

Main software page