FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[powertoold]

11.4.9 was wiping the rain perfectly for me today.

I think what happened was that Tesla had to come up with a more efficient video module in order to have enough compute to run the rain NN. The wipers on 11.4.7 were completely unfunctional for me, dry wiping and also not wiping with heavy rain, it was frustrating.

The drawback with 11.4.9 is that it's not as smooth as 11.4.7 wrt lead vehicle slow downs based on my brief usage so far.

 

[legendsk]

I thought euthanasia was legal for threads that are in a terminal condition?

I'm pretty sure that threads that are terminal have to be moved to hospice for, (are you ready for this?), "two weeks", before euthanasia.

 

[Supcom]

Drove my FSD M3 on 2023.44.30.2 for two drives, each about 20 miles with a mix of road types. Midday, so no condensation present.

11.4.9 worked pretty much like previous versions. No particular clompaints. I had one disengagement on each drive. One was for failure to move over two lanes to enter an onramp. This is an old problem at this location and the behavior was indistinguishable from previous versions.

The second disengagement was for attempting to move up on the left side of a pickup pulling a trailer as we both approached a lane merge on a limited access road. The pickup was about to lose his lane. Poor decision to block the truck so I disengaged to move left and give the truck room to merge.

Sunny on the first drive, cloudy on the second. The windshield wipers behaved themselves and stayed in the stowed position.

Nags on FSDb were not noticeably different than pre-recall other than the position of the nag message. Frequency seemed the same with the same sensitivity on the steering wheel. I did not test AP on this car, since it has FSD.

I have ultrasonics, so no park assist. Also saw none of the new traffic icons. My car did start downloading a nav update when I arrived back home, but I don't expect that to help.

 

[cbdream99]

I did another test drive. Unfortunately I experienced two hard phantom braking episodes as well as periodic brief but softer braking episodes. FSD has a hankering to lift off the throttle for no apparent reason.

The photo radar intersection isn't displaying on the UI even with the latest map update. Nav settings are set for online routing as required.

FSD wasn't able to correctly interpret road construction where the right lane (my lane) ended. There was a vehicle in the left lane leading by about 1 sec. FSD should've slowed and merged behind the left lane vehicle but instead maintained the same speed and jammed my car between the bollards and the vehicle in the left lane. It behaved just like the highway zipper lane snafu except FSD wanted to up close and personal with the left lane vehicle.

Although the vision module was suppose to improve it, FSD still over reacts to lead vehicles entering the median or turn lanes. It's as if FSD has poor estimates of the lead vehicle's range, velocity and path. This in spite of many software update release notes reporting sizeable % improvements in object kinematics.

When I tested it briefly this morning, it brake unnecessarily when a car made a right turn while I was on the outer lane; interestingly enough another car made a left turn crossing my path, it didn't brake which is normal to me.

 

[manole]

Anybody with a refreshed S or X with USS get the update yet?

 

[MP3Mike]

Also saw none of the new traffic icons.

Do you have a premium connectivity subscription? (It is required for the new traffic icons.)

 

[FSDtester#1]

Anybody with a refreshed S or X with USS get the update yet?

Nooooo!!!!!

 

[WilliamG]

Oh wow... My Rivian (which has working auto wipers) is getting an update that improves the already working auto wipers.... Nice!

"Automatic Wiper Sensitivity Control
We added the ability to select from three automatic wiper sensitivity levels to suit your preference. Use Auto mode to access these settings.

• When you toggle the wiper switch down to Auto, it changes to the highest sensitivity level.
• Toggle the switch down again in Auto mode to decrease the sensitivity, and then up to increase it.

Instead of toggling, you can also hold the wiper switch up to jump to Storm, or hold the wiper switch down to jump to Auto. When you jump down to Auto, it recalls your previously selected sensitivity setting."

Telsa?
"GFY" - says Elon...

That’s pretty funny timing.

 

[WilliamG]

Nooooo!!!!!

Not I, and not anyone I know. Who can say why.

 

[kabin]

Weird that it is so bad for you. I've only used it for about 20 miles so far, but it seems slightly better than FSDb 11.4.8.1, which was the best one I've had so far.

I had no dry wipes, but there was no rain today to test if it responds to rain properly. (In 11.4.8.1 the wipers seemed to be working pretty well.)

The biggest improvement I've seen in 11.4.9 is fewer false slowdowns when someone is turning across your path, but will be out of your way before you get there. Prior versions would slow down after the path was clear, today it highlighted the crossing car in dark blue but didn't slow down.

FSDb 11.4.8.1 seemed to introduce a new slowing when approaching traffic lights that it couldn't see, I assume so that it wouldn't have to slam the brakes on once they came in to view and were red. The weirdest was that I was behind a Semi at a red light, the Semi proceeded through the intersection when the light went green, but FSDb only pulled up to the stop line and stopped until it could see the light was green for itself. (I suppose it is the safest behavior as the Semi could have ran the red light.)

I've only used it around the neighborhood for about an hour so time will tell. But TBH v11 hasn't been much of an improvement for me. Hopefully it's eventually reincarnated and requires fewer crutches and hacks.

 

[Supcom]

Do you have a premium connectivity subscription? (It is required for the new traffic icons.)

Yes. Both cars have premium connectivity. And I have online routing enabled. I get traffic backup data just fine. Perhaps the database is not very complete. Sort of like how I often do not see lane assignments at intersections.

 

[fasteddie7]

D

Yes. Both cars have premium connectivity. And I have online routing enabled. I get traffic backup data just fine. Perhaps the database is not very complete. Sort of like how I often do not see lane assignments at intersections.

is you get the accompanying nav/map update? Seems like most people don't see them until both updates happen.

 

[sleepydoc]

For another single data point, I’m on 2023.27.12 and got a notice that I can upgrade to 2023.44.30.2. (2020 model Y LR with USS)

 

[swedge]

First drive on 11.4.9 seems very much like 11.4.8.1 was, no significant improvements. My wipers were always OK, and still are. Our car has USS, and the new parking visualizations do not appear, as expected.

Not mentioned yet here, I switched to a non-FSD profile. Standard AutoPilot did engage, like before, on a non-highway road, but nags came pretty quickly, maybe 15 seconds. One hand hanging a bit on the wheel still prevents nags.

 

[AlanSubie4Life]

in order to have enough compute to run the rain NN.

Rain sensing bringing HW3 to its knees. Story checks out.

 

[GWord]

Anybody with a refreshed S or X with USS get the update yet?

What constitutes Refreshed? My 2017 With MCU2 got 2023.44.30.4 (11.4.9)

 

[jebinc]

Nooooo!!!!!

Nooooooooooo

 

[jebinc]

That’s pretty funny timing.

It's almost like RJ is trolling Elon....

 

[swedge]

Rain sensing bringing HW3 to its knees. Story checks out.

Except some of us with HW3 had no problems with rain sensing or dry wipes.

I just hope that 11.4.9 has finally wiped the wiper bug clean out of FSD for everyone. It was taking up a lot of TMC bandwidth! ;-)

 

[BBTX]

I came from 11.4.7.3 to 2023.44.30.2 on my MYLR (USS) today. There are definitely some subtle improvements, but a lot of basic things are still regressions vs 11.3.6 (e.g. poor handling of narrow two ways, random stupid lane changes that make no sense, including into short-deadline turn lanes that would take me off-route).

I got the map update after the software update, and I do have premium connectivity and traffic updates, but have yet to see any of these new nav icons for e.g. stop signs.