FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[jebinc]

Did you mean U?

No

 

[Dewg]

I have to add that on normal driving around my neighborhood. Collision warning seems to be very sensitive and happens more often! One thing I have noticed is that on left turns, cars on opposite lanes after the turn showed up as red!! Right turn also, cars I already passed after the turn showed up red also.

Have you tried setting FCW to Late?

 

[mtndrew1]

Well, I was about to head out to go to downtown. One check on Google map stopped me. There are already 2 accidents on 110N, red all the way with reroutes to surface streets between 105 and 10. I will wait!

Welcome to my life every day, twice a day.

It was moot anyway, the gridlock resulted in the express lanes being shut down for single occupant vehicles. Glad you didn’t end up wasting an hour of your life.

 

[JohnB007]

Meh.

I was on a 4-lane road, needing to go straight for a while. 2 lanes became 4 at a turn (new lanes for left and right turns), but FSD decided to swerve left into left-only lane half way then came back. This is with MLC on.

Tesla needs to fix this behaviour before putting all their resources to v12.

 

[KLam]

Have you tried setting FCW to Late?

Yes, setting FCW to Late (I was on Medium) seems to take out couple of false warnings on a curvy marked narrow 2 lanes (one on each side) road with parking on both sides.

The red identified cars on the opposite direction side after a left turn still shows. Those opposite side cars already behind me on my left. It shows even few lanes over to my left with a median divide.

 

[KLam]

Welcome to my life every day, twice a day.

It was moot anyway, the gridlock resulted in the express lanes being shut down for single occupant vehicles. Glad you didn’t end up wasting an hour of your life.

The shut down on North bound seems cleared, but still red. Now we have a South bound accident! People are *sugar* drivers even on a straight freeway!!

 

[Buckminster]

https://twitter.com/x/status/1704160599813619783

They have added another dot.

 

[KLam]

Meh.

I was on a 4-lane road, needing to go straight for a while. 2 lanes became 4 at a turn (new lanes for left and right turns), but FSD decided to swerve left into left-only lane half way then came back. This is with MLC on.

Tesla needs to fix this behaviour before putting all their resources to v12.

I don't think it will help with v12. The MLC setting is a telltale that it is impossible to set a heavy enough coefficient in the NN to say something absolute like "No lane change!"

 

[Buckminster]

https://twitter.com/x/status/1704162052737048755

 

[LowlyOilBurner]

What are the close to 50 non-FSD features? Or at least some of the ones that folks want to see?

 

[tivoboy]

What are the close to 50 non-FSD features? Or at least some of the ones that folks want to see?

Looks like a feature ROLL UP from the past 4-5 non FSDb regular releases.. one has to scan the entire NATA page to see them all. I think this build will just pretty much feature parity with NON FSDb releases at this point. Something about that says to ME at least, we’re waiting till EOY/Holiday release for any FSD 12.x to try out.. which sort of makes sense.

Personally I’d like like PAK to finally work reliably again!

 

[Yelobird]

What are the close to 50 non-FSD features? Or at least some of the ones that folks want to see?

The (J) barkers auto ejection seat would be nice….

 

[Twiglett]

Glad to report that a second try at reboot and deep sleep with no cabin temp protection or sentry, entire commute was entirely wipe free
Such a relief

 

[PACEMD]

What are the close to 50 non-FSD features? Or at least some of the ones that folks want to see?

Well, to start with there is feature 1. From there, it goes all the way up to feature 50. Windshield wipers not included.........

 

[KLam]

Welcome to my life every day, twice a day.

It was moot anyway, the gridlock resulted in the express lanes being shut down for single occupant vehicles. Glad you didn’t end up wasting an hour of your life.

OK, here is a report on my drive this afternoon. Model S LR, Software v2023.7.30 ,FSD beta v11.4.7. Chill, Max speed offset 0. FCW Late, MLC not set, Navigation remap if exceed 10 min. Route North bound 110, entry at Sepulveda Blvd, Exit at 9th St. South bound, entry at 17th st, Exit at Carson.

Highlights:
1) E bound Sepulveda on middle lane, no auto lane changes. Speed at or below 40 mph speed limit. Two lane entrance to 110N, Left lane, last minute merge with no signal.
2) 110N, Auto lane change once while slowed by truck at around 45 mph. Speed limit is 65 mph..
3) Most of travel from 91 North are below 55 mph, some stop and go, I dialed down max speed to approx 20 mph above on going traffic. No auto lane change. Most travel are on lane one left of right most. Did couple of manual lane change by signalling,
4) GPS signal degraded at around Coliseum and Navigation degraded.
5) Traffic want to redirect to local at Adams Blvd north of 39 st. Disengage and manually drive to 9th st exit.
6) South bound mostly below Speed limit 65 mph. I dialed down to approx 20 mph above on going stop and go traffic. No auto lane change and unwanted slow down.
7) FSD tried to merge left to avoid on a last minute cut in of a truck from the right at 91 interchange. I disengaged and stay on lane as it seemed to have enough room for slow down and stop and I don't know whether if there was any car on my left.
8) My hands are on the yoke. No warning nags.

It seems that 11.4.7 is much better than NOA. Just "chill it" and you will be OK.

 

[mtndrew1]

OK, here is a report on my drive this afternoon. Model S LR, Software v2023.7.30 ,FSD beta v11.4.7. Chill, Max speed offset 0. FCW Late, MLC not set, Navigation remap if exceed 10 min. Route North bound 110, entry at Sepulveda Blvd, Exit at 9th St. South bound, entry at 17th st, Exit at Carson.

Highlights:
1) E bound Sepulveda on middle lane, no auto lane changes. Speed at or below 40 mph speed limit. Two lane entrance to 110N, Left lane, last minute merge with no signal.
2) 110N, Auto lane change once while slowed by truck at around 45 mph. Speed limit is 65 mph..
3) Most of travel from 91 North are below 55 mph, some stop and go, I dialed down max speed to approx 20 mph above on going traffic. No auto lane change. Most travel are on lane one left of right most. Did couple of manual lane change by signalling,
4) GPS signal degraded at around Coliseum and Navigation degraded.
5) Traffic want to redirect to local at Adams Blvd north of 39 st. Disengage and manually drive to 9th st exit.
6) South bound mostly below Speed limit 65 mph. I dialed down to approx 20 mph above on going stop and go traffic. No auto lane change and unwanted slow down.
7) FSD tried to merge left to avoid on a last minute cut in of a truck from the right at 91 interchange. I disengaged and stay on lane as it seemed to have enough room for slow down and stop and I don't know whether if there was any car on my left.
8) My hands are on the yoke. No warning nags.

It seems that 11.4.7 is much better than NOA. Just "chill it" and you will be OK.

So cool of you to take the time to do the drive, thank you!

 

[KLam]

So cool of you to take the time to do the drive, thank you!

No problem. One thing I forgot to mention is that on stop and go traffic. Every time when FSD beta slow down to a stop, it kind of do a little zig-zag yo-yo as if hunting for the correct lane position.

I will be driving up to SF this week end. This time I will see if it do better on 152 from I-5 to San Jose. NOA cannot handle some of the sharper curves over the mountain and the 2 lanes (one each direction) curvy farm section.

 

[JohnB007]

I don't think it will help with v12. The MLC setting is a telltale that it is impossible to set a heavy enough coefficient in the NN to say something absolute like "No lane change!"

The problem is that this used to be no issue zone. The current branch introduced this issue. I'm sure it will be fixed in time, but kinda annoying to live with it.

 

[AlanSubie4Life]

The road I was on was one lane each direction, along with a turn lane. The road I was crossing was two lanes in each direction, with a turn lane.

Miramar Rd & Cabot Dr · Transport interchange

San Diego, CA

maps.app.goo.gl

Didn’t work around here for the flashing red disabled signal.

There was construction too, so there was only one lane open, normally the center turn lane, and cones everywhere (which it managed to negotiate, poorly). Anyway, just sat there on Miramar, refusing to move.

In spite of the dynamic improvements, it still does not pass the wife test. Just accelerates inappropriately and slows down too suddenly on rural twisting highways like 79, 78 (it’s not awful usually, it is just inappropriate and far inferior to a reasonably skilled driver). “It’s too jerky.”

Only by passing this test would there be any further adoption, and even then the price is likely a bit too high.

 

[SK360]

I’ve been misinformed