FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[cbdream99]

Night school?

No school. It just decided to stop.

 

[Mr. Michael]

Finally installed 30.5.1. New map downloaded yesterday. Still drives down the middle of unmarked roads, still doesn’t know a lot of speed limits, still blows through stop signs, still turns like it’s the first time it ever turned. Then has the audacity to tell me to pay attention in the middle of a turn, so then I increase pressure on the wheel and it shuts down and asks why it shut down. This thing will never, ever work. It’s all been one long, sad, bum’s rush to sell stuff. Even the “premium” maps display an image that is at least 4 years old. In my continued disappointment, I perused the menu and found my answer to all these problems. You can turn TACC off (new to me). Now cruise control works just like a dumb old cruise control - no crazy slowdowns. Doing a bit of manual steering I found that isn’t nearly as difficult for me as for the car, so do I really need that? Maybe the $25K car is the same as a model 3 but none of the very expensive computers and sensors.

 

[Supcom]

You can turn TACC off (new to me). Now cruise control works just like a dumb old cruise control - no crazy slowdowns.

Please elaborate on how you do this. I've never seen anyone claim that a dumb cruise control is available on a modern Tesla.

 

[cbdream99]

The unexpected turning into the turn lane continues to drive me nuts especially on state highway traveling at 60 mph! The logic doesn't make sense, the actual turn is still mile(s) away, clear traffic ahead but it decided to turn into it, which can be catastrophic in high speed; sometimes when it comes to the actual turn, it won't turn early into the turn lane until almost at the fork. The worse case is stopping in the middle of the road from the outer lane and then makes a turn across two lanes.

Also there is a new behavior - couple of times when it almost stops at the red light or when it begins to move, it makes a sudden whack a mole jerk on the steering wheel, enough to escape from my grip and scares me to brake. I have seen this in much earlier release but it appeared it returns now.

Maybe FSD is just seeing things from a different earth ..

 

[Supcom]

The unexpected turning into the turn lane continues to drive me nuts especially on state highway traveling at 60 mph! The logic doesn't make sense, the actual turn is still mile(s) away, clear traffic ahead but it decided to turn into it, which can be catastrophic in high speed; sometimes when it comes to the actual turn, it won't turn early into the turn lane until almost at the fork. The worse case is stopping in the middle of the road from the outer lane and then makes a turn across two lanes.

Also there is a new behavior - couple of times when it almost stops at the red light or when it begins to move, it makes a sudden whack a mole jerk on the steering wheel, enough to escape from my grip and scares me to brake. I have seen this in much earlier release but it appeared it returns now.

Maybe FSD is just seeing things from a different earth ..

Mistakenly moving into a turn lane appears to be a case of FSD perception misidentifying the turn lane as a new straight through lane. FSD acts as if it is just attempting to stay in the leftmost lane. It seems like a gradual opening of the turn lane may trigger the wrong identification. I've had FSD move into one of these lanes, then, if it's long enough, move back out almost immediately. Usually, I can't give it a chance to do this.

I know a couple roads where FSD will attempt to use every other turn lane. In such case, I find it helps to change to the right lane and put minimal lane changes on. Or, just drive manually until I get past the area where the car has difficulty.

 

[Mr. Michael]

In the “Autopilot” menu towards the bottom you can turn TACC off.

 

[Mr. Michael]

For some reason it just doesn’t chime, it makes no indication at all that you are using it.

 

[sleepydoc]

In the “Autopilot” menu towards the bottom you can turn TACC off.View attachment 1006592

uh...That's just the chime.

 

[Mr. Michael]

I also have “Autopilot” off as well.

 

[uscbucsfan]

I also have “Autopilot” off as well.

You are using TACC with no chime...not quite dumb cruise.

 

[Steel Chicken]

V11.4.9 has some improvements, its often more aggressive when it should be, which is nice. However, it is still mostly retarded and will stop in the middle of an intersection for no reason and do other really dumb and dangerous stuff. Really disappointed after owning this car for two years and seeing little no real improvement. And the nagging has definitely gotten worse. I literally turn it on (FSD) and one second later its nagging me. **** off, thing.

 

[cbdream99]

Mistakenly moving into a turn lane appears to be a case of FSD perception misidentifying the turn lane as a new straight through lane. FSD acts as if it is just attempting to stay in the leftmost lane. It seems like a gradual opening of the turn lane may trigger the wrong identification. I've had FSD move into one of these lanes, then, if it's long enough, move back out almost immediately. Usually, I can't give it a chance to do this.

I know a couple roads where FSD will attempt to use every other turn lane. In such case, I find it helps to change to the right lane and put minimal lane changes on. Or, just drive manually until I get past the area where the car has difficulty.

Sure, I already know how to get around the problem. It is likely the case the vision bias thinks a lane is open up but the decision it made without considering other factors at the moment is a serious flaw and I see the problems on both sides, this makes the city usage very problematic and dangerous especially if traveling to a new and unfamiliar area.

 

[jebinc]

In the “Autopilot” menu towards the bottom you can turn TACC off.View attachment 1006592

That’s only the chime that can be turned off!

 

[AlanSubie4Life]

FSD acts as if it is just attempting to stay in the leftmost lane.

Remember it also veers into right-turn lanes. For example, it has done it here when navigation said to go straight ahead (this was on the late-October version):

Google Maps

Find local businesses, view maps and get driving directions in Google Maps.

www.google.com

I suppose it wanted to stay in the rightmost lane? No idea. Happened multiple times.

 

[aronth5]

I've had FSD slow down for speed bumps quite often... occasionally there's an update that seems to kill the feature but probably at least 3/4 of the time it's there... it only slows down to like 17ish, but it for sure slows down

Typical speed bump with markings that FSD always ignores.

 

[Yelobird]

Typical speed bump with markings that FSD always ignores.
View attachment 1006646

Interesting looks more like a bridge than a ramp. Never seen speed bumps like that in my region.

 

[Supcom]

In the “Autopilot” menu towards the bottom you can turn TACC off.View attachment 1006592

The chime has nothing to do with how cruise control operates. Your user manual explains this setting.

There is, in fact, no means to disable the traffic aware function of cruise control.

 

[Iain]

Interesting looks more like a bridge than a ramp. Never seen speed bumps like that in my region.

Boston never recovered from “the big dig”

 

[aronth5]

Interesting looks more like a bridge than a ramp. Never seen speed bumps like that in my region.

Very little standardization across the state in Massachusetts which makes it hard for FSD but the 5 in the center of town are all the same.
There is a speed bump in the next town that is twice the size without any markings 5 mph max. Fortunately it's in a parking lot road so vehicles aren't traveling too fast.

 

[AndrewZ]

Maybe the $25K car is the same as a model 3 but none of the very expensive computers and sensors.

I don’t think the computer and sensors are actually that expensive, EAP/FSD are basically pure profit