FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[gsmith123]

It is illegal to hit bicyclists in this bike lane (also in general).

Lol.

I am leery of testing these blind-spot and being-passed-on-the-right situations, but I suspect the two backward looking cams will keep us out of trouble.

I've tested this (and it was even at night and the bike had no lights!). The car was very careful and correctly yielded to the bike coming up from behind on the right. It just stopped in it's lane with the right turn signal on waiting for the bike. Good stuff! As a cyclist it makes me very happy that it can handle this.

The repeater cameras are well positioned to see cyclists in this position (easy for humans to miss them though)

 

[gsmith123]

No need for pages of discussion. You should only do what is legal! Follow the law.

This thread would disagree (see follow distance and speed limit discussions)

 

[DarkForest]

Similar idiotic experience posted earlier; replace “bicycle lane” with “clearly delineated shoulder”.

View attachment 924070

Hmmm… getting onto the shoulder to make a right turn on the 65 mph county roads in my area is basic courtesy.

 

[jebinc]

Hmmm… getting onto the shoulder to make a right turn on the 65 mph county roads in my area is basic courtesy.

Hmmm, no… this is a 25mph, well marked road next to a school with a stop sign “Y” intersection….

 

[JB47394]

JB

Loudon county parkway at RT 7 northbound to westbound 7
Also

Willard road WB to Rt 28 SB

Left turn both cases

I just did a quick run over.

Route 7 Westbound to Loudoun County Parkway Southbound from the right lane

I engaged FSD as I approached a yellow light. Car stopped, waited for the green, then navigated the intersection perfectly.

Loudoun County Parkway Northbound to Route 7 Eastbound from the left lane

I pulled up to a red light on FSD, but had a lead car. I disengaged, moved over to the left lane and reengaged. Car waited for the green, then navigated the intersection perfectly.

I'm on 11.3.3

I had other stuff to report such as a dangerous merge, and choosing to change lanes such that it would take Route 28 Southbound when I was on Route 7 Eastbound. Sigh. I noticed that FSD really works nicely when nobody is around, but the moment you introduce other cars, it gets pretty nervous. I wonder if HW4 is needed to give it enough information to relax.

 

[PACEMD]

Oh no! Now we're gonna have a week of discussion about if cars are supposed to drive in the bike lane or not when making a right turn over a bike lane.

Yeah, my M3P kept to the bike lane so often I had to dress it up in an electric bike costume. My Trek Rail electric mountain bike is still jealous.

 

[PACEMD]

45 min from notiicarion of start

Weird, is that when they warn you about a dead body right off the bat?

 

[WilliamG]

Hmmm… getting onto the shoulder to make a right turn on the 65 mph county roads in my area is basic courtesy.

But… isn’t it also illegal? Some people also see it as a courtesy to pull up FIRST to the stop sign, wait for me to stop, then wave ME across first like they’re doing me a favor. No. Just obey the rules of the road and go first since you got there first. Grrr.

 

[jebinc]

But… isn’t it also illegal?

“Hmmm,” I believe it is…

To add some more “color” to my example, I was behind a lead car that was stopped and waiting their turn. As I approached, FSDb did a hard right and parked half inside the shoulder and half on the road - at a very awkward angle. The person behind me looked very confused/pissed. When the lead car moved through, FSDb did a hard left to move up and then another hard right to make the turn. Failed at this basic right turn. And, “Hmmm” don’t get me going about roundabout non-performance….

 

[bayareaever]

V11 is definitely improved overall but still blows through several uncontrolled and low visibility 4 way intersections in my neighborhood which all previous versions have also done. It’s somewhat surprising considering the nhtsa recall. One of them has two yield signs but it also ignores them entirely.

It seems like a gross oversight that the software apparently only considers the ego’s traffic control but not the cross traffic control.

It’s also still surprised by foliage-occluded stop signs. Obviously it will need to develop a ‘memory’ as human drivers won’t ever forget about a stop sign even if it’s occluded.

 

[Goose66]

Ok, we’ve gotten to the point where 80% of testers have 11.3.x version installed. I know someone has to be in the last 20%, but it seems a lot of those would be folks who’ve lost interest or don’t have a wifi connection in their car, etc. Is it time to panic?

 

[jebinc]

Ok, we’ve gotten to the point where 80% of testers have 11.3.x version installed. I know someone has to be in the last 20%, but it seems a lot of those would be folks who’ve lost interest or don’t have a wifi connection in their car, etc. Is it time to panic?

I would say not time (to panic). Instead, be thankful (you don’t have it)! I suspect another dot release is coming to fix some of the blatantly bad performance (e.g., roundabouts, shoulder and bike lane “diving”…) of 3.2,3.3,3.4 and 3.5…. 3.6, anyone? Fifth time’s a charm?

 

[scottf200]

Start to finish only took 45 min from notiicarion of start to notification of completion. As sort of typical there was a pause at 60% that took a large part of the last 20 to continue.

TeslaFI.COM added an interesting feature a while back that tells you the install time. Examples for me:

 

[Dewg]

Ok, we’ve gotten to the point where 80% of testers have 11.3.x version installed. I know someone has to be in the last 20%, but it seems a lot of those would be folks who’ve lost interest or don’t have a wifi connection in their car, etc. Is it time to panic?

I still don't have it, but I'm patient and don't mind waiting for the final version of 11.3

 

[boonedocks]

My only two real complaints with V11.* so far

Highway driving no longer recognizes the entry exit points of the PeachPass (Atlanta GA version of HOV LANE). Have to manually enter and exit them now.

Streets with a short “go around” lane when traffic is turning and stopped has now become a lane change veer onto lane and immediately back in

Example:

 

[valem]

I still don't have it, but I'm patient and don't mind waiting for the final version of 11.3

Will there ever be a final version? I think the final version of V11 will be when V12 comes out...

 

[Dewg]

Will there ever be a final version? I think the final version of V11 will be when V12 comes out...

Yes, each point release has a final version. 11.3.x before 11.4 is released.

 

[aronth5]

How are people doing with speed bumps? For me 90% are missed so I end up disengaging and file a report for what good it will do.
Most have warning signs and most are painted. Speed bump support hasn't changed since I started. Always bad.
It would be great if Tesla allowed a way to add speed bumps but then you can be sure someone would add speed bumps where they don't exist just for fun.

 

[WilliamG]

How are people doing with speed bumps? For me 90% are missed so I end up disengaging and file a report for what good it will do.
Most have warning signs and most are painted. Speed bump support hasn't changed since I started. Always bad.
It would be great if Tesla allowed a way to add speed bumps but then you can be sure someone would add speed bumps where they don't exist just for fun.

For Model S and X, it should easily be able to tell what's speed bump just via fleet data of the air suspension.

Speaking of which, Tesla made this huge deal out of being able to gather air suspension data from the fleet so that your car adjusts its suspension before the uneven road. Well that's pretty funny. Over on the West Seattle Bridge the road used to be really bad, and the car would adjust itself and give the message that it was doing so. Well, it's been months and months since the bridge was fixed, and it still raises suspension for comfort for NO REASON AT ALL now. Heck, why am I even surprised? Oh right, I'm not.

 

[Midnightsun]

Just installed and tried 45.13 Oh my this one works well. Drove for a couple of hours on rural streets and highways. Only hiccup I saw was coming to a 3 way intersection where I was supposed to turn right. Everything worked as it should however the car came to a full stop before turning however there is no stop sign. Every move seems so much smoother and real life like as if I was driving. Definitely on the right track for getting this right.

Both cars wanted the 45.13 update this morning. Unusual as they usually are a few to several days apart.