FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[jebinc]

R.I.P., v11.3.2

 

[jebinc]

Installed 11.3.2 FSD beta….

Seems that Tesla has gone out of their was to attempt to kill you with this version.

Notably:

- You cannot turn off auto lane change while in FSD
- it appears that the car now likes to change into lanes that aren’t actually lanes. The resulting issue is either hitting a barrier in the center of the road, smashing into another car, or driving off the road.

Woot. Awesome. Why do they screw with things? Seriously for what good purpose is it to not allow you to turn off auto lane change?

Junk

 

[Dewg]

Why do they always have to be dudes... that's a sexist comment and now my feelings are hurt and have to go to my safe room for 3 hours. Thanks a lot!

Where's the doc when you are in need.... paging @PACEMD

You didn't include a trigger warning before you stated your hurt feelings. Tsk tsk tsk.

 

[Dewg]

I miss that guy, where’s he at?!

I miss that guy, where’s he at?!

Paging @2101Guy
Paging @2101Guy

OMG - WHAT ARE YOU GUYS DOING?!?!?!? That's like playing with a Ouija board and asking for a demon to come inhabit your house. Both of you go outside right now and turn around 3 times and spit. DO IT!

 

[kabin]

There's a new utube obstacle avoidance test (part 2) by AI Drivr. V11 performs comparably to V10 as one would expect given it's basically the same hardware and software. I'm pretty sure the results are also about the same as what O'Dowd claims.

It really is odd how FSD drives through a box in the middle of the road, doesn't highlight an oncoming vehicle vectoring into the ego's path, doesn't stop fast enough for sudden objects in path, etc. Definitely not better or safer than an average driver.

 

[JulienW]

There's a new utube obstacle avoidance test (part 2) by AI Drivr. V11 performs comparably to V10 as one would expect given it's basically the same hardware and software. I'm pretty sure the results are also about the same as what O'Dowd claims.

It really is odd how FSD drives through a box in the middle of the road, doesn't highlight an oncoming vehicle vectoring into the ego's path, doesn't stop fast enough for sudden objects in path, etc. Definitely not better or safer than an average driver.

Click here

Wiki - FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN. From AI day and Lex Fridman interview we have a good sense of what might be included. - Object permanence both...

teslamotorsclub.com

 

[Scott Chapman]

BACK to V11. A little funny (or sad for me and most). Installs of 10.69.25.2 have been closing in on 11.3.2 and today thay are on parody. Feels almost like we are backing up.

View attachment 920668

I'm more than a little peeved that there are some 83 people that still haven't recieved the upgrade. I mean who are they? Clearly no one on this thread. What would happen if something were "to happen" to them?

 

[Dewg]

There's a new utube obstacle avoidance test (part 2) by AI Drivr. V11 performs comparably to V10 as one would expect given it's basically the same hardware and software. I'm pretty sure the results are also about the same as what O'Dowd claims.

It really is odd how FSD drives through a box in the middle of the road, doesn't highlight an oncoming vehicle vectoring into the ego's path, doesn't stop fast enough for sudden objects in path, etc. Definitely not better or safer than an average driver.

It's coming - it's a work in progress. It's going to take time to train the occupancy network to recognize a massive set of objects that represent what's drivable and not drivable. For example, I don't want the car to panic brake because a dark/black plastic shopping bag floats up a few inches from the ground.

As an L2, we as drivers can override - if there is a box in the lane, and you don't want to hit it, take over and maneuver around the box, then re-engage.

 

[Ramphex]

I’m just here so I won’t get fined

 

[PACEMD]

A larger number times zero is still zero.

Well, maybe but you can't always count on it. Sometimes it just doesn't add up to much.........

 

[PACEMD]

Is it "simple"? I get over when it's best to get over...my brain doesn't have this "a mile or two" value you have. I will wait to get past any other merge/exit points, for instance. If that means I need to wait until the last 1/2 mile, that's what I'll do.

Right, what he said. It's best you get over yourself........

 

[PACEMD]

I wish there was a stat in the profile to see the # of people you’re ignored by

I'm gonna ignore that you said that.....

 

[Ramphex]

I'm gonna ignore that you said that.....

You can checkout anytime you’d like, but you can never leave

 

[PACEMD]

You can checkout anytime you’d like, but you can never leave

I'll leave it to you to check that out.........

Hey, what's up with that 11.3.2 business?

 

[Ramphex]

I'll leave it to you to check that out.........

Hey, what's up with that 11.3.2 business?

Asystole

 

[PACEMD]

Asystole

Shocking!

 

[PACEMD]

Gathered again in the rabbit hole waiting on dinner........

 

[azred]

For anyone with the new 11.3.2: How does it handle lane changes on freeways while using navigation? Are they automatic — and annoying — like City Streets while navigating? (I seldom use navigation and FSD together on City Streets due to the excessive and bizarre lane changes.)

 

[aronth5]

Wait what? you've never heard of a zipper merge? What do you do in the TONS of situations around here were 2 lanes suddenly become one?

In my town, they used to just have a sign that represented "right lane ending." Now they replaced it with an "alternate merge" sign, which is the zipper.

The sign replacement was a godsend because now people use both lanes equally; whereas before, people treated the right lane as the cheat lane, making the left lane people tailgate to prevent the right side from merging in.

Nope never heard of it. Starting driving a long time ago which I guess explains it. I just merge in as gracefully as possible. It's interesting how many YouTube videos complain about FSD waiting too long till the end to merge.

 

[PACEMD]

Shocking!

The layer 3 joke is that asystole is a non-shockable rhythm, sometimes you can pace it but more likely dead in the water.........