FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[KLam]

The opposite of FSD.

I wondered if FSD detected these carts and AEB.

 

[Twiglett]

I have been having my best drives ever. However out of nowhere, while sitting as front car at a red light, the car just slowly started moving forward. I let it go a couple of feet, since there weren't any cars coming from either direction. My first red light runner in months. Just an FYI to be alert at red lights when you are in pole position. It has never ran this light before.

I had a similar WTF with 11.4.9 today.
Driving down a 60mph divided highway in the right lane, I noticed flashing yellow lights easily visible at least a half mile away. A work crew had the right lane closed for street light repair.
FSD-wtf just kept barreling along at 63mph, no sign of slowing down or moving over until I took over and braked quite firmly to give me time to signal and move over. Felt like the typical "emergency vehicle in the road therefore lets run into it" scenario, except I was paying more attention than the car was.

 

[JulienW]

Yea, I think Tesla is mucking with us. Seems the last couple of days Tesla has been throwing "crap" drives at us after a couple of weeks of improved drives.

 

[FSDtester#1]

Yea, I think Tesla is mucking with us. Seems the last couple of days Tesla has been throwing "crap" drives at us after a couple of weeks of improved drives.

Agreed, and my light show went off without a problem.
Did it Christmas Eve and day and New Years eve.
Still married as of now. My wife actually watched 2 or 3 shows before going inside with her friends to self medicate.
Kids and friends loved it. Can't wait until Halloween.
There are some scary a$$ shows to play. Will park by my front door. If only we could remotely control all the shows, that would be awesome. I know you can time the first one, but being able to do them all remotely would be great..

 

[Pdubs]

Yea, I think Tesla is mucking with us. Seems the last couple of days Tesla has been throwing "crap" drives at us after a couple of weeks of improved drives.

Maybe to make us appreciate v12.x more? I mean, they can't release 12 and have it worse than 11 so they're polluting 11?

Just a thought.

Kind of like @FSDtester#1 only able to have friends worse looking than him, so people think he favors more than he does?

 

[Pdubs]

Agreed, and my light show went off without a problem.
Did it Christmas Eve and day and New Years eve.
Still married as of now. My wife actually watched 2 or 3 shows before going inside with her friends to self medicate.
Kids and friends loved it. Can't wait until Halloween.
There are some scary a$$ shows to play. Will park by my front door. If only we could remotely control all the shows, that would be awesome. I know you can time the first one, but being able to do them all remotely would be great..

Would love you to share your files with me

 

[FSDtester#1]

Would love you to share your files with me

Go to town, this is just one of them.

Tesla Light Share | The First & Biggest Tesla Light Show Platform

Explore 700+ premium Tesla Light Shows for free. Featuring festive displays for Halloween, Christmas, and captivating theme songs and more.

teslalightshare.io

This is one of my favorites... sums up some of our experiences.

 

[Dewg]

I have been having my best drives ever. However out of nowhere, while sitting as front car at a red light, the car just slowly started moving forward. I let it go a couple of feet, since there weren't any cars coming from either direction. My first red light runner in months. Just an FYI to be alert at red lights when you are in pole position. It has never ran this light before.

Did visualisations indicate it was stopping for a traffic light when approaching the intersection? I'm curious if it identified it as a stop light or stop sign.

 

[kabin]

2023.44.30.7 releases are still ramping up.

 

[FSDtester#1]

Did visualisations indicate it was stopping for a traffic light when approaching the intersection? I'm curious if it identified it as a stop light or stop sign.

It did. Came to a complete stop for about 30 seconds, then just started slowly rolling into intersection. Like an ice car with foot off the brake.

 

[WilliamG]

Maybe to make us appreciate v12.x more? I mean, they can't release 12 and have it worse than 11 so they're polluting 11?

Just a thought.

Kind of like @FSDtester#1 only able to have friends worse looking than him, so people think he favors more than he does?

Na that makes no sense. That would be like the equivalent of them making auto wipers unusable earlier this year and then fixing it in the holiday update to make us so gratefohhhhh wait…

 

[powertoold]

First I've heard of pothole/manhole avoidance on FSD Beta 11.4.9. We'll see if others experience it or if it there was another cause of what Chuck saw:

https://twitter.com/x/status/1736362779953488173

11.4.9 seemed like it avoided a ~1.5in deep pothole for me today at around 5-10mph. It could have been a fluke, but based on my 2 yrs+ experience with FSD, this looked intentional (I saw a curve on the blue path visualization just as it dodged the pothole)

 

[kabin]

11.4.9 seemed like it avoided a ~1.5in deep pothole for me today at around 5-10mph. It could have been a fluke, but based on my 2 yrs+ experience with FSD, this looked intentional (I saw a curve on the blue path visualization just as it dodged the pothole)

That would be nice but I haven't had success with 11.4.9 slowing or acknowledging storm water trenches etc.

 

[JulienW]

I drive in Atlanta every day and mine NEVER seems to miss an opportunity to hit a manhole cover. NEVER had it make any kind of avoidance maneuver of a manhole cover or pothole.

Don't use MySpace (although do help finance it by owning TSLA) so not sure but does Chuck say what streets this was on? Would love to try them if in the city.

 

[FSDtester#1]

Just did my daily software check, 2023.44.30.7 was waiting

 

[powertoold]

Here's the gif of avoiding pothole, you can see it bias towards the left and then curve back

 

[MP3Mike]

Just did my daily software check, 2023.44.30.7 was waiting

It sort of looks like they are consolidating everyone on to this version. (People coming from both 2023.44.30.5.1 and 2023.44.30.6.)

 

[JulienW]

Here's the gif of avoiding pothole, you can see it bias towards the left and then curve back

View attachment 1005436

Mine must think there are potholes EVERYWHERE since it is always weaving like that.

 

[fasteddie7]

Definitely had my car run a red light. Even recorded it both times via dashcam. Definitely isn’t the most fun feeling, let me tell you.

Was there cross traffic lights? My car sees the cross traffic light turn green and then runs my red light.

 

[JulienW]

I'm recently having kida the opposite problem. Driving in the left lanes it "sees" the red light and tries to stop. It never used to do this (or at least it has been MANY versions ago).