FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[PACEMD]

Unless you’re going precisely 88 MPH…

True. Science is science..........I've done my research.........

 

[PACEMD]

So I'm still with the poor relatives on 2023.44.30.8 but I have to say this is the best FSDj I've had to date. And don't tell my wife about my dating habits, please. But......on my last four 150-mile interstate commutes I have not gotten a single warning, not for eyes, pay attention, wheel hands, nothing, nada, zilch.........used to be that way with NOA before we had FSDb.

 

[sleepydoc]

So I'm still with the poor relatives on 2023.44.30.8 but I have to say this is the best FSDj I've had to date. And don't tell my wife about my dating habits, please. But......on my last four 150-mile interstate commutes I have not gotten a single warning, not for eyes, pay attention, wheel hands, nothing, nada, zilch.........used to be that way with NOA before we had FSDb.

But were you using it on the drive or was the junk just along for the ride?

 

[scottf200]

This AI DRIVR example was something else!
Comments by Ethan Knight Vision lead @Tesla_AI

https://twitter.com/x/status/1760764608326123657

 

[PACEMD]

But were you using it on the drive or was the junk just along for the ride?

I don't know, I was out of town when that sh*t happened...........

 

[fasteddie7]

I suspect you might mean "can not get it *yet*."
Pretty sure cars in that situation won't be dead-ended WRT FSD. Honestly, waiting for FSD V12 might be for the best anyway, because FSD V11 was a nightmare.

It looks like there may be a forked scenario that has happened in the past where higher firmware versions got fewer point release updates than the lower firmware. So when you get v12 the others will get several point releases you may never see. On the flip side, those vehicles received QOL features and improvements that were not FSD related way before the early FSD group.

 

[FOOLSLFDRVNG]

I don’t expect 12 to get a wide release especially with Whole Mars Catalog being disappointed and this latest video below. Most likely we won’t see it for 2 months when we are starved for anything however bad it is finally released, people will swear how mind blowing it is and v13 will bring Tesla $400 a share.
.

https://twitter.com/x/status/1760846858564612144

 

[FOOLSLFDRVNG]

I don’t expect 12 to get a wide release especially with Whole Mars Catalog being disappointed and this latest video below. Most likely we won’t see it for 2 months when we are starved for anything however bad it is finally released, people will swear how mind blowing it is and v13 will bring Tesla $400 a share.
.

https://twitter.com/x/status/1760846858564612144

Teslafi indicates 12 is dead and we all get to enjoy 11.

 

[JulienW]

Teslafi indicates 12 is dead and we all get to enjoy 11.

Yea man that's cool so......bring on 11.420 so we can chill and don't have to sweat it out while tripping about v12.69.

 

[PR0FESSOR]

v12.69 (or is it 69.12; I am so confused about version numbers these days) is the version that @PACEMD wants, because it will not tell his wife about his penchant for certain ahem… positions.

Yea man that's cool so......bring on 11.420 so we can chill and don't have to sweat it out while tripping about v12.69.

 

[PR0FESSOR]

I am on the Track Package version of this software release, and I have little hope of ever getting off of it.

Software Engineer 1: Your Kingship, it is 2036 now, do you think we can upgrade the Model S Plaid people who have the Track Package now?

King Muskedine: Let them wait, they were foolish enough to “invest” in the track pac umm k pa gurgle kag (urn) eeeeee (King Muskedine drools all over the floor and software engineer 1).

Software Engineer 2: Software Engineer 1, I think his majesty has been snorting shrooms and ketamine mixed with cocaine and bovine urine.

King Muskedine: eye wuz notttttt…what is youze saainggggg. I nver tsted pissative evan 1nce. I fur you atfer iz woke pu frm dis legly purrscribded mdcnidnen.

(King Muskedine starts swimming in his vomit and then passes out)

Software Engineer 1: Do you think we should get his nose and mouth out of the vomit?

Software Engineer 2: No, this happens all the time. King Muskedine gets angry if he doesn’t have something to eat when he wakes up.

Software Engineer 1: How stupid people who bought the Model S Track Package are.

Software Engineer 2: Oh, that’s right. I think tha…

(Slurping sounds begin emanating from the floor)

Software Engineer 1: The King is waking up, we’d better get out of here.

King Muskedine: keeen sumones get me a spoon?

(Both engineers bolt out of the King’s antechamber)

Fade to Black

 

[FOOLSLFDRVNG]

Yea man that's cool so......bring on 11.420 so we can chill and don't have to sweat it out while tripping about v12.69.

I am on the Track Package version of this software release, and I have little hope of ever getting off of it.

Software Engineer 1: Your Kingship, it is 2036 now, do you think we can upgrade the Model S Plaid people who have the Track Package now?

King Muskedine: Let them wait, they were foolish enough to “invest” in the track pac umm k pa gurgle kag (urn) eeeeee (King Muskedine drools all over the floor and software engineer 1).

Software Engineer 2: Software Engineer 1, I think his majesty has been snorting shrooms and ketamine mixed with cocaine and bovine urine.

King Muskedine: eye wuz notttttt…what is youze saainggggg. I nver tsted pissative evan 1nce. I fur you atfer iz woke pu frm dis legly purrscribded mdcnidnen.

(King Muskedine starts swimming in his vomit and then passes out)

Software Engineer 1: Do you think we should get his nose and mouth out of the vomit?

Software Engineer 2: No, this happens all the time. King Muskedine gets angry if he doesn’t have something to eat when he wakes up.

Software Engineer 1: How stupid people who bought the Model S Track Package are.

Software Engineer 2: Oh, that’s right. I think tha…

(Slurping sounds begin emanating from the floor)

Software Engineer 1: The King is waking up, we’d better get out of here.

King Muskedine: keeen sumones get me a spoon?

(Both engineers bolt out of the King’s antechamber)

Fade to Black

I loved Shakespeare in high school, my favorite was Cliff’s notes.

 

[FOOLSLFDRVNG]

Yea man that's cool so......bring on 11.420 so we can chill and don't have to sweat it out while tripping about v12.69.

Goimg to be a late Christmas present this year released for next year ETA March 2025.

https://twitter.com/x/status/1761441347456880928

 

[hybridbear]

Goimg to be a late Christmas present this year released for next year ETA March 2025.

https://twitter.com/x/status/1761441347456880928

Where's the video?

 

[scottf200]

Where's the video?

I think the comments said he was waiting for the file from his friend.

 

[MP3Mike]

Where's the video?

It looks like it is here:

https://twitter.com/x/status/1761811308176196082

Not much there.

 

[Knightshade]

So much for the folks who kept insisting with V12 Tesla had solved the whole "car forgets things are there as soon as they're in the blind spots" issue

https://twitter.com/x/status/1761817429594755293

 

[JulienW]

It looks like it is here:

Not much there.

Horrible driver error. Going 2MPH gives the driver over a second to react. Clearly it was not lined up for the spot or anything else. I "pressed the brake" the first time I watched it. Uncomfortable = disengage

 

[FOOLSLFDRVNG]

Horrible driver error. Going 2MPH gives the driver over a second to react. Clearly it was not lined up for the spot or anything else. I "pressed the brake" the first time I watched it. Uncomfortable = disengage

It could be the pillar blind spot and who knows how FSD reacts especially when it does a sudden pause and twitch. Some people are more confident than others at the expense of paying for and being a beta tester. After seeing numerous accidents on autopilot and FSD, I no longer am as brave.

 

[diplomat33]

On the current V11 version, I noticed two interesting behaviors:

1) Approaching a brand new traffic light that was recently installed but is inactive (there are bags covering the lights), FSD Beta detected the traffic light and stopped. I got the "stopping for traffic light" message on the screen. I needed to press the accelerator to make the car go. So FSD beta 11 knows there is a traffic light from the cameras but does not know that the traffic light is inactive and should be ignored.

2) When approaching a railroad crossing, with no traffic, no train coming, sometimes FSD beta stops at the stop line for the railroad crossing and sometimes it just keeps going. I have no idea why FSD beta sometimes stops and sometimes does not stop as the conditions seem identical in both cases.