FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[PR0FESSOR]

“and behold, joy and gladness,
killing pedestrians and slaughtering bicyclists,
crushing flesh and drinking wine from a Tesla chalice.
Let us eat and drink,
for tomorrow we die.”

FSDbj 22:13

Joe

What was it Jesus said about FSDb?

 

[LSDTester#1]

Teach a man to change his software preference from standard to advanced and he will get the latest updates faster... lol

This is SUCH A CHEAP SHOT

 

[sleepydoc]

Let's just call it Ludicrous Chicken..........a game the whole family can enjoy.........

Only Colonel Sanders get's the ludicrous chicken mode!

 

[AlanSubie4Life]

Sadly 2023.27.6 has broken the ability to do voice commands (No Connectivity error). Many reboots did not resolve. Maybe it'll resolve once I let my Premium Connectivity expire.

And one dry wipe mid-day.

Had it do some surface streets and it was pretty awful about braking especially on downhills. How hard is it to anticipate and gauge how early to start slowing down? To be clear, this may not be a new development, no idea, really. Performance prior to now has been inconsistent. The jerkiness is probably improved from much earlier versions, as discussed earlier here, but friction brake use is out of control still. Ironically it seemed to use brakes much less on stop signs, the one place it would make sense to use friction brakes to improve throughput by increasing average speed.

Wife was not in the car for this one (it's been banned (on surface streets) until the next release that demonstrates significant improvements on surface streets), but certainly it would have failed the Wife Test.

Lots of work to do on the fundamentals still. If they can figure out how to go and how to stop, we'll really be cooking. Not there yet, though!

I doubt v12 will get us there, though maybe it'll somehow be more optimal. Just seems really unlikely. I can't wrap my head around how v12 will work unless it is not exactly what was advertised.

 

[PACEMD]

Only Colonel Sanders get's the ludicrous chicken mode!

No One Writes to the Colonel. Gabriel García Márquez.

 

[PACEMD]

“and behold, joy and gladness,
killing pedestrians and slaughtering bicyclists,
crushing flesh and drinking wine from a Tesla chalice.
Let us eat and drink,
for tomorrow we die.”

FSDbj 22:13

Joe

That's the one I was thinking of.......

 

[PACEMD]

Sadly 2023.27.6 has broken the ability to do voice commands (No Connectivity error). Many reboots did not resolve. Maybe it'll resolve once I let my Premium Connectivity expire.

Maybe it just doesn't like the sound of your voice anymore. Happened to me once back in the Before Times.........

 

[Supcom]

I tested turnout lane change errors today on a four-lane divided highway (TX-24 north of Commerce, TX) (not limited access) that has many left turnout lanes. I used FSD 11.4.7.2. Not surprisingly for a minor point release, the car showed no improvement over 11.4.7 and attempted to enter about half of the turnout lanes when it was to continue straight.

I noticed two interesting things that might explain what is going on. First is that the car did not activate the turn signal as it moved into the turn lane. The second was at one point I used the turn signal to initiate a lane change to the right just before reaching a left turnout lane. Even though the right turn signal was active, the car attempted to enter the left turnout lane! Third, I found that even with Minimal Lane Changes active, if the car was in the left lane, it still attempted to enter left turnouts.

From these, I infer that the car is actually not attempting to change lanes into the turnout lane, but mistakenly thinks that the turnout lane is the continuation of the left through lane. This particular stretch of highway has turnout lanes that have a more gradual opening than most, so there may be something about that that doesn't trigger an NN designed to detect turnouts.

 

[Joboo7777]

I tested turnout lane change errors today on a four-lane divided highway (TX-24 north of Commerce, TX) (not limited access) that has many left turnout lanes. I used FSD 11.4.7.2. Not surprisingly for a minor point release, the car showed no improvement over 11.4.7 and attempted to enter about half of the turnout lanes when it was to continue straight.

I noticed two interesting things that might explain what is going on. First is that the car did not activate the turn signal as it moved into the turn lane. The second was at one point I used the turn signal to initiate a lane change to the right just before reaching a left turnout lane. Even though the right turn signal was active, the car attempted to enter the left turnout lane! Third, I found that even with Minimal Lane Changes active, if the car was in the left lane, it still attempted to enter left turnouts.

From these, I infer that the car is actually not attempting to change lanes into the turnout lane, but mistakenly thinks that the turnout lane is the continuation of the left through lane. This particular stretch of highway has turnout lanes that have a more gradual opening than most, so there may be something about that that doesn't trigger an NN designed to detect turnouts.

Strange thing for me is 11.3.6 did not do this as much(if at all). It wasn’t until 11.4 that I experienced these type of issues. I still think poor GPS data/accuracy is contributing to the issue.

In addition, when traveling the same road sometimes the car initiates blinker, sometimes not. At the same exact spot.

 

[jebinc]

Done properly there is no grinding just a click

Yep, lining up the synchros with the right RPM. Am I old , or what?!

 

[WilliamG]

And the lord sayeth, that whichith be solved, becomith unsolved by the righteous hand of thine lord’s unhumble garden gnome, eshorticus minimus muskis.

FSDbj 3:16

Joe

Joe, you took the words right out of my mouth, literally. And by literally, I do mean literally.

 

[FSDtester#1]

Maybe it just doesn't like the sound of your voice anymore. Happened to me once back in the Before Times.........

A Mad Max clip??? Especially that one... you are definitely not allowed to write me any prescriptions Doc...

I bet in real life you are the guy with the dog and helicopter from episode 2
A.k.a "The Road Warrior"

 

[KLam]

I tested turnout lane change errors today on a four-lane divided highway (TX-24 north of Commerce, TX) (not limited access) that has many left turnout lanes. I used FSD 11.4.7.2. Not surprisingly for a minor point release, the car showed no improvement over 11.4.7 and attempted to enter about half of the turnout lanes when it was to continue straight.

I noticed two interesting things that might explain what is going on. First is that the car did not activate the turn signal as it moved into the turn lane. The second was at one point I used the turn signal to initiate a lane change to the right just before reaching a left turnout lane. Even though the right turn signal was active, the car attempted to enter the left turnout lane! Third, I found that even with Minimal Lane Changes active, if the car was in the left lane, it still attempted to enter left turnouts.

From these, I infer that the car is actually not attempting to change lanes into the turnout lane, but mistakenly thinks that the turnout lane is the continuation of the left through lane. This particular stretch of highway has turnout lanes that have a more gradual opening than most, so there may be something about that that doesn't trigger an NN designed to detect turnouts.

Can you chill out on the right lane and with Max speed set at right lane traffic speed?

 

[LSDTester#1]

I charge to 11, because most go to 10, I get that extra push over the edge...

You just inadvertently quoted one of my heroes/idols.

“The Edge... There is no honest way to explain it because the only people who really know where it is are the ones who have gone over. The others-the living-are those who pushed their control as far as they felt they could handle it, and then pulled back, or slowed down, or did whatever they had to when it came time to choose between Now and Later. But the edge is still Out there.”….HST​

 

[FSDtester#1]

You just inadvertently quoted one of my heroes/idols.

“The Edge... There is no honest way to explain it because the only people who really know where it is are the ones who have gone over. The others-the living-are those who pushed their control as far as they felt they could handle it, and then pulled back, or slowed down, or did whatever they had to when it came time to choose between Now and Later. But the edge is still Out there.”….HST​

Sorry but I was referencing this, maybe the Edge was inspired by Nigel in Spinal Tap..

Edit: For those that don't already know, this scene from this movie is the reason all of our Tesla’s radios go to "11"

 

[LSDTester#1]

Sorry but I was referencing this, maybe the Edge was inspired by Nigel in Spinal Tap..

Did I just date myself?

 

[FSDtester#1]

Did I just date myself?

Probably, who would ever date you? You've been single your whole life.
You pretty much have to "date yourself" !!!

 

[LSDTester#1]

Probably, who would ever date you? You've been single your whole life.
You pretty much have to "date yourself" !!!

And John Entwhistle‘s song, “Ten Little Friends”, just popped into my head

 

[Supcom]

Can you chill out on the right lane and with Max speed set at right lane traffic speed?

On this road, the car prefers the left lane. If you set Minimal Lane Changes when in the right lane, the car will generally stay there. But, if you need to pass a car, you still must be especially vigilant, or simply disengage FSDb.

 

[ItalianoNC]

Teach a man to full self-drive and he'll drive for a day. Teach a man to full self-drive a fish and he'll get drunk and fall off the boat...........something like that.......

Teach a man to full self-drive, and he'll cruise smoothly for a day. Teach a man to full self-drive a fish, and he'll probably end up at a seafood restaurant wondering where the road turned into waves. Just remember, whether on land or sea, keep the self-driving to the vehicles, not the wildlife!