FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[jeremymc7]

Teslascope thinks they may be A/B testing with 11.3.4 and 11.3.5:

https://twitter.com/x/status/1642022033352699904

Of course that puts some of us in C, for control group

I think it’s likely a difference between USS and non USS. If so I suppose it’s still A B but not between different drive methods.

I was watching some intensive Tesla Vision parking between a Vision car and a USS and the results were HORRIBLE. The Vision parking system is not worth using at all.

 

[jeremymc7]

I think Tesla does not detect the wall yet. USS cars detect the wall obstruction. The interesting part is the car can detect the park blocks way below the car body. This is contrary to what Munro guessed couple months go. The diagram in the link indicates the car cannot detect anything lower than 1 feet.

This is so far the best video showing what Vision parking is limited to currently how how it compares to a USS taking.

 

[rlsd]

This is so far the best video showing what Vision parking is limited to currently how how it compares to a USS taking.

Apple to orange comparison. I drive on the left side of the car. He drives on the right side. I think it may work if he put long park blocks there.

 

[aronth5]

Anyway, V11 has failed the wife test (surface street scenario).

Have you taken her on the highway with V11? My wife is fine with highway driving but not city streets. I rarely enable city streets when she is with me.

 

[willow_hiller]

I think it’s likely a difference between USS and non USS. If so I suppose it’s still A B but not between different drive methods.

Yep, in retrospect, it's much more likely that 11.3.3 and 11.3.4 are the A/B test. Very few 11.3.3 upgraded to 11.3.4; the vast majority of 11.3.4 were straight from 10.69.

 

[Joboo7777]

Sad thing is there is a lot of truth to your statement. Seems like . Running an “Orange” light these days does seem like the better experience. I was trying to be impartial and determine if this was the type of light a human might consider acceptable to run through. Just seemed a little too red for my comfort level.

Here is my dashcam Video of 11.3.5 running a red light. You be the judge

Sad thing is there is a lot of truth to your statement. Seems like . Running an “Orange” light these days does seem like the better experience. I was trying to be impartial and determine if this was the type of light a human might consider acceptable to run through. Just seemed a little too red for my comfort level.

here is the dashboard cam of my 2003 M3LR on 11.3.5 running red light. You be the judge.

OneDrive

Sign in to your OneDrive cloud storage and Office Online.

1drv.ms

 

[jabloomf1230]

Here is my dashcam Video of 11.3.5 running a red light. You be the judge

here is the dashboard cam of my 2003 M3LR on 11.3.5 running red light. You be the judge.

OneDrive

Sign in to your OneDrive cloud storage and Office Online.

1drv.ms

That may not be the safest decision, but the light was still amber when you entered the intersection. My definition of "running a red light" is different. Entering the intersection either on the fly or stopped with a red light is "running". My FSDb has done both the the past. Obviously, I disengaged on the latter scenario, since I don't have a death wish.

 

[jeremymc7]

That may not be the safest decision, but the light was still amber when you entered the intersection. My definition of "running a red light" is different. Entering the intersection either on the fly or stopped with a red light is "running". My FSDb has done both the the past. Obviously, I disengaged on the latter scenario, since I don't have a death wish.

I guess the question is, and this was mentioned somewhere from Tesla, that’s the car just improves its decisions in when the can enter the intersection on a red with less likely of the like being when when exiting or limits the amount of time in the intersection with a red.

These fixes are more treatment and less cure.

 

[AlanSubie4Life]

Here is my dashcam Video of 11.3.5 running a red light. You be the judge

here is the dashboard cam of my 2003 M3LR on 11.3.5 running red light. You be the judge.

OneDrive

Sign in to your OneDrive cloud storage and Office Online.

1drv.ms

A little orange. Though not unsafe of course. Timing seemed unsafely short (~4 seconds!!!) though hard to judge speeds.

This is the type of light I would have sped up for, FSD engaged or not! Just to be sure it was yellow and to avoid any friction braking. It’s not really safe to stop on borderline lights, so it is safest to go when there is plenty of time like this.

Been rear-ended stopping for nearly red lights, so I have learned The Way; can’t fight it.

 

[heapmaster]

A little orange. Though not unsafe of course. Timing seemed unsafely short though hard to judge speeds.

This is the type of light I would have sped up for, FSD engaged or not! Just to be sure it was yellow and to avoid any friction braking. It’s not really safe to stop on borderline lights, so it is safest to go when there is plenty of time like this.

Been rear-ended stopping for nearly red lights, so I have learned The Way; can’t fight it.

This is why I like the newer CA lights that detect the car going thru the yellow and hold the yellow a bit longer.

 

[PianoAl]

I just got 11.3.4 and I can't wait to see if it slows down fast enough to avoid a speeding ticket when the limit changes.

It slows down perfectly now!

Because I'm a feedback-aholic, I like the ability to describe the problem when I disengage.

 

[gsmith123]

When was the last push of V11.3.x? About a day ago?

 

[rlsd]

When was the last push of V11.3.x? About a day ago?

It still pushing out today and probably the next couple days. This website shows the push for each version and each day. It only shows the push for the cars registered with its site.

TeslaFi.com Firmware Tracker

 

[jeremymc7]

When was the last push of V11.3.x? About a day ago?

The last two most recent versions just started yesterday.

 

[gsmith123]

I was mostly wanting to confirm there haven't been any additional pushes today. I don't think Teslafi easily shows when a car got pushed an update, does it? Just when they actually installed it. Right now there's about 500 cars that either installed 2022.45.13 today or have it pending, but those were all pushed yesterday IIRC.

 

[PACEMD]

Hey, where is my 11.3.5 already? I've been on 11.3.4 for most of 24 hours now, hello!

 

[jeremymc7]

I was mostly wanting to confirm there haven't been any additional pushes today. I don't think Teslafi easily shows when a car got pushed an update, does it? Just when they actually installed it. Right now there's about 500 cars that either installed 2022.45.13 today or have it pending, but those were all pushed yesterday IIRC.

No TeslaFi shoes much more than just installed status. A lot more. Even more so if you drill down into any of the numerologist datapoints.

 

[jeremymc7]

Hey, where is my 11.3.5 already? I've been on 11.3.4 for most of 24 hours now, hello!

FYI most of us are still stuck on the 69 release.

As for .4 vs .5 it has been discussed they may more likely be for different sets of cars more so than any other functional difference.

 

[jabloomf1230]

don't think Teslafi easily shows when a car got pushed an update, does it?

It summarizes the entire fleet for each firmware version by these categories:

1. Downloading
2. Waiting for WiFi
3. Installing
4. Ready to install
5. Schedule to install

 

[PACEMD]

FYI most of us are still stuck on the 69 release.

As for .4 vs .5 it has been discussed they may more likely be for different sets of cars more so than any other functional difference.

Sure, but what's the point of being on TMC if you can't complain?