FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[eli_]

I wonder if anyone has experienced an AEB event with cross-traffic when not using FSD, like someone running a red. That was one of the major changes with V11.

 

[diplomat33]

Some more observations on 11.3.3:

Good
Lane keeping and lane changes were super smooth.
I really like the new visualizations and the text that tells you what the car is doing. It makes the system much more transparent.
I also really like that when you suddenly disengage FSD, there is a pop up now that asks you what went wrong and let's you enter feedback by voice.
11.3.3 seems to have fixed a right turn. It used to be very wobbly on 10.69 but is now butter smooth on 11.3.3.

Bad
Still tried to make a protected left on a flashing yellow with incoming traffic. The car started creeping forward into the middle of the busy intersection! I disengaged because there was a lot of traffic and it would not have been safe to try to do the left turn.

Misc.
A cop car was in the left turn only lane helping a stalled car. So traffic was staying in the straight lane and making a protected left from the straight lane to go around the cop car and the stalled car. I disengaged because it was a special case and I did not know what FSD Beta would have done.

 

[uscbucsfan]

Did Tesla reduce the nags on V11? I took a short drive on V11.3.3. I was hands-off but eyes-on the road the whole time and went a few minutes with no nag. On 10.69, I used to get nags every few seconds.

There's a poll on FB, most are reporting the opposite, which means it probably didn't change.

 

[uscbucsfan]

Literally just put together this hypothetical in another thread and people are already disagreeing about the interpretation. On a Tuesday at 3 PM, can you turn right on red from the outside right turn lane?

View attachment 922356

Obviously fake, but still funny.

 

[eli_]

Maybe with HW4/5/6... they can run a GPT4-like model offline and ask it if the car is allowed to park or not. Just send it the road signs and ask.

 

[diplomat33]

There's a poll on FB, most are reporting the opposite, which means it probably didn't change.

maybe it was because I was just cruising on a straight road at 45 mph. But I was able to go eyes on/hands-off for several minutes before it asked me to hold the wheel.

 

[JHCCAZ]

I wonder if anyone has experienced an AEB event with cross-traffic when not using FSD, like someone running a red. That was one of the major changes with V11.

It's obviously hard for us to compile data on, but it's a significant safety Improvement for the whole fleet. This is exactly the kind of thing that Tesla should pull from data upload clips, and tweet out a video compilation, after the software's been in the field for a few months. Probably they can reconstruct the FSD traffic visualization and insert that in split screen, so you can see the accident being avoided.

 

[eli_]

My commute is basically one long edge case so I don't get a whole lot out of FSD. Highway lanes that are dual-purpose of HOV/toll, with variable constraints depending on day of week and time of day. Highway ramps that are dangerous for human drivers, high curvature ramps leading into totally blind merge areas that are barely as long as a single car length. Ramp signal metering with HOV bypass lanes. Restricted bus lanes that abruptly transition into right-turn only lanes. Lots of terrible/missing road markings/striping. Yield signs that don't have anything to yield to. Construction all over the place, etc. None of these things work right currently.

 

[2023y]

When I checked for the update, mine is still showing March 26th date.

 

[pimfram]

Mine doesn't even give a last tried date and time, just that software is up to date.

 

[MarcG]

When I checked for the update, mine is still showing March 26th date.

Same here (I just took the photo below, at 4:40pm PT on March 28)

 

[SSDTester#1]

I also suggested voice annunciation of the screen messages - I can't see them well enough - but I knew @Ramphex and others would hate it, so yes it needs to be optional.

My forum-inspired vision of @Ramphex driving through the neighborhood has him slow-cruising, holding his coffee with the music on, a ton of loud bass resonating up and down the street:

Boom Thugga Boom​

Took ma b**ches to da sto​

Thugga Boom Boom Boom​

Imma a gangsta man fo sho​

Well, something like that.

It wouldn't do to have that vibe interrupted by the Tesla turn-directions lady, reassuring everyone:

Boom Thugga Boom​

Took m-APPROACHING STOP LINE-​

Thugga Boom Boo- WAITING OUR TURN-​

Imma gangst-PROCEEDING SAFELY-​

that second part is exactly what I can see happening. I don’t want any bi*ch to interrupt when I’m listening to Mozart.

You know how many turns I’ve missed while driving because I have voice turned off for the navigation? Obviously because I’m too busy looking at the road nonstop and not the screen….

What would be nice is a chime feature, it would do a subtle chime when there’s an upcoming turn or a message on the dash.

 

[SSDTester#1]

Same here (I just took the photo below, at 4:40pm PT on March 28)

View attachment 922396

Also stuck here on noon two days ago….

 

[gsmith123]

When I checked for the update, mine is still showing March 26th date.

I experienced this behavior first hand today! Went to the software tab. It "checked" and then the date was didn't change. I repeated that process 3-4 times and eventually it worked (the date updated to today, but I did not get V11 big sad...).

I assume Tesla's API is just flakey and the car handles errors by just not updating the "last checked for updates" timestamp (and not otherwise indicating an error). Maybe that's why they need to rate limit us on checking! LOL.

I really don't get why this is hard from Tesla's end. A small database + lightweight servers could easily store VINs + the latest version available for that car and serve up thousands of requests per second. That whole dataset is small enough to just keep in memory...

 

[Gwgan]

My one year old Model X has a broken ultrasound sensor system for a few weeks now. No parking sensors, no auto park, no auto lane change completion. With 3.3 auto lane change and lane change completion works well despite the US alert showing.

 

[sleepydoc]

Except I actually know, but NOT talking. Unless someone (like johnmodely) Paypal's me $10,000.

I keep telling you - I wired the money to your account at Silicon Valley Bank. It’s not my problem if you can’t get to it!

 

[azred]

I experienced this behavior first hand today! Went to the software tab. It "checked" and then the date was didn't change. I repeated that process 3-4 times and eventually it worked (the date updated to today, but I did not get V11 big sad...).

I assume Tesla's API is just flakey and the car handles errors by just not updating the "last checked for updates" timestamp (and not otherwise indicating an error). Maybe that's why they need to rate limit us on checking! LOL.

I really don't get why this is hard from Tesla's end. A small database + lightweight servers could easily store VINs + the latest version available for that car and serve up thousands of requests per second. That whole dataset is small enough to just keep in memory...

One of my cars has updated to today’s date, the other is “stuck” on Mar 19. But until I get v11 on either car, I am hopeful it means nothing. I did try hard and soft resets but they didn’t fix the Mar 19 date.

 

[sleepydoc]

We really should split this thread now that we actually have V11 to use instead of just hypothesize about...
I'm going to start a new thread. Mods - if you want to split/combine it feel free to do as you deem appropriate.

 

[SSDTester#1]

We really should split this thread now that we actually have V11 to use instead of just hypothesize about...
I'm going to start a new thread. Mods - if you want to split/combine it feel free to do as you deem appropriate.

Link

 

[JHCCAZ]

Also stuck here on noon two days ago….

View attachment 922400

Me too. Trapped in Elon time