FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[Supcom]

Is TeslaBull an influencer?

Prob employee.

 

[Gwgan]

Whenever my friend drives—over curbs, into exits, wherever-I-want u-turns, etc—we call it driving in The Jane Lane; it’s the lane she just made up for herself.
Maybe we’ll call the tentacle a ribbon now, but we’ll probably call it the Jane Lane.

 

[oliphant428]

Less than human like anticipation for cut-in at 1:00. The cut-in vehicle begins the lane change slightly before initiating the turn signals but ego is still late to acknowledge via lifting throttle. End result is at least 1sec delayed response with excess required ego braking. I should add at times this videos seems sped up and if so the mentioned 1 sec delayed response is even longer.

What is "ego"?

 

[JulienW]

What is "ego"?

Your car

 

[JulienW]

Prob employee.

Wonder how he got permission to post videos? Or if he is now a former employee.

 

[thewishmaster]

Wonder how he got permission to post videos? Or if he is now a former employee.

Even with the original FSDb versions there were a few hardcore investors who were getting it; I bet this is such case.

Auto park seems to be back:

https://twitter.com/x/status/1628082633468186624

Unfortunately it also looks to be as bad as it’s been at perpendicular parking ever since they switched to vision only

 

[Nikon201068]

I wonder if this feature "Leave Notes About a Disengagement" is only for employees. Will it be removed once this version 11.3 goes out to wide general users?

 

[JulienW]

I remember a BIG discussion with several people saying that NoA would remain in V11. I never understood what they meant since V11 means no discrimination from Highway to city. Will looks like it is removed.

 

[JulienW]

I wonder if this feature "Leave Notes About a Disengagement" is only for employees. Will it be removed once this version 11.3 goes out to wide general users?

Kinda looking now like probably not removed but.......it could also be limited to influencers/select only like it is now or everyone. We have NO WAY of knowing until it is released.

 

[JulienW]

Also looking at the Highway pic about no NoA I don't see a toggle to switch to the legacy AP stack. Looks like you can't change from FSD Beta to legacy AP stack on the fly and must go into the Menu. Will be nice to see how this is handled.

 

[scottf200]

I wonder if this feature "Leave Notes About a Disengagement" is only for employees. Will it be removed once this version 11.3 goes out to wide general users?

It is in the release notes:
"Added voice drive-notes. After an intervention, you can now send Tesla an anonymous voice message describing your experience to help improve Autopilot."

Finally : The Notes of FSD Beta v11.3 Version of Tesla EVs Were Launched. - E Vehicles Aura

The automaker today released the notes for the new FSD Beta version v11.3 in place of its old FSD. Expanded AEB to handle vehicles that cross ego's path.

evehiclesaura.com

 

[Mardak]

Hopefully reduced path jiters results in less steering wheel input jitter

Looks like probably no change to blue line jitter and hard to tell if there was much steering jitter with shaky cam:

https://twitter.com/x/status/1628089992978534400

Here the car was in the only straight lane with 2 possible destinations across the intersection, and FSD Beta 11.3 kept switching between the left destination lane and the right one with a brief switch and back midway through:

Maybe the wider blue path line was indeed primarily to help increase its visibility and the red stop line, but it now also makes it much more obvious that there's prediction jitter.

 

[JulienW]

It is in the release notes:
"Added voice drive-notes. After an intervention, you can now send Tesla an anonymous voice message describing your experience to help improve Autopilot."

True but so is this.

EDIT: Also this is our 3ed set of V11 Release Notes. Hopefully the 3ed time will be the charm but I'm not betting my retirement on it.

 

[powertoold]

I'm thinking it won't be released to the OGs until 3.1

 

[EVNow]

Unfortunately it also looks to be as bad as it’s been at perpendicular parking ever since they switched to vision only

Looks ok to me. Esp. with that pillar on the side, never easy.

 

[EVNow]

https://twitter.com/x/status/1627858215521374208

 

[Dan D.]

Maybe the wider blue path line was indeed primarily to help increase its visibility and the red stop line, but it now also makes it much more obvious that there's prediction jitter.

the wider blue path line ... makes it much more obvious that there's prediction jitter.


The Long Blue Arm of the Flaw?

 

[EVNow]

Maybe the wider blue path line was indeed primarily to help increase its visibility and the red stop line, but it now also makes it much more obvious that there's prediction jitter.

They need to reduce/ignore jitter to show more stable path. Remember all those dancing cars ?

 

[dckiwi]

These refined visualizations are strong evidence that Tesla sees v11 as their 'release candidate' for wide distribution (including replacing existing AP for all vehicles). The prior visualizations, while colorful, had a debug mode feel to them.

I suspect when they do release v11, it will be in a production branch to all vehicles, with the FSD toggle available for all US FSD owners/subscribers (no separate request/download required).

 

[sleepydoc]

I'm sure they would love to release it before Investor Day, but I hope they will release it when it is ready independent of Investor Day. Also, what is the over-under on this thread hitting 100 pages before the widespread release?

Sorry - management has never prioritized PR stunts and quarterly financials that may improve stock options over solid engineering!