FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[legendsk]

Well, it's certainly comforting to see that Tesla's focus is on the important stuff and that the game "Vampire Survivors" is up and running.

 

[Ramphex]

You mean N, OK?

K

 

[sleepydoc]

Has anyone else had issues with the windows on 11.4.7? I’ve had them spontaneously go down on several occasions. At first I thought I may have bumped the buttons on the armrest but it’s happened several times now and I’m positive I wasn’t pressing the buttons.

 

[Ramphex]

What are the close to 50 non-FSD features? Or at least some of the ones that folks want to see?

I would like to see console quality gaming be brought to my refresh Model S, as advertised. I would also like to see the track mode for non-plaid Model S. The wipers not go from Auto to Off every single time the car is turned off/sleeping. I also could care less about what they add to the J until they release something that doesn’t nag more than my girlfriend and mother put together.

I’ve been misinformed


View attachment 975540
View attachment 975541

Sometimes I feel like the employees know just as little as us. They probably get all of their FSD info from Elon’s Twitter just like we do.

 

[Ramphex]

What’s the difference between Summon and Smart Summon?

 

[Buckminster]

What’s the difference between Summon and Smart Summon?

View attachment 975620

Neither are Ass

 

[uscbucsfan]

What’s the difference between Summon and Smart Summon?

View attachment 975620

Summon is moving forward and back...Smart Summon is the car can come get you or go to a point...unless it hits a tree, curb, or another car which we've seen countless times on these boards. Smart Summon is what Elon calls a fun trick, but not useful until Actually Smart Summon is released, which was due November 2022...so in two weeks.

 

[WilliamG]

What’s the difference between Summon and Smart Summon?

View attachment 975620

Summon is just the forward/reverse scenario. Smart Summon is the driving round a parking lot scenario.

 

[Ramphex]

Summon is moving forward and back...Smart Summon is the car can come get you or go to a point...unless it hits a tree, curb, or another car which we've seen countless times on these boards. Smart Summon is what Elon calls a fun trick, but not useful until Actually Smart Summon is released, which was due November 2022...so in two weeks.

Gee and here I thought the summon and smart summon were the same exact gimmick.

 

[WilliamG]

Summon is moving forward and back...Smart Summon is the car can come get you or go to a point...unless it hits a tree, curb, or another car which we've seen countless times on these boards. Smart Summon is what Elon calls a fun trick, but not useful until Actually Smart Summon is released, which was due November 2022...so in two weeks.

Hot damn we posted at the same time. Also, Actually Smart Summon (ASS) is so obviously Elon being a man child once again. No wonder nothing works. Aspirational, with the emphasis on As(s).

 

[uscbucsfan]

In before, "I use Smart Summon all of the time and it works great"...I swear some of these people are the same ones who tell those who post about their cars wrecking into other cars with Smart Summon, "It's not meant to be used in actual parking lots"....

 

[Ramphex]

In before, "I use Smart Summon all of the time and it works great"...I swear some of these people are the same ones who tell those who post about their cars wrecking into other cars with Smart Summon, "It's not meant to be used in actual parking lots"....

They live in “their own reality” lol

 

[mtndrew1]

Gee and here I thought the summon and smart summon were the same exact gimmick.

They are in that neither of them work in any capacity.

 

[WilliamG]

They are in that neither of them work in any capacity.

I mean, regular summon kinda sorta works, sometimes. I use it to get closer to cement parking stops because Tesla hasn’t figured out a front bumper camera would be a real benefit to us.

 

[mtndrew1]

I mean, regular summon kinda sorta works, sometimes. I use it to get closer to cement parking stops because Tesla hasn’t figured out a front bumper camera would be a real benefit to us.

Not if your car doesn’t have USS. Ask me how I know lol.

 

[WilliamG]

Not if your car doesn’t have USS. Ask me how I know lol.

Oh that’s true. I forgot that not only did we not get a front bumper camera in the HW4 update, Tesla crippled the cars even more. Honestly, who is running the show at Tesla? Do they have any clue how actual humans drive cars?

 

[mtndrew1]

Oh that’s true. I forgot that not only did we not get a front bumper camera in the HW4 update, Tesla crippled the cars even more. Honestly, who is running the show at Tesla? Do they have any clue how actual humans drive cars?

This human is driving to South Bay Volvo tonight to check out the EX30 and EX90 which are on display by appointment for reservation holders.

I bet they have turn signals.

 

[FOOLSLFDRVNG]

Summon is moving forward and back...Smart Summon is the car can come get you or go to a point...unless it hits a tree, curb, or another car which we've seen countless times on these boards. Smart Summon is what Elon calls a fun trick, but not useful until Actually Smart Summon is released, which was due November 2022...so in two weeks.

Curb martyr checking in.

 

[sleepydoc]

This human is driving to South Bay Volvo tonight to check out the EX30 and EX90 which are on display by appointment for reservation holders.

I bet they have turn signals.

We’re actually looking at an XC60. They have a 35 mile electric only range and then the benefits of a hybrid. For us it means most of the miles will be pure electric.

I checked today - it has turn signals!

 

[Scott Chapman]

dang, I just checked and I still don't have 11.4.7.1 yet!