FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[kabin]

You can't say this without posting a link, so we can give the poor guy some clicks. I'm far too lazy to look it up. Exact timestamp would be awesome, too!

Ok, hopefully it's good entertainment value even if it's a Dawn Project. There's so much weird FSD driving behavior it's embarrassing and that was one drive.

https://twitter.com/x/status/1730995390412214477

 

[AlanSubie4Life]

Ok, hopefully it's good entertainment value even if it's a Dawn Project. There's so much weird FSD driving behavior it's embarrassing and that was one drive.

https://twitter.com/x/status/1730995390412214477

Thanks. Yeah, I guess I had seen this, though I had missed the bottoming out the first time I watched. Probably had the sound off, to make it slightly more bearable.

It's incredible how badly it did with all the parked cars. It's like it had never seen such a thing before. I'm sure end-to-end planning will fix it all.

 

[nikolajz1]

I love Omar going to check the cameras in the clip....like it's not the crappy software.

His videos are always infuriating because he never disengages and doesn't mind holding up traffic while the car goes 1 mph down a narrow street while jerking the steering wheel back and forth. Surprised he hasn't gotten multiple tickets

 

[willow_hiller]

Ok, hopefully it's good entertainment value even if it's a Dawn Project. There's so much weird FSD driving behavior it's embarrassing and that was one drive.

https://twitter.com/x/status/1730995390412214477

Imagine complaining about Tesla shills and then posting the Dawn Project. The anti-Tesla shills are just as toxic as the Tesla shills.

 

[sleepydoc]

Imagine complaining about Tesla shills and then posting the Dawn Project. The anti-Tesla shills are just as toxic as the Tesla shills.

Completely agree - what’s the difference between one horribly biased, unbalanced perspective and another?

 

[willow_hiller]

Completely agree - what’s the difference between one horribly biased, unbalanced perspective and another?

If Omar makes you cringe, then O'Dowd should make you cringe as well. Reality exists somewhere in-between the two extremes.

 

[AlanSubie4Life]

Imagine complaining about Tesla shills and then posting the Dawn Project

Note he only posted it because I asked. Would not have otherwise. I don’t think many people here are anti-Tesla.

 

[kabin]

Thanks. Yeah, I guess I had seen this, though I had missed the bottoming out the first time I watched. Probably had the sound off, to make it slightly more bearable.

It's incredible how badly it did with all the parked cars. It's like it had never seen such a thing before. I'm sure end-to-end planning will fix it all.

Yep, that's all it needs until Elon decides it needs something more and then Omar quickly changes his talking points.

FSD playing chicken with parked cars of differing lengths is so unnatural, so uncomfortable and ridiculously unsafe.

 

[cbdream99]

I encountered a FSD safer than human situation this week. FSD needs to exit the highway, it moved to the right lane about a mile ahead, buffered ramps are common here for both onramp and offramp, there was a car in the front and exiting, so normal intelligent human driver will slow down and follow that car, move to the buffered lane when it is safe to do so (i.e. no other car coming onramp from behind in that lane). FSD decided it is not at the fork to exit yet, keep going then it decided its time to turn, but there is a car coming up onramp in the lane, no problem, just speed up and cut in front of him, makes a quick turn and oh crap, there is a car in front, let's brake, finally made the exit safely, definitely much safer human if driving that way.

 

[kabin]

If Omar makes you cringe, then O'Dowd should make you cringe as well. Reality exists somewhere in-between the two extremes.

Yep, almost like zen fundamental forces of FSD.

 

[Ramphex]

I wonder if anyone has ever polled to determine an average time span of a Tesla Apologist.

 

[jebinc]

Note he only posted it because I asked. Would not have otherwise. I don’t think many people here are anti-Tesla.

Yeah, I would say most "anti" folks here are not "anti-Tesla," but more likely "anti-Elon".

 

[EVNow]

Right - but there's a clear difference in the audible signals so it's pretty obvious which mode you're in. Every time I activate FSD I listen for the double tone, check to see that the steering wheel is blue and make sure the car is actually driving itself. I just don't see how it's an issue.

I haven't paid attention to the sound... But the issue usually is FSD not engaging even though we double tap.

But wheel disengagement to tacc is the main issue. We would usually do it in tough turning situations where you don't have time to look at the screen or tap up ..

From a UI perspective it was a terrible design.

BTW, do you pay attention is a rude remark... If we didn't we would not disengage. It's FSD that needs to pay more attention!

 

[jebinc]

I wonder if anyone has ever polled to determine an average time span of a Tesla Apologist.

Same question, but for a stalwart Elon Devotionalist. Sure, I recognize there may be some overlap....

 

[Scott Chapman]

I wonder if cars without stalks will get single pull?

 

[jebinc]

I wonder if cars without stalks will get single pull?

Yeah, but maybe the "pull" is in a different location?

 

[jebinc]

Looks like 8.1 is rolling out again, as I just received a notification to update....

 

[Mardak]

I wonder if cars without stalks will get single pull?

Pretty sure the initial software version in the car we got without stalks had the option for single press of right scroll button to activate Autosteer / FSD (Controls > Autopilot Activation > Autosteer Activation). I could see Tesla learning that people like single button press to bring the equivalent to those with stalks.

 

[rlsd]

Has anyone here tried 8.1 yet? I’ll pass on the hour long shiller vids, thank you.

Still like that j?

 

[willow_hiller]

Some undocumented feature found by Green. Speed trap and red-light camera data added to the maps. I suppose FSD Beta will be more likely to brake for yellows and not adjust speed up when it knows there's a camera:

https://twitter.com/x/status/1731223084084916379