FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[kabin]

Yep, just like the Roadster, the Model S, and the Model 3 all hit the fan after Marc Tarpenning, Peter Rawlinson, and Doug Field left Tesla in 2008, 2012, and 2018 respectively.

Executives come and go, and they often sign NDAs and non-competes. It's a nothing-burger served cold on a slow-news day.

We'll see if it's a nothing burger or some crow.

 

[rlsd]

I don't have 11.4.8.1 yet. The distribution curve is going down yesterday and today. Not sure what Tesla is up to?

 

[EVNow]

I don't have 11.4.8.1 yet. The distribution curve is going down yesterday and today. Not sure what Tesla is up to?

We have to see ... happened with 4.7 as well. If the pace doesn't pickup today / tomorrow, then we should see 4.8.2 or may be 4.25 itself soon.

 

[mtndrew1]

I’ve started using FSDb again, I guess for novelty (it’s still very bad in my use case) and my car has really been uploading a tremendous amount of video. It just saturates my uplink for hours.

 

[fasteddie7]

I don't have 11.4.8.1 yet. The distribution curve is going down yesterday and today. Not sure what Tesla is up to?

My hw3 got it but my hw4 hasn't (looks like no one with hw4 did) don't know how this is gonna play out for next weeks holiday update. We ordered a new stealth grey model x and the delivery got pushed back because of software, and it's definitely a hw4 car. Maybe 11.4.8.1 was only for hw3 but how the heck is that going to work with the holiday update? Two or three branches of holiday update or maybe a merger?

 

[sleepydoc]

Has 11.4.8.1 stalled ? I'm still on 4.7.

View attachment 997631

Elon wants you to stick with inaudible alerts.

 

[rlsd]

My hw3 got it but my hw4 hasn't (looks like no one with hw4 did) don't know how this is gonna play out for next weeks holiday update. We ordered a new stealth grey model x and the delivery got pushed back because of software, and it's definitely a hw4 car. Maybe 11.4.8.1 was only for hw3 but how the heck is that going to work with the holiday update? Two or three branches of holiday update or maybe a merger?

I have HW3

 

[sleepydoc]

LiDAR-Equipped Ford F-150s Built for the Military Can Drive Themselves Anywhere

No, those aren't the mirrors—they're called DefensePods and they have built-in LiDAR, radar, and cameras.

currently.att.yahoo.com

Well, when you don't have roads it makes the job much easier!

 

[FOOLSLFDRVNG]

Well, when you don't have roads it makes the job much easier!

Drove it like you Kia Tik Tok challenged it

 

[WilliamG]

Has 11.4.8.1 stalled ? I'm still on 4.7.

View attachment 997631

Same. I care not one bit.

 

[uscbucsfan]

Same. I care not one bit.

It's not a great update thus far.

 

[WilliamG]

It's not a great update thus far.

As opposed to the other updates this year? No, no, that’s not fair. No, wait, yes it is.

 

[PACEMD]

I was driving with my daughter today and had dry wipes on 4 separate occasions. “so what?“ you say, “everyone knows the wipers suck on 11.4.x.” Here’s the kicker - the wipers were turned off. She was driving herself - no TACC, no FSD, nothing and had never activated them. I checked the wiper settings each time and they were completely off.

The wipers turn themselves on or off whenever they damn well feel like it. Only way I've been able to stop this is by cutting the wire.

Usually, I have to call my friend on the bomb squad. I can never remember, is it the red wire or the blue wire?

 

[PACEMD]

I’d argue FSD itself may be a dead end (with current cars and hardware).

So these cars will probably end up in the junkyard.........

 

[PACEMD]

It could be its already solved level 5 autonomy and Elon is just waiting to make the announcement for Christmas !

Dang, you let the cat out of the stocking..........you weren't supposed to tell.........

 

[PR0FESSOR]

Sayest thou not, woe be unto me for mine chariot of electrons worketh but now doeth not, for thou surely doeth forgetteth the words of master Muskedine: “that which worketh shall be made broken, and that which beith broken shall stayeth so, for ever and ever, amen”.

The book of Elon
Chapter 69 verse 31415926

The wipers were not great but at least average before, so why did they bother changing the code? Why haven't they just reverted to the old code?
"Reduced vehicle velocity error by 3%" ummm.. ok. Is anyone going to notice that?

 

[PACEMD]

It's easy to solve .. they just do what every other car maker seems to be doing .. tune it so the bias is against false positives. But of course this ALSO leads to a reduction in TRUE positives .. in other words, you ID.4 wont phantom brake, but it also runs the risk of NOT braking when it should.

I'll take the odd phantom braking event over having the car crash in an emergency any day.

What if it crashes into a phantom?

 

[WilliamG]

What if it crashes into a phantom?

Do not even speak of such a scenario lest we invoke the wrath of Muskedine.

 

[TK211X]

Elon wants you to stick with inaudible alerts.

Wait can we talk about this for a sec.

When I get the black apply slight turn alert and the blue pulse I get no aural tone. Is it supposed to be like that or is mine broken? I’ve had someone else try my cars FSD and they heavily complained about having to take your eyes off the road to notice that it wants you to stay alert.

 

[sleepydoc]

Wait can we talk about this for a sec.

When I get the black apply slight turn alert and the blue pulse I get no aural tone. Is it supposed to be like that or is mine broken? I’ve had someone else try my cars FSD and they heavily complained about having to take your eyes off the road to notice that it wants you to stay alert.

It changed a couple updates ago. It use to beep at you soon after the pulsing blue screen. Now it waits until right before it disengages.