FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[swedge]

I run ~80% and temps are currently in the 40s. But even in the 50s regen is limited and friction brakes get blended in if I haven't preconditioned the car long enough.


The State Farm Drive Safe & Save is very sensitive. Just regen braking can ding you sometimes, so regen is right at the g-force limit. (Like I said, I don't think it should have gotten dinged at either spot.)

Ha! Back in the days of the Safety Score (SS) Contest to qualify for FSD beta, I would get dinged when I braked hard enough to stop at a stop sign located at the bottom of a hill. My "safety" score was better if I ran the stop sign, slowly of course.

Yours is an interesting story because I have wondered if FSD could past the Safety Score test so it could use itself. We could never test that because SS was not accumulated when AutoPilot was engaged and SS was deactivated when we passed the test.

I figure those scoring system numbers may correlate somewhat with accidents, but getting a perfect score was not the safest way to drive. On the other hand, SS did train one to really, continuously pay attention, good practice for driving with FSD.

 

[swedge]

It's 106 miles to Chicago, we've got a 100% battery charge, half a pack of cigarettes, it's dark and we're wearing sunglasses....

The Future's So Bright.... (Timbuk3: link)

 

[Pdubs]

It's a red light runner, red light runner.......... loved that song...........Jefferson Airplane wasn't it?

I need a link. love Grace Slick but that line and your tone deaf voice doesn't help me

 

[Pdubs]

The Future's So Bright.... (Timbuk3: link)

Dude, it was a Blues Brothers reference, not Hughey Lewis or whatever Timbuk3 is

 

[swedge]

Dude, it was a Blues Brothers reference, not Hughey Lewis or whatever Timbuk3 is

Ouch. I'll just curl up and dye.

I think you meant "whatever Timbuk3 was"... Their biggest hit was in 1986, and was perhaps an homage to the 1980 Blues Brothers, who knows. But the refrain, "The future's so bright, I gotta wear shades" just seemed to me like a good take on FSD and on Elon's attitude.

 

[aronth5]

Ouch. I'll just curl up and dye.

I think you meant "whatever Timbuk3 was"... Their biggest hit was in 1986, and was perhaps an homage to the 1980 Blues Brothers, who knows. But the refrain, "The future's so bright, I gotta wear shades" just seemed to me like a good take on FSD and on Elon's attitude.

Funny posts on this but the question remains how can Tesla remove the nags since camera monitoring doesn't work with sunglasses? At least my last 2 pairs.
I wonder if there are additional capabilities not yet implemented in HW4 cars that over come the sunglasses limitation?

 

[legendsk]

Got 44.30.8 yesterday for the FSDb M3P. Haven't tried it yet but I can already say my minor bugs look soooooooo much better fixed..........

That makes me think. . . . . . . Once a bug is 'fixed', that's the end of that branch isn't it? It can no longer reproduce and must be extinct, eh?

 

[KLam]

Funny posts on this but the question remains how can Tesla remove the nags since camera monitoring doesn't work with sunglasses? At least my last 2 pairs.
I wonder if there are additional capabilities not yet implemented in HW4 cars that over come the sunglasses limitation?

It's the occasional running red light and random lane changes.

 

[Dewg]

That makes me think. . . . . . . Once a bug is 'fixed', that's the end of that branch isn't it? It can no longer reproduce and must be extinct, eh?

Yeah, just like humans NN. When we make a mistake, we never make it again. Oh wait...

 

[JHCCAZ]

That makes me think. . . . . . . Once a bug is 'fixed', that's the end of that branch isn't it? It can no longer reproduce and must be extinct, eh?

Well, there can always be other "reproducible" bugs populating the same branch...
Fortunately, Tesla gives us the OTA method of "neuter-alizing" them to control all that indecent software behavior - a "spay-in-place" program as it were, so you don't need to abort disengage so often.

 

[cbdream99]

Just came back from a night drive, after passing a school zone sign, it slowed down and then finally stopped, just passed the solid white mark in the middle of the junction of the side street. I guess it is a good try but failed, then it correctly passed all duck crossings, pedestrian crossings, parent/children crossings signs without stopping.

 

[sleepydoc]

it correctly passed all duck crossings

Just think of all the poor ducks that could’ve been savagely run over!

Now we need someone from down under to see if it will stop for platypi…

 

[Supcom]

Just came back from a night drive, after passing a school zone sign, it slowed down and then finally stopped, just passed the solid white mark in the middle of the junction of the side street. I guess it is a good try but failed, then it correctly passed all duck crossings, pedestrian crossings, parent/children crossings signs without stopping.

I passed an active school zone with a flashing light today. FSD visualized the flashing light, but did not recognize the school zone speed limit sign, as always. Maybe V12 will.

 

[Skotty]

I'd just like FSD to slow down for speed bumps. I have several huge speed bumps which FSD treats as launching pads. I disengage because of their size. They are well marked too.

I bet that was fun the first time.

 

[rlsd]

Just think of all the poor ducks that could’ve been savagely run over!

Now we need someone from down under to see if it will stop for platypi…

I wonder what FSD will do when it sees Baby On Board sign on the rear window of the leading car?

 

[sleepydoc]

I wonder what FSD will do when it sees Baby On Board sign on the rear window of the leading car?

It will probably follow it home assuming it’s Elon having another rant about advertisers on Twitter

 

[FSDtester#1]

Funny posts on this but the question remains how can Tesla remove the nags since camera monitoring doesn't work with sunglasses? At least my last 2 pairs.
I wonder if there are additional capabilities not yet implemented in HW4 cars that over come the sunglasses limitation?

My waving of the hand over the yoke to turn off the nag is no longer working. This newest release killed it. And now actually have to Move the yoke a little.
There's your minor bug fix....

 

[PACEMD]

I wonder if there are additional capabilities not yet implemented in HW4 cars that over come the sunglasses limitation?

You could get prescription sunglasses. You know, with camera monitors installed.......

 

[PACEMD]

That makes me think. . . . . . . Once a bug is 'fixed', that's the end of that branch isn't it? It can no longer reproduce and must be extinct, eh?

Right, that should fix the problem.........

 

[PACEMD]

Just came back from a night drive, after passing a school zone sign, it slowed down and then finally stopped, just passed the solid white mark in the middle of the junction of the side street.

Night school?