FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[sleepydoc]

V12.2 is ready for release but Tesla has not finished the training video "FSD for Dummies" yet.
It took couple years for beta users like us to know how to use FSD beta. People without FSD beta experience need that video.
Tesla cannot tell real FSD users to search youtube videos or RTFM to know how to use released FSD.

Actually, Tesla is going to use the cabin camera to record a video of the driver raising their hand, reciting “I swear on my lithium batteries not to be an idiot. I will pay attention at all times…”

 

[JulienW]

How does a fresh FSD user knows how to avoid nags?

How does a fresh Tesla Model Y/3 owner know how to open the door?

 

[AlanSubie4Life]

But given the amount of froth we've seen on this thread with people complaining bitterly about the nags, both torque and eyeballs,

Internet and forums are not real life.

In real life people just figure this stuff out and it basically always works.

 

[JulienW]

Internet and forums are not real life....

WAIT........I'm insulted. Are you saying I'm not a "real life" qualified rocket scientist, brain surgeon, trail lawyer, astrophysicist, complete historian and all around super informed smart person?

 

[JHCCAZ]

WAIT........I'm insulted. Are you saying I'm not a "real life" qualified rocket scientist, brain surgeon, trail lawyer, astrophysicist, complete historian and all around super informed smart person?

The only thing that matters is Your Truth

 

[sleepydoc]

The only thing that matters is Your Truth

can you define 'Truth?'

 

[JulienW]

can you define 'Truth?'

Truth=Belief≠Facts

 

[Supcom]

Per Teslascope, 12.2.1 is going out to employees and special friends.

 

[JHCCAZ]

can you define 'Truth?'

It's whatever makes you feel safe

Alternatively, whatever slogan impressed you in the TikTok you just watched!

 

[Hiline]

In real life people just figure this stuff out

or give up completely

 

[Hiline]

On my latest drive, FSD cut right in front of another vehicle which then honked in protest. Not a life-threatening situation. Just embarrassing.

 

[AlanSubie4Life]

On my latest drive, FSD cut right in front of another vehicle which then honked in protest. Not a life-threatening situation. Just embarrassing.

* correction - you cut right in front of another vehicle!

It’s not like it is a surprise when the vehicle changes lanes. If you find that it is, try turning on vibrate. It’s a nice hand massage if nothing else.

When it comes to lane changes, it’s always trivial to intervene in plenty of time when using FSD Beta.

No need to cut anyone off. It’s you doing the driving, not the car!

 

[Hiline]

When it comes to lane changes, it’s always trivial to intervene in plenty of time when using FSD Beta.

It's not. The time between the turn signal getting turned on to the vehicle moving over was less than a second. I didn't have time to intervene. The lane change was completely unexpected given that it was into the left most lane and that I had set the vehicle speed limit at the highway speed limit.

 

[JulienW]

It's not. The time between the turn signal getting turned on to the vehicle moving over was less than a second. I didn't have time to intervene. The lane change was completely unexpected given that it was into the left most lane and that I had set the vehicle speed limit at the highway speed limit.

 

[AlanSubie4Life]

The time between the turn signal getting turned on to the vehicle moving over was less than a second. I didn't have time to intervene. The lane change was completely unexpected given that it was into the left most lane and that I had set the vehicle speed limit at the highway speed limit.

An eternity.

Not to mention that with both hands on the wheel it will simply disengage shortly after the wheel starts to turn.

Note that the vibration usually provides a little extra warning if you are having difficulty or want more notification modalities. Give it a try. I think it sometimes is not quite concurrent with the signal though I have not paid close attention.

It will spuriously vibrate sometimes with no signal when FSD Beta is pondering a lane change.

 

[Hiline]

An eternity.

Not to mention that with both hands on the wheel it will simply disengage shortly after the wheel starts to turn.

Note that the vibration usually provides a little extra warning if you are having difficulty or want more notification modalities. Give it a try. I think it sometimes is not quite concurrent with the signal though I have not paid close attention.

It will spuriously vibrate sometimes with no signal when FSD Beta is pondering a lane change.

OK teach me then. You're looking forward. The turn signal goes on. The car starts moving over. Then you do what?

As I mentioned, the move was unexpected. Before I could check the side mirror to make sure there wasn't a vehicle closely following me, the vehicle cut over.

 

[Dewg]

Where were your hands? If you had your hands on the wheel, the car can't make any moves without your approval. It starts to move the wheel to change lanes, you just grip tighter and the system aborts, and disables ADAS (back to TACC if you are using AP/EAP or FSD Beta with double-pull, or completely disabled with single-pull).

 

[Hiline]

Where were your hands? If you had your hands on the wheel, the car can't make any moves without your approval. It starts to move the wheel to change lanes, you just grip tighter and the system aborts, and disables ADAS (back to TACC if you are using AP/EAP or FSD Beta with double-pull, or completely disabled with single-pull).

I had my hands on the wheel with a light tug to keep the nags off, so didn't apply enough force to keep the wheeling from turning. Do you instinctively grip the wheel tighter when your car makes an unexpected move before confirming that the move isn't favorable?

 

[FOOLSLFDRVNG]

Per Teslascope, 12.2.1 is going out to employees and special friends.

Whole Mars gives the best slurp slurp and gets it.

 

[AlanSubie4Life]

Do you instinctively grip the wheel tighter when your car makes an unexpected move before confirming that the move isn't favorable?

Yeah if the move is unexpected it is not favorable. It is not like the car is going to notice something you did not! At least, not on any timescale that would be relevant.

Just disengage. Always be disengaging, whenever the car deviates at all from the path or manner of driving that you have planned.