FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[FSDtester#1]

Buying air fresheners

Buy the Burnt Hair, aka scent de Elon's Musk

 

[EVNow]

I don't think this will pass NHTSA (stop sign, speed control ...). -- how will they get around this.

Sue. Clearly that come to a complete stop at stop signs "recall" was a stupid recall. I can think of a thousand other more important things FSD needs to fix first.

 

[scottf200]

Sue. Clearly that come to a complete stop at stop signs "recall" was a stupid recall. I can think of a thousand other more important things FSD needs to fix first.

My observation and questions about potential problems vs all the absolutile fan giddiness.

how will they get around this? --- speed control, stop signs, etc
Sue NHTSA?

 

[EVNow]

how will they get around this? --- speed control, stop signs, etc
Sue NHTSA?

Theoretically end-to-end NN should follow all the rules "like normal humans do". If NHTSA says FSD should do things that normally people don't - Sueing is in order.

ps : As I wrote elsewhere I'm skeptical of end to end NN (both in terms of possibility and actually how much of end-to-end NN V12 actually is).

 

[KLam]

Everybody seems very hot about Elon's version 12 claims. I have one suggestion for him is to take the car to Chuck's UPL and see if his v12 converges and learn to take just that UPL correctly after someone drive through that turn 100's of times correctly under different conditions.

 

[jbrady3324]

https://twitter.com/x/status/1695846088685634044

 

[rlsd]

Everybody seems very hot about Elon's version 12 claims. I have one suggestion for him is to take the car to Chuck's UPL and see if his v12 converges and learn to take just that UPL correctly after someone drive through that turn 100's of times correctly under different conditions.

Problem solved. V12 will train FSD to exclude road having turns similar to CK's UPL and U turns when selecting routes. Aren't we taught to find an easy way over difficult ways to solve a problem?

 

[KLam]

Problem solved. V12 will train FSD to exclude road having turns similar to CK's UPL and U turns when selecting routes. Aren't we taught to find an easy way over difficult ways to solve a problem?

So, instead of training UPL. v12 will train U turns correctly.

 

[PACEMD]

Heh. Not everybody in Joisey is a thug.

And.. this is the place where the background radiation of the Big Bang was first discovered. And, down the hall from where my office was (now retired), there's a plaque: First Transistor Made Here.

It's still hard to come to grips with that last.

Fuhgeddaboudit.............

 

[rlsd]

So, instead of training UPL. v12 will train U turns correctly.

That's what human drivers do if I am considered as human. I usually avoid turning left by turning right then making protected U turns, or going around the block.

 

[Supcom]

Problem solved. V12 will train FSD to exclude road having turns similar to CK's UPL and U turns when selecting routes. Aren't we taught to find an easy way over difficult ways to solve a problem?

If FSDb geofenced off UPLs, there would be no end to the vitriol on this site.

 

[KLam]

That's what human drivers do if I am considered as human. I usually avoid turning left by turning right then making protected U turns, or going around the block.

It is like training for survival! FSD v12 has to learn its limits like bandwidth and surround complexity. Learn not to stop in the middle of an intersection !

 

[kpanda17]

I have a spot below that v11.4.4 looses its mind:
Should be in rhe right most lane making a right
1. Starts here where left and right lanes go straight
New right lane starts, right turns should merge to the right

Once in the new right lane, get ready to go eight

FSD looses it mind and in the confusion, last minute knows it should be in rhe right lane starts applying be brakes and I have to jntervene

When we have .7 or v12, I’ll test here to know if we have advanced

Test in your worst repeatable environment for FSD

 

[EVNow]

That's what human drivers do if I am considered as human. I usually avoid turning left by turning right then making protected U turns, or going around the block.

Many times - I try turning left - but after a while if the traffic is heavy and I can't make the left, I turn right and do a U-turn (by going into a parking lot or side roads, if needed).

 

[scottf200]

Sue. Clearly that come to a complete stop at stop signs "recall" was a stupid recall. I can think of a thousand other more important things FSD needs to fix first.

Theoretically end-to-end NN should follow all the rules "like normal humans do". If NHTSA says FSD should do things that normally people don't - Sueing is in order.

ps : As I wrote elsewhere I'm skeptical of end to end NN (both in terms of possibility and actually how much of end-to-end NN V12 actually is).

Is "normal" stops in CA, the same as IA, the same as WA, the same as MT, the same as TX .... the same as stops in other countries.
What is "Normal" in every part of the world that Teslas drive or will eventually drive FSD. There is no one size fits all. Cali FSD training / driving is not the worldwide standard.

Tesla is too hesitant at stops! The car could evaluate the situation on the way to stopping to 0 mph and go *immediately* after all tires stop. I don't know how an automated car could legally do anything differently. If not a full stop then people will do 5 or 10 or 20 or more mph 'roll thrus'.

 

[SpaceNuts]

Just got v11.4.7 last night. I had 11.4.4 before.

Just finished a two hours' drive consists of 70% highway and 30% local. It had zero intervention. The only blemish is a phantom brake event on a new location. It braked from 45 mph to about 42 mph. But it was very brief and it corrected itself before I could intervene.

So far, I am loving it. But it was only one drive.

 

[kpanda17]

11.4.4
Last night I experienced rhe quick slow down into a construction area, 55 to 45 mph reduction by FSD, instead of staying with the traffic and their speed, the vehicle quickly slowed down; right thing to do but was abrupt
heard v 11.4.7 would stay with traffic and gradually slow down
Anyone know?

 

[scottf200]

heard v 11.4.7 would stay with traffic and gradually slow down

Source? Heard from where? It was talked about for v12.

 

[kpanda17]

Source? Heard from where? It was talked about for v12.

Oh, maybe that’s where
Thanks for clarifying
FSD Mind is in two worlds

 

[jebinc]

So for everyone who said HW3 was a dead end and wouldn't get any significant upgrades nice to see that's not the case. Maybe that will help pull this thread out of the negative doldrums.
From the investor thread
Yeah, the entire subforum is taken over by TSLAQ and other Tesla hating nutters.
Tesla, TSLA & the Investment World: the Perpetual Investors' Roundtable



"

One can hope. But you can’t say it, “ain’t the case” as nothing has been released that proves what was said. Extraordinary claims require extraordinarily evidence (which we don’t have).