FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[jebinc]

What do you mean? I'm not going to be able to use my car as a robotaxi by the end of the year?

But I overextended my budget to get this car banking on using it as a robotaxi.... What am I going to do now?!?!?!?!?

I hear you made a “bad financial decision”! What, you say I can’t believe everything I read in the internet?!

 

[Ramphex]

I hear you made a “bad financial decision”! What, you say I can’t believe everything I read in the internet?!

I actually wish I ran into more “naysayers” when I did my FSDj research. Instead I saw a slew of shill videos and posts and fell for it, ultimately wasting my money. I don’t necessarily regret it, but if I had to do it again, I would’ve done it differently.

 

[jebinc]

I actually wish I ran into more “naysayers” when I did my FSDj research. Instead I saw a slew of shill videos and posts and fell for it, ultimately wasting my money. I don’t necessarily regret it, but if I had to do it again, I would’ve done it differently.

Agreed. Many “no interventions,” “mind blowing,” “100% improved,” yada yada yada videos and similar forum posts promoting FSD’s then current greatness and, either “canonizing” Elon, or outright declaring him ad a demigod….

Anyhoo, let’s hope v11.4 is something of an improvement…

 

[n.one.one]

With credit to @PACEMD I've updated my avatar.
I've done this not to reflect perfection, or to ignore FSD beta shortcomings. Rather, it's in the spirit of 'the glass is half full'.

 

[Tcmccormick]

Trying to find a definitive answer on how I can subscribe to and get FSD beta (city streets). We had a M3P last year and I subscribed and got it before a road trip which was great. We now have a MYLR and I recently subscribed, but never got the full FSD package. All I got was the EAP, and whatever else comes with that basic package. I have heard if your car's software version is to far ahead that is the reason you cannot get the FSD beta (city streets). I am currently on 2023.6.9 and there is a new update available 2023.12.5. If I keep denying the install for a while will I eventually be able to successfully subscribe to "FULL" FSD? How are we supposed to know which version and which version will allow the FSD beta? I find a lot of anecdotes and opinions but have not found any good source to know how to successfully get FSD beta. You would think Tesla would explain this somewhere.

 

[JulienW]

.....I am currently on 2023.6.9 and there is a new update available 2023.12.5....

There is NO new update on 23.12.5 available. This version is in internal (employee) testing only and not available to anyone.

Maybe in a few weeks if all goes well it will rollout to everyone.

 

[PACEMD]

I think everyone except Omar is tired of Elon’s ‘overoptimism.’

Y’all might need to think this through and stop wasting my time, ’cause Omar can come back tomorrow. And the next day. And the next day, ya feel me?​

 

[Dennisis]

So, we’ve finally devolved to lunacy……

 

[jebinc]

Y’all might need to think this through and stop wasting my time, ’cause Omar can come back tomorrow. And the next day. And the next day, ya feel me?​

For those on the other side, a "badge of courage" for speaking your mind (and the truth).

Note: The badge is color appropriate...

Enjoy!

 

[PACEMD]

View attachment 935853

That's pretty! Pretty junkie..........

 

[jebinc]

That's perfect! Perfectly junkie..........

Yes. I also forgot to say it comes with a, “Perpetual world-wide royalty free any use IP license”. Folks are free to use it as their new Avatar, if they do choose!

 

[sleepydoc]

What do you mean? I'm not going to be able to use my car as a robotaxi by the end of the year?

But I overextended my budget to get this car banking on using it as a robotaxi.... What am I going to do now?!?!?!?!?

Guess there’s nothing left to do but wallow in your naïveté!

 

[WilliamG]

Drop me a line where and when. Next weekend would be perfect - my Mon thru Thurs is pretty busy. Anywhere within 30 mins of the Seattle area is cool with me. I assume you all have GoPros etc to document and someone has put together a test plan and route?

Are you able to make it over to West Seattle? I have some great roads for you try (and fail) on!

 

[willow_hiller]

Anyway, the whole idea of "end-to-end NN" is just another pie-in-the-sky.

Rules of the road can't all be inferred by NN - besides they change somewhat based on jurisdiction.

We all understand "end-to-end" to mean 1 gigantic neural network that takes camera data as inputs and outputs controls, but I wonder if Elon is just misusing it. Contextual, we know Elon was tweeting about replacing more of the control and planning code with neural nets:

https://twitter.com/x/status/1614377287557984256

So he might just mean perception, planning, and control each being primarily run by their respective neural networks. A network at one end, and a network on the other, but not really "end-to-end."

 

[jebinc]

We all understand "end-to-end" to mean 1 gigantic neural network that takes camera data as inputs and outputs controls, but I wonder if Elon is just misusing it. Contextual, we know Elon was tweeting about replacing more of the control and planning code with neural nets:

https://twitter.com/x/status/1614377287557984256

So he might just mean perception, planning, and control each being primarily run by their respective neural networks. A network at one end, and a network on the other, but not really "end-to-end."

Agreed, Elon is more likely than not having a estranged relationship with the facts/truth here - just like his comments over the years that the Cybertruck is based on a structurally stressed skin exoskeleton, when in fact (as discussed by the Munro Live team) it is not…. But listening to him, it sure sounds cool and we should all line up and buy one or more…

 

[sandman1330]

Guess there’s nothing left to do but wallow in your naïveté!

I trust you were aware I was joking, and are doing the same….

 

[EVNow]

Do you know anyone who works there?

I know someone who was a direct report to Elon

 

[EVNow]

So he might just mean perception, planning, and control each being primarily run by their respective neural networks. A network at one end, and a network on the other, but not really "end-to-end."

Interestingly they were earlier talking about Monte Carlo tree search to figure out the best path. They no longer talk about that. I guess whatever they are doing now has replaced it.

"Planner optimization using NN / Monte Carlo Tree Search (MCTS)"

 

[jebinc]

I know someone who was a direct report to Elon

And why are they no more a direct report to Elon? That inspired?!

 

[EVNow]

And why are they no more a direct report to Elon? That inspired?!

Burnout.

If I was just out of college definitely I'd be working there or at SpaceX ... But if you have a family and want to see your kids grow... Not the place.