FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[jebinc]

Burnout.

No surprise there. I figure the same is true for the FSD team. While I don’t have numbers, I would not at all be surprised if data stated the turnover is exceptionally high…

 

[jebinc]

Are you able to make it over to West Seattle? I have some great roads for you try (and fail) on!

 

[KrazinAz]

By skillful application of the ignore button I've reduced my thread update time by 66%

 

[jebinc]

We all understand "end-to-end" to mean 1 gigantic neural network that takes camera data as inputs and outputs controls, but I wonder if Elon is just misusing it. Contextual, we know Elon was tweeting about replacing more of the control and planning code with neural nets:

https://twitter.com/x/status/1614377287557984256

So he might just mean perception, planning, and control each being primarily run by their respective neural networks. A network at one end, and a network on the other, but not really "end-to-end."

 

[rlsd]

So it finally happened. Strike 1 received on a long trip from Dallas to Iowa City (and back).

To be fair it was justified. Yes I’m guilty. Based on other forum post I’m probably the only guilty Tesla Driver to receive a strike..lol. My question is related to how V11 handles strikes. I understand if you get 5 you will lose acces to FSD beta for a few weeks then it resets. But if I do not receive any more strikes does it still reset back to 0 in a few weeks? The other question I have is does 1 strike impact the ability to receive timely FSD beta updates? Would be a shame if I miss out on 11.4.x.

Thanks I’m advance!
Coming from the only guilty strike recipient using FSD beta..

The strike count is for duration of one month now. After one month it's reset to zero.

 

[JulienW]

By skillful application of the ignore button I've reduced my thread update time by 66%

I have found a logical conclusion based on the majority of the last few pages which (like my post) have almost nothing to do with 11.x. Run the numbers and you will see it is a sound formula.

FSDb=FSDp-FSDj or FSDb=FSDj+FSDp

So I have determined that 11.4 is actually a FSD Beta product and NOT FSD Junk or FSD Perfect.

 

[Ramphex]

Oh look, my car without a $10,000 package is going from 2023.12.1.1 to 2023.12.5…. Flagship refresh with FSDj is still on 2022.45.15.

Just saying…

Müll

 

[SeattleFSD]

Are you able to make it over to West Seattle? I have some great roads for you try (and fail) on!

You bet! I've only done Alki in West Seattle, so keen to do more. Post them to this thread in the order you want me to test them and I'll start on them this upcoming weekend. I'll follow up to make sure I'm clear on the routes. If you have specific times you want them tested, add that too please. Weekdays are tough, as I have a job - but weekends are fairly open before 7pm.

If you post the route request as a comment to one of my videos on YouTube, I'll give you a shout out in the video. I did this for a drive to Kent as well as Tacoma.

You can find me on youtube.com/@SeattleFSD. I typically do 30mins drives, so I can squeeze them into 10 mins videos. If you explore my channel, you'll get an idea of my style. Hopefully, it comes across in the videos but in the event it does not: I don't care if the software fails. I'm just keen to see what it can do. In fact, the more it fails, the better = more reports I get to send to Tesla!

Btw - the offer is open to anyone who knows the Seattle area or likes using chatGPT to find challenging routes.

 

[SeattleFSD]

First I'd say given how sped up the Tesla video is it's unclear to what degree there's any jerk at all---- Second I'd say to my knowledge the refresh S is running the same FSDb a 3 or Y is running (and likely doing it on a better media computer than most 3/Ys are)- is there a video of whatever issue you're talking about on yours?

I use FFW on my vids too, but nothing like that original Tesla-created video. I tend to use:

0.5x to show detail of what the tentacle is planning, in a close call
1x for close calls
1.5x for speeds under 25 mph
3x for speeds between 25 and 60mph or boring drives under 60mph
5x for speeds over 60mph
(rarely) 10x for speeds over 60mph and the car stays in the same lane with not much going on

The tentacle will give you a good idea on jerk plus my b/w steering wheel can help spot the jerks too.

But FSD beta is like a teenage boy - jerks consistently and often for no visible reason (yes, pun intended!)

You can find me on youtube.com/@SeattleFSD

 

[rlsd]

What Should Tesla Improve? The Company Asked For Comments

Tesla and CEO Elon Musk have often asked fans, owners, and investors for advice. Sometimes, the company actually grants requests.

insideevs.com

Everyone spoke. I want to add one more thing: Better UX design.

 

[PACEMD]

You folks do know that Elon is a frequent poster on TMC, right? Under an alias of course. In fact, I understand he is in negotiations to purchase the whole TMC kit and caboodle. Just you wait.......

 

[Porkalletta]

The strike count is for duration of one month now. After one month it's reset to zero.

Interesting? I got a strike 6 months ago and it's still there?

 

[sleepydoc]

Interesting? I got a strike 6 months ago and it's still there?

Seems like a better route would be to have the strikes drop off after a certain amount of time. Getting 5 strikes in a month is different from getting 5 strikes in a year.

 

[EVNow]

I actually wish I ran into more “naysayers” when I did my FSDj research. Instead I saw a slew of shill videos and posts and fell for it, ultimately wasting my money. I don’t necessarily regret it, but if I had to do it again, I would’ve done it differently.

I think most of us were surprised when we first got FSD - in person it definitely seemed worse than YT.

When a company gives special access to "Influencers" - by definition they are trying to (at least subtly) control the narrative. PR people are graded on how well they can control the press / influencers. The "special access" always comes with a threat of removing the access when they get out of line.

Works exactly the same way in politics too - politicians control what journalists write by giving or denying special access to them.

In neither case money is involved (thats why I don't like the term "shill") - but "special access" is by itself corrupting.

 

[jebinc]

I think most of us were surprised when we first got FSD - in person it definitely seemed worse than YT.

When a company gives special access to "Influencers" - by definition they are trying to (at least subtly) control the narrative. PR people are graded on how well they can control the press / influencers. The "special access" always comes with a threat of removing the access when they get out of line.

Works exactly the same way in politics too - politicians control what journalists write by giving or denying special access to them.

In neither case money is involved (thats why I don't like the term "shill") - but "special access" is by itself corrupting.

Money may, or may not be involved; “money” is just one of many forms of compensation…There still is a “quid pro quo” going on, so…

 

[jebinc]

We should do a poll on this one - to see when people think this may happen. Maybe @sleepydoc can add a poll to his/her thread?

Free 1-Month Tesla FSD Trial To Come Once It's "Super Smooth": Musk

Tesla will give every North American customer a free taste of FSD, but not before it makes sure the software is safer and smoother than it is right now.

insideevs.com

 

[PACEMD]

Interesting? I got a strike 6 months ago and it's still there?

Me too, also.......

 

[PACEMD]

You folks do know that Elon is a frequent poster on TMC, right? Under an alias of course. In fact, I understand he is in negotiations to purchase the whole TMC kit and caboodle. Just you wait.......

I think that poll should be about which one of us is actually Elon in disguise. My money is on either Ramphex or jebinc........junk can do some crazy stuff to you..........

 

[PACEMD]

I want to be an influencer. Is there a signup list, like for FSDb? An influencer score? If I had any influence I would get to the bottom of this deal, but alas...........

 

[EVNow]

Money may, or may not be involved; “money” is just one of many forms of compensation…There still is a “quid pro quo” going on, so…

It’s all various shades of gray … for eg. With almost every interview there are “don’t ask about these topics” agreements…