FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[SSDTester#1]

https://twitter.com/x/status/1664790889426812928

https://twitter.com/x/status/1664790911321268224

That guy is a shmuck. He came on here defending Tesla in the whole “console quality gaming” for original refresh Model S debacle, telling people they’re overreacting and Tesla will have it addressed within two weeks in a bulletin. I called him out on it in two weeks and he had nothing to say. It’s been MONTHS, and Tesla has yet to care to address over a year worth of refresh Model S not getting Steam due to the crippled RAM infotainment system. I guess we have Infotainment (Beta).

 

[PACEMD]

The newest software is sugar.

Sweet!

FSDp

 

[PVia]

After one week with 11.3.6, my main issues are:
- would love to see the car stay closer to the left lane line, instead of centering between the line and parked cars
- it's often way too close to parked cars, esp with the way some people swing open their doors w/o looking
- drives too close to a concrete divider if there's no line at the base (right or left side)
- would like to see it bias to the line opposite the divider
- signals and wants to change lanes often, even when there's a turn coming up that would be easier if it just stayed put
- tends to cross into the other lane in double left/right turn lanes
- sometimes changes lanes in intersections
- would like to see smoother braking and more use of regenerative braking vs friction braking
Looking forward to 11.4.2 and onward...

 

[EVNow]

That guy is a shmuck

So .... Are you claiming his tweet about FSD testing outside US is wrong?

 

[FSDtester#1]

So .... Are you claiming his tweet about FSD testing outside US is wrong?

Not sure, but he does seem very reliable most of the time, but this time he is a douchebag

 

[Yelobird]

So .... Are you claiming his tweet about FSD testing outside US is wrong?

No, just an opening to further bark about a video game he didn’t get and would never play. An entitlement gripe.

 

[EVNow]

Not sure, but he does seem very reliable most of the time, but this time he is a douchebag

Basically they have some inside information .... i.e. they have an informant who gives them non-public information. Sometimes the information turns out to be correct and sometimes not. Could be because the informant is guessing (instead of knowing) or because the information was correct when given - but plans changed.

You would take it with a pinch of salt as you would any Bloomberg article

Tesla Plans to Showcase Updated Model 3 With Musk in Shanghai

Tesla Inc. plans to give an early glimpse of its revamped Model 3 sedan as part of Chief Executive Officer Elon Musk’s first visit to the carmaker’s Shanghai factory in years, according to people familiar with the matter.

www.bloomberg.com

 

[rlsd]

Speed reduce issue: Tesla should put an icon/message on the screen and sound a ding to indicate speed reduce ahead (maybe .5 mile in advance)

 

[SSDTester#1]

So .... Are you claiming his tweet about FSD testing outside US is wrong?

No. I just don’t like him

 

[SSDTester#1]

No, just an opening to further bark about a video game he didn’t get and would never play. An entitlement gripe.

Pretty sure the feature was promised and advertised. Never delivered.

EDIT: With your stupid logic, if FSD never gets delivered, and people complain about it, they’ll be “barking” because they’re “entitled”. Damn apologists.

 

[fasteddie7]

I notice changes in behaviors at the same spots every day, are there silent updates that make subtle changes every night, or is it just random ghosts in the machine?

 

[SSDTester#1]

I notice changes in behaviors at the same spots every day, are there silent updates that make subtle changes every night, or is it just random ghosts in the machine?

The Junk is bipolar

 

[kabin]

Pretty sure the feature was promised and advertised. Never delivered.

EDIT: With your stupid logic, if FSD never gets delivered, and people complain about it, they’ll be “barking” because they’re “entitled”. Damn apologists.

Indeed. Some folks have magical thinking where it's okay for them to complain about other people complaining.

 

[Yelobird]

Indeed. Some folks have magical thinking where it's okay for them to complain about other people complaining.

Agreed, I am devastated not having a video game and a fart speaker. Those bastards promised!

 

[GlmnAlyAirCar]

I notice changes in behaviors at the same spots every day, are there silent updates that make subtle changes every night, or is it just random ghosts in the machine?

No not random ghosts. I believe it was green who posted that whenever you enter a route into navigation, metadata for your trip is downloaded, including things such as locations of lanes, stop signs, etc. This is presumably updated frequently and is likely the cause of what you are seeing.

When I first got 11.4 it would consistently miss or take the wrong exits on the highway. Where there were extremely faded lines would get into a non-existent lane (admittedly a lot human drivers would do that as well). Now, it doesn’t do any of those things. All with the same software version.

 

[EVNow]

Indeed. Some folks have magical thinking where it's okay for them to complain about other people complaining.

Some folks have magical thinking where it's okay for them to complain about other people complaining about other people complaining.

 

[EVNow]

I notice changes in behaviors at the same spots every day, are there silent updates that make subtle changes every night, or is it just random ghosts in the machine?

If you describe, may be we can figure out. There are map updates - but more likely just randomness of circumstances. NN is not deterministic.

 

[drtimhill]

If you describe, may be we can figure out. There are map updates - but more likely just randomness of circumstances. NN is not deterministic.

Technically not quite true, given the same input it will always generate the same output .. but predicting the output for a novel input is hard. What makes them "squishy" is that the input is rarely identical.

 

[EVNow]

Technically not quite true, given the same input it will always generate the same output .. but predicting the output for a novel input is hard. What makes them "squishy" is that the input is rarely identical.

Right - it is not deterministic because in real life the "same" intersection will look different from day to day. But we expect FSD to behave the same way each time.

 

[rlsd]

Technically not quite true, given the same input it will always generate the same output .. but predicting the output for a novel input is hard. What makes them "squishy" is that the input is rarely identical.

NN output is the same for the same set of inputs but the results of the output applied to a specific car at a specific location can vary because those specific information cannot be factored into the NN inputs. For example: weather condition, tire wear, load weight, surrounding cars,...