FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[PACEMD]

I think the Turkish Prison line was glaring enough that people would try to figure out what the heck it means.

Also, some movies are timeless. I'm pretty sure that's one. I could be wrong. And I'm surprised how many people born after the turn of the century still recognize references to TV shows that I watched as a kid two decades earlier, which originally aired three decades or more before that. Never underestimate the power of low-budget syndication.

So I'm guessing if I reference 1950's television I might be in a select crowd? What's that girl? FSDb fell down the well?

 

[kabin]

First drive with 4.4. Some improvements but will wait for a few more drives before judging.
The one dangerous problem that continues is pulling out in front of traffic when it's not safe. This particular example is not new but highlights the behavior when FSD stops at an intersection but then never creeps to make sure it's safe to pull out. FSD just goes. In this case the crossing traffic was a 18 wheeler. My guess is FSD would have eventually stopped without hitting the truck but the truck driver would have freaked and then bad things can happen.
Most of the time at this intersection FSD just goes without ever creeping. In the past I've also seen FSD try and pull out with vehicles coming from both directions at this intersection which is not obstructed. I had another intersection like this and after a few emails to Tesla it was fixed. Who knows if my emails had any impact. Already emailed Tesla on this for what it's worth.
It will be helpful when the B-pillar camera view is available which we know is coming.

Sometimes those semis are difficult to see.

 

[D Good]

Still stuck on the junk 11.4.2 here.

 

[powertoold]

What’s impressive? The car didn’t know what it was, slowed down, and then barreled through the next slide/puddle for whatever reason.

It would be impressive if it slowed down for that mud patch; however, it could have been slowing down for the yellow blinking lights above. Can't tell for sure unless he drives back the other way.

 

[Iain]

11.4.3 was terrible. TBH the whole 11.4.X has been pretty bad so far, especially with entering turning lanes and making turns.

I would agree. 11.3.6 was far better for me until today with 11.4.4 I’ve only done a couple of short drives but it worked flawlessly. I hope further use of it still provides a positive step forward

 

[uscbucsfan]

I would agree. 11.3.6 was far better for me until today with 11.4.4 I’ve only done a couple of short drives but it worked flawlessly. I hope further use of it still provides a positive step forward

I got it, but the wife has that car

 

[WilliamG]

It would be impressive if it slowed down for that mud patch; however, it could have been slowing down for the yellow blinking lights above. Can't tell for sure unless he drives back the other way.

Right, I never assume a one-off is a consistent behavior. I have wildly differing experiences from one drive to the next at the same time of day on the same roads in the same weather.

 

[MARKM3]

I gotta say, I'm on 11.3.6 and it's pretty bad. After using it for two months now I can say that I drive manual way more often. FSD 11.x has got a loooong ways to go in my honest opinion. I'm having my doubts about it ever being able to actually be a safe FSD car.

Here are some key points:

1. I'm constantly having to disengage on left or righthand turns. If I had to guess I'd be willing to bet 75% of the time if there is traffic. The car wants to either pull out in front of a car or pull out dangerously close to oncoming traffic for unprotected left hand turns. I'm beginning to think there is too much blind spot for measuring long distances of traffic at stop sign intersections. These in my opinion are safety related interventions. Not acceptable for software that has been in the works for ~5 years now.
   1. I'd expect cross traffic camera vision to be just as good as it is at detecting vehicles in front of the car. But I am having serious doubts about turning left or right at a stop sign onto a 55mph highway.
2. Two lane back country highways have constant improper speed limits (25mph instead of 55mph), go around slight bends waaay too slow, break for those turns waaay too soon, and phantom brake with oncoming traffic in opposite lane often.
3. Merges are hit and miss. Most of the time, my car doesn't merge onto the highway properly. It either runs the lane out or it will allow itself to be put in a bad spot to where it has to slam on the brakes to merge.
4. Tesla waits too long for turning traffic to accelerate.
5. Having to constantly input accelerator, speed limit adjustments, etc.

Overall, FSD is an utter waste of money even for $200. Honestly Tesla should give it for free until it is polished enough to become a mainstream reliable software offering. In its current state, it is in fact junk.

 

[Genie]

I gotta say, I'm on 11.3.6 and it's pretty bad. After using it for two months now I can say that I drive manual way more often. FSD 11.x has got a loooong ways to go in my honest opinion. I'm having my doubts about it ever being able to actually be a safe FSD car.

Here are some key points:

1. I'm constantly having to disengage on left or righthand turns. If I had to guess I'd be willing to bet 75% of the time if there is traffic. The car wants to either pull out in front of a car or pull out dangerously close to oncoming traffic for unprotected left hand turns. I'm beginning to think there is too much blind spot for measuring long distances of traffic at stop sign intersections. These in my opinion are safety related interventions. Not acceptable for software that has been in the works for ~5 years now.
   1. I'd expect cross traffic camera vision to be just as good as it is at detecting vehicles in front of the car. But I am having serious doubts about turning left or right at a stop sign onto a 55mph highway.
2. Two lane back country highways have constant improper speed limits (25mph instead of 55mph), go around slight bends waaay too slow, break for those turns waaay too soon, and phantom brake with oncoming traffic in opposite lane often.
3. Merges are hit and miss. Most of the time, my car doesn't merge onto the highway properly. It either runs the lane out or it will allow itself to be put in a bad spot to where it has to slam on the brakes to merge.
4. Tesla waits too long for turning traffic to accelerate.
5. Having to constantly input accelerator, speed limit adjustments, etc.

Overall, FSD is an utter waste of money even for $200. Honestly Tesla should give it for free until it is polished enough to become a mainstream reliable software offering. In its current state, it is in fact junk.

I find every one of those issues remain on V11.4.3

 

[WilliamG]

I find every one of those issues remain on V11.4.3

Was going to say! There's no improvement there on 11.4.3, that's for sure.

 

[kabin]

And unfortunately within v11.4.4's short release time (<24hrs?) I've already seen 3 video cases of near misses after poor UPL gap selection.

 

[fasteddie7]

Was going to say! There's no improvement there on 11.4.3, that's for sure.

It’s so odd that I had the opposite experience. 11.4.2 was a regression for me, but 11.4.3 was vastly improved. it also brought park assist to my HW4 car, and my experiences there are also more positive than what I read from others. Going to try 4.4 soon see how that goes.

 

[jebinc]

Hard to believe how junky the new 11.4.4 Junk is in this just released Black Tesla (refreshed MS) video. Unreal.

 

[jebinc]

And unfortunately within v11.4.4's short release time (<24hrs?) I've already seen 3 video cases of near misses after poor UPL gap selection.

“Junk” turns into “JUNK” with 11.4.4. Just linked in Black Teslas first drive video. Many fails and wildly flailing yoke. Hard to watch. I won’t be installing this version of JUNK. I bet Whole Mars says it’s great - wait for it…. I will be waiting for 11.5….

 

[uscbucsfan]

“Junk” turns into “JUNK” with 11.4.4. Just linked in Black Teslas first drive video. Many fails and wildly flailing yoke. Hard to watch. I won’t be installing this version of JUNK. I bet Whole Mars says it’s great - wait for it…. I will be waiting for 11.5….

It has to be better than 11.4.3 and likely 11.4.2.

 

[Supcom]

It would be impressive if it slowed down for that mud patch; however, it could have been slowing down for the yellow blinking lights above. Can't tell for sure unless he drives back the other way.

Message on the screen was "Creeping forward for visibility" so suspect the mud was not a factor.

 

[jebinc]

It has to be better than 11.4.3 and likely 11.4.2.

Doesn’t seem to be. Watch the video…

 

[uscbucsfan]

Doesn’t seem to be. Watch the video…

I did. Nothing that isn't happening in 11.4.3.

 

[j0shm1lls]

interestingly enough, last night i jumped from 11.4.2 to 11.4.4. I'll take it!

 

[PR0FESSOR]

I watched that movie as a young adult. I lost any urge to ever visit Turkey… and my lack of desire to visit Turkey has never waned. LOL.

Turkish prison? Watch this movie:

Midnight Express (1978) ⭐ 7.5 | Biography, Crime, Drama

2h 1m | R

www.imdb.com