FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[kabin]

No good at 4:00 and 7:57: The car ran on the shoulders to make right turns. It's illegal and dangerous.

I was thinking the same thing. I couldn't understand his praise for the maneuver - "really beautiful and so natural."

That's where all the debris resides. No thanks.

 

[kabin]

I seem to remember someone who might be in the know saying it is so improved that it should be called V12. I must have been mistaken.

Or manipulated?

 

[powertoold]

It's illegal in California. If another car makes the right turn at the same time then collision will happen and the car crossing the shoulder will be at fault.

California Motorcyclist Safety

www.chp.ca.gov

That's for motorcyclists, also see my comment about not passing anyone on the shoulder

 

[D Good]

Which videos did you watch?

Dirty Tesla’s.

 

[jebinc]

I seem to remember someone who might be in the know saying it is so improved that it should be called V12. I must have been mistaken.

It’s “mind blowing,” as has been reported every other release over the past two years; yet here we are….

 

[Mardak]

HW4 is getting it, I toggled the software track button last night and now see it’s available

As in you see 2023.7.5 available for your HW4 vehicle? TeslaFi is showing someone with HW4 newly getting FSD Beta software from 2023.6.x:

Seems like another technical milestone checked off for Autopilot team of getting FSD Beta working with HW4 (in addition to moving to 2023.x).

 

[Ramphex]

I tow a speeder weighing 2,300 LB's It's six feet tall and is a cube with no aero dynamic values at all. With the X I lost 30-40% range and a lot more in the mountains. What are you pulling? Does Tesla let you use AP or FSD while towing. My X will not allow it.

I tow a boat. No FSD on my Model Y, but it lets me use the TACC which is a lot easier to hold a constant speed with a trailer. I honestly don’t remember if I ever tried the AP since it sucks more ass than FSDj so I never use it even not towing lol

 

[Supcom]

That's for motorcyclists, also see my comment about not passing anyone on the shoulder

In Texas, the Transportation code specifically allows driving on an improved shoulder to prepare to make a turn.

 

[sleepydoc]

It's illegal in California. If another car makes the right turn at the same time then collision will happen and the car crossing the shoulder will be at fault.

California Motorcyclist Safety

www.chp.ca.gov

Not illegal in MN as far as I know. When I searched the state code site all I found was this:
”both the approach for a right turn and a right turn shall be made as close as practicable to the right-hand curb or edge of the roadway”

That would seem to mandate using the shoulder. As a practical matter, the practice here is to use the shoulder when approaching a right turn, assuming it’s paved.

 

[EVNow]

No good at 4:00 and 7:57: The car ran on the shoulders to make right turns. It's illegal and dangerous.

This has been discussed at length when 11.x first came out. Search.

 

[JulienW]

Chucky's first. Fails the CULT right off the bat.

 

[kabin]

Chucky's first. Fails the CULT right off the bat.

Bummer but not too much of a surprise. V11.3.6 randomly had similar performance when attempting to step into traffic. It's as if FSD doesn't see objects and/or planning and object kinematics are still sub optimal.

There's not much hope for FSD rolling out to higher L levels if there's always a chance of these oh $%^T moments. Improved architecture or not, NNs can give a nice show and then scare the hell out of you.

 

[old pilot]

In Texas, the Transportation code specifically allows driving on an improved shoulder to prepare to make a turn.

Tennesse is the same,

• Well ahead of the turning point, check for traffic behind
and beside your vehicle. Get as close as is practical to the
right curb or road edge without interfering with
pedestrians, bicyclists or parked vehicles.
• Give a signal for a right turn for at least 50 feet.
• Before starting to turn, look to the left and right

Also passing a car on the right is permitted if it is an improved shoulder (paved the same as the roadway) and can be done safely.

 

[navguy12]

It's kind of amazing that basic stuff like using HOV lane isn't determined by the cabin camera for occupancy in the passenger seats.

In the province of Ontario, anyone with the ”green vehicle” license plate can use the HOV lanes on all limited access freeways with only the driver on board.

 

[WilliamG]

In the province of Ontario, anyone with the ”green vehicle” license plate can use the HOV lanes on all limited access freeways with only the driver on board.

Sure, there are edge cases (sorry, but the province of Ontario is that), but for those in mainland USA, it should be simpler.

 

[JulienW]

ULTs

 

[WilliamG]

ULTs

Not great. Turning into the middle lane is appalling. How is this basic stuff not solved?!

 

[FSDtester#1]

Where did the edit, report, ignore button go?

 

[FSDtester#1]

By skillful application of the ignore button I've reduced my thread update time by 66%

So you won't be seeing this is what you are saying ?

 

[navguy12]

Not great. Turning into the middle lane is appalling. How is this basic stuff not solved?!

Some day, an FSD beta update will show up without a bunch of notes explaining the minutiae of implied improvements.

It will show up with one sentence, “Tesla assumes all liabilities when this version of FSD is engaged”.

That will be the announcement that the AI development challenges have been solved.