FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[Supcom]

Why NHTSA does not recall Apple Vision Pro?

Tesla Driver ‘Arrested’ for Driving With Apple Vision Pro Says It Was Just a ‘Skit’

Apple warns users that they should "never" use the Vision Pro while operating a moving vehicle.

gizmodo.com

Well, that didn't take long.

 

[rlsd]

Because they don't have any authority over consumer devices. That would be up to the CPSC, Consumer Product Safety Commision: CPSC.gov

Apple Vision Pro should show nags when the user wears it to drive on both EV auto pilot cars and ICE cars

 

[MP3Mike]

Apple Vision Pro should show nags when the user wears it to drive on both EV auto pilot cars and ICE cars

I agree, and the Cybertruck that one person was shown using it in doesn't even have Autosteer, so they were just letting it go where the road bumps took them.

The hard part is that is should be OK to use it as a passenger or even as a driver in a L3 car that allows hands, and eyes, off driving like Mercedes. (Of course, in that case it is really complicated because of all the limitations...)

 

[PACEMD]

For the Pay Attention warnings, more likely that some faces are not tracked as well as others. Different shapes, complexions and types of glasses can all make a difference in how well the face tracking NN performs. I don't think I've read any posts from someone claiming that the face tracking works differently for them across multiple cars. In my case, it works well in a M3 and MY. And the M3 has no IR illuminators.

I think that's why I get by without frequent strikes, Tesla just doesn't like staring me in the face. And who can blame them? Been known to scare small children.........

 

[JHCCAZ]

Why NHTSA does not recall Apple Vision Pro?

Maybe they look at it this way:

âï¸ Mind Reading Helmet

15 seconds · Clipped by JHCCAZ · Original video "Back to the Future | PART I | 1955 [Convincing 1955 Doc]" by UltronmanX

youtube.com

 

[sleepydoc]

Well, that didn't take long.

It was actually a stunt.

 

[sleepydoc]

Apple Vision Pro should show nags when the user wears it to drive on both EV auto pilot cars and ICE cars

I can’t confirm but I read a report that vision pro will actually disable itself if you’re driving (i.e. moving too quickly.)

 

[MarcG]

I can’t confirm but I read a report that vision pro will actually disable itself if you’re driving (i.e. moving too quickly.)

Is it smart enough to know whether you’re behind the wheel versus a passenger? It certainly has the hardware with all those cameras

 

[JulienW]

I can’t confirm but I read a report that vision pro will actually disable itself if you’re driving (i.e. moving too quickly.)

Asking Delta flight attendant: Could you ask the caption to slow the plane down so I can use my Vision Pro's.

 

[PACEMD]

Asking Delta flight attendant: Could you ask the caption to slow the plane down so I can use my Vision Pro's.

It has an airplane mode you know........

 

[sleepydoc]

It has an airplane mode you know........

Well duh! It’s a plane - of course it has airplane mode!

 

[mgs333]

Has anyone who used to be on the OG tester branch gotten the new 2024.2.2.1 release? My wife's non-FSD car got it a few days ago and I haven't. Earlier, people were speculating that the people on the OG branch were being held back so they can receive yet another forked version and that seems likely. Not sure how I feel about the testers possibly getting left behind on car features again while getting access to a newer FSDb version.

 

[rlsd]

Asking Delta flight attendant: Could you ask the caption to slow the plane down so I can use my Vision Pro's.

Does Apple Vision Pro show message "Vision may be degraded. Poor weather detected" when it's raining?

 

[TK211X]

24.2.3 popping

 

[JulienW]

24.2.3 popping

Good because if there is one thing I value WAY more than getting a new version of FSD, it is having my BRAKE/ABS/PARK icons up to full NHTSA standard. Such anticipation and I can't wait to actually see them in my car. Please rush me this update Tesla.

 

[scottf200]

Has anyone who used to be on the OG tester branch gotten the new 2024.2.2.1 release? My wife's non-FSD car got it a few days ago and I haven't. Earlier, people were speculating that the people on the OG branch were being held back so they can receive yet another forked version and that seems likely. Not sure how I feel about the testers possibly getting left behind on car features again while getting access to a newer FSDb version.

Three big groups still!

 

[scottf200]

24.2.3 popping

Cybertruck and other AP features?

 

[Supcom]

Has anyone who used to be on the OG tester branch gotten the new 2024.2.2.1 release? My wife's non-FSD car got it a few days ago and I haven't. Earlier, people were speculating that the people on the OG branch were being held back so they can receive yet another forked version and that seems likely. Not sure how I feel about the testers possibly getting left behind on car features again while getting access to a newer FSDb version.

My FSD car was on the FSDb test branch and it has not gotten any 2024.2.x software yet.

 

[TK211X]

Me neither. This is why I think a specific V12 FW version will pop for us soon based on updated recall obligation.

 

[JulienW]

Me neither. This is why I think a specific V12 FW version will pop for us soon based on updated recall obligation.

I wouldn't bet my rent money on that. 24.2.x contains a NHTSA recall so Tesla is going to push it out. Even if Tesla releases a V12.2.x version tomorrow and starts pushing to the influencers we are still weeeeeks away from most of us getting it and this is even going by the "normal" rollout precedent of a minor update version. This being a whole "new thing" is going to be FAR slower and more carful on Tesla's part.

The last time we had a fast rollout was 10.3 and that was an event for the record books (and a day I will never forget).