FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[Kablooie]

I think lots of people would use it if it actually worked. I have a tight garage where there's not much room to open the door; it would be great to be able to summon out of it and even better to summon into it.

Same with me. I put white lines down in the garage in the hopes that summon would allow me to move it into the garage automatically. It works occasionally but often angles itself towards my wife's car when it moves in. I have to grab the door handle to stop it a few inches from my wifes' car. Other times it starts then stops and gives up. Only once in ever 3 or 4 tries does it succeed. Not very usable.

 

[Twiglett]

that’s not the only USE CASE that summon is being sold on. That’s really just a garage parking facilitation. And, I’d like to see it do that with a garage with another car, and less than 12” inches between vehicles. It just STOPS completely and times out, or fails out.

Main thing I use summon for is to send the car out into the rain, then back again so I can wash it.
That hasn’t happened for a few months here in Texas though

 

[JHCCAZ]

Main thing I use summon for is to send the car out into the rain, then back again so I can wash it.

Summon's on the Storm

 

[Yelobird]

Well let's see:

I've proven that statement totally wrong. Then you decided to restrict it to a garage with another car, then added the distance between cars has to be less than a foot. Anymore restrictions you wanna place on this to prove your point?

Well done on the whack-a-troll. Lol. Priceless.

 

[JohnB007]

Main thing I use summon for is to send the car out into the rain, then back again so I can wash it.
That hasn’t happened for a few months here in Texas though

That's actually a good idea! lol
Finally a reason for me to learn how to use summon...

 

[Scott Chapman]

YEa, I thought there was an "auto-park" feature where you press park twice, it brings up a UI where you tell it to go forward or back, then get out of the car, and it would pull into or out of your garage.

Did that go away?

 

[aronth5]

Here is an example of a B-pillar obstructed view problem that I have encountered many times at this intersection. There are lots of other intersections with worse views this just happens to be one in my area. Between the 2 trees, telephone pole and bushes FSD consistently launches at this intersection when it shouldn't. Since I can lean way forward I'm able to stop FSD from getting T-boned or causing oncoming traffic to swerve out of the way. I wonder what would have happened in this situation with a large truck bearing down on me if I had not immediately stopped when I saw the truck about 100 feet away. I merged two video clips from Tesla's videos so there is a slight lag in between. The truck was actually at the intersection a split second or two sooner making this encounter even worse than it looked. This is why I post so many comments regarding the B-pillar camera limitations and the danger associated with poor camera location. This was potentially life ending.

 

[jebinc]

Where has the OP (EVNow) of this thread gone? Haven't seen a post in over a month...

 

[Pdubs]

Where has the OP (EVNow) of this thread gone? Haven't seen a post in over a month...

Probably on the Rivian forums

 

[JulienW]

Probably on the Rivian forums

Are you confusing the two (EVNow and jibinc)?

 

[DrGriz]

Are you confusing the two (EVNow and jibinc)?

You all know what Jebinc translates to from slovakian...,,

 

[JulienW]

You all know what Jebinc translates to from slovakian...,,

FSDJunk

 

[jebinc]

Probably on the Rivian forums

You’re confused… that’s me!
Loving my R1T!

 

[DrGriz]

FSDJunk

Something along those lines!

 

[Yelobird]

You’re confused… that’s me!
Loving my R1T!

View attachment 962217

R1tJ. Sorry had to do it. Lol

 

[jebinc]

R1tJ. Sorry had to do it. Lol

More like MSPj; that would be more accurate.

 

[amadeusneo]

Still trying to get this junk removed from my car. Tesla is now resisting its removal - Exchange with SC attached. You can’t make this stuff up.

View attachment 959838

My SC just flat out told me they can’t do anything about my firmware version other than push the same build to my car. And that I’ll just have to wait for further updates. It’s baloney.

 

[amadeusneo]

Not to derail but as this keeps popping up what is the advantage to opting out vs just turning off the features while they make improvements?? What in the “production branch” is so remarkable or “can’t live without” to go through the juggle? I mean IF say the production branch increased range by 50 miles Sure makes sense but what is SO incredible there that waiting a bit is so tormenting to live without.

For me I want the latest features and bug fixes. I currently have bugs relating to Bluetooth and sentry on the fsd beta older branch that I assume are fixed in latest production.

 

[amadeusneo]

YEa, I thought there was an "auto-park" feature where you press park twice, it brings up a UI where you tell it to go forward or back, then get out of the car, and it would pull into or out of your garage.

Did that go away?

Nope still there but conditions have to be just right. For me since my driveway is sloped it will not allow me to do it.

 

[jebinc]

My SC just flat out told me they can’t do anything about my firmware version other than push the same build to my car. And that I’ll just have to wait for further updates. It’s baloney.

More like horseshite. Unreal that a SC can handle this - especially when the official email process, isn’t.