FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[Therealm80]

I’d love that in a magnet form

 

[EVNow]

Did you make it yourself? I'd buy something like this without the Tesla logo.

I’d love that in a magnet form

Car Magnets & Magnetic Signs | 50% OFF MAGNETS

Magnetic signs on the cheap! Design & buy Truck, Van or car door magnets online for cheap. GET 50% OFF TODAY! SHIPS NEXT DAY*

www.magnetsonthecheap.com

Wiki - MASTER THREAD: Actual FSD Beta downloads and experiences

Guys for some reason I am having an issue coming up with something good for warning plate. I don’t want a bumper sticker because stickers stick…. I need some brainstorming….

teslamotorsclub.com

Any other idea for the signage ... ? I'm thinking of getting a smaller one which fits 3 better.

ps :

 

[rlsd]

Car Magnets & Magnetic Signs | 50% OFF MAGNETS

Magnetic signs on the cheap! Design & buy Truck, Van or car door magnets online for cheap. GET 50% OFF TODAY! SHIPS NEXT DAY*

www.magnetsonthecheap.com

Wiki - MASTER THREAD: Actual FSD Beta downloads and experiences

Guys for some reason I am having an issue coming up with something good for warning plate. I don’t want a bumper sticker because stickers stick…. I need some brainstorming….

teslamotorsclub.com

Any other idea for the signage ... ? I'm thinking of getting a smaller one which fits 3 better.

ps :

View attachment 943883

I prefer a more cryptic sign "FSD is engaged" and let the public figure out the meaning.
Or "This vehicle will stop at anytime".

 

[Twiglett]

I got the opportunity to do some 11.3.6/11.4.2 comparison testing this weekend.
First was my 75% highway daily commute which was pretty good with 11.3.6 but still had plenty of times where I would have to either take over or just manually drive.
With 11.4.2 it was honestly the best behaved commute I've ever had with FSD or AP. Highway corners and passing trucks is much more natural and feels safer. Only two takeovers needed, which for my commute is a huge improvement.

The second test is my drive out to weekend camping, 50ish miles each way. Mostly smaller roads on the first half and fast highway the second half and reverse on the way home.
The smaller road part was significantly better, not a single takeover at all, really smooth and natural. The second half on the divided highway but with side roads etc was appalling, easily the worst FSD has been in a long time. It was constantly changing lanes for no reason, only to change back half a mile later.
On the way back today I let it zigzag its way down the highway for 5 minutes before getting bored of the constant lane changes and just manually drove.
I was hoping for a repeat of the good drive on the smaller road section but was sadly disappointed.
The good bits from earlier were still there, but the insanity of some of its decisions was mind boggling.
1 - smooth corner into an acute merge, I looked left to check traffic and FSD alerted, gave the red hands then disengaged
2 - Waiting at a red light in the straight on lane behind another car. As the light went green, FSD started signaling left to either overtake the already moving lead car or try to turn left a the light. I took over.
3 - Waiting at another red light, as light went green the car wasn't even out of the junction and it again started signaling left, there was no lead car this time and there was already other cars in the left lane. For the next mile or so, every time I engaged FSD it would signal left again. I gave up again it this point and drove manually.

The good bits. Its now significantly better at sharp right hand turns at lights, its now starting to cope with flashing yellow warning lights (that aren't traffic lights), it now maintains speed of tight corners and is noticeably smoother.
The bad bits. Lane consistency and control is appalling. Traffic light behavior was ridiculous today, Feels like two steps forward with severe regression on lane choice.

 

[EVNow]

I prefer a more cryptic sign "FSD is engaged" and let the public figure out the meaning.
Or "This vehicle will stop at anytime".

Another option ...


https://www.amazon.com/Bluetooth-Programmable-Scrolling-Advertising-14-6x3-6/dp/B0B1DD5K2T/

Oh BTW, for people afraid of driving at speed limit ...

Amazon.com

 

[Dave EV]

The fact that people feel the need for these signs is troubling.

If your testing of FSD is affecting the flow of traffic, disengage and drive manually.

Do not force others to deal with Tesla's erratic FSD behavior.

 

[willow_hiller]

If your testing of FSD is affecting the flow of traffic, disengage and drive manually.

Do not force others to deal with Tesla's erratic FSD behavior.

Ironically, it's FSD Beta obeying the letter of the law and other drivers behaving erratically, most of the time. I've been thinking of a bumper sticker to the effect of:

"The computer driving this car isn't intimidated by your tailgating, go around."

 

[rlsd]

View attachment 943906


View attachment 943907

Another option ...


https://www.amazon.com/Bluetooth-Programmable-Scrolling-Advertising-14-6x3-6/dp/B0B1DD5K2T/


View attachment 943917


Oh BTW, for people afraid of driving at speed limit ...

Amazon.com

View attachment 943916

Seriously I want "My other cars are BMW, Mercedes, Audi" to show my friendliness to owners of BMW, Mercedes, Audi,... to calm them down. Secondly to show my preference to the current drive.

 

[Dave EV]

Ironically, it's FSD Beta obeying the letter of the law and other drivers behaving erratically, most of the time. I've been thinking of a bumper sticker to the effect of:

"The computer driving this car isn't intimidated by your tailgating, go around."

In my experience, it's not the letter of the law that causes the most issues for me that require me to disengage.

It's the over cautiousness at intersections (just how far is it going to creep into a 4-way stop before it decides it's safe to go?), erratic behavior making turns (rapid back and forth steering adjustments), turning on the blinker when not needed, changing lanes back and forth when not needed, etc.

FSD drives like it's a high, drunk, teenage, elderly driver, all combined in one.

And every now and then it nails a situation perfectly and you wonder "now why can't it drive like that all the time?".

 

[JulienW]

...."The computer driving this car isn't intimidated by your tailgating, go around."

Kinda have a thought along this line every time someone honks. "My car doesn't know are care about your horn."

 

[EVNow]

The fact that people feel the need for these signs is troubling.

If your testing of FSD is affecting the flow of traffic, disengage and drive manually.

Do not force others to deal with Tesla's erratic FSD behavior.

The signage is to notify others that the car doesn't behave exactly like other neurotic drivers that are texting while driving as a courtesy

 

[JulienW]

The signage is to notify others that the car doesn't behave exactly like other neurotic drivers that are texting while driving as a courtesy

....but can you texted them a pic of the sign so they can see and read it.

 

[rlsd]

The fact that people feel the need for these signs is troubling.

If your testing of FSD is affecting the flow of traffic, disengage and drive manually.

Do not force others to deal with Tesla's erratic FSD behavior.

I disagree. My FSD driving does not violate traffic laws. The other drivers are belligerent and reskless.

 

[EVNow]

In my experience, it's not the letter of the law that causes the most issues for me that require me to disengage.

It's the over cautiousness at intersections (just how far is it going to creep into a 4-way stop before it decides it's safe to go?), erratic behavior making turns (rapid back and forth steering adjustments), turning on the blinker when not needed, changing lanes back and forth when not needed, etc.

FSD drives like it's a high, drunk, teenage, elderly driver, all combined in one.

And every now and then it nails a situation perfectly and you wonder "now why can't it drive like that all the time?".

Funny thing is - I & my kids wonder when we see other Teslas on the road whether they are using FSD. We can always tell if they are not - by how bad the lane keeping is. Normally people cross the lines all the time - esp. on curvy roads. Yesterday we had a car in front that rode on the right line the entire way - no doubt distracted by a call or something else.

 

[Bet TSLA]

Kinda have a thought along this line every time someone honks. "My car doesn't know are care about your horn."

Why would you think that? We know the car has the ability to hear voice commands. And, obviously, it needs to hear to get to level 4/5. Might be testing this now. Probably not, but...

Eventually, we're going to see FSD pull over for emergency vehicle sirens and/or flashing lights (laws vary). Then we'll start seeing hacks from other drivers that get all the Teslas to get out of their way by imitating the right sounds and such.

 

[kabin]

Tesla's warning might be the most appropriate:

Warning: This Vehicle May do the Wrong Thing at the Worst Time.

 

[Supcom]

Why would you think that? We know the car has the ability to hear voice commands. And, obviously, it needs to hear to get to level 4/5. Might be testing this now. Probably not, but...

It is not required for the car to sense audio to be L4/L5. Deaf humans drive cars.

 

[Bet TSLA]

It is not required for the car to sense audio to be L4/L5. Deaf humans drive cars.

Not everywhere, and not under all conditions, and not without a variety of extra rules and possibly training or equipments to be able to be aware of audible signals.

Besides, Teslas can already hear, so that's not an issue. The only question is how they will react to what they hear.

 

[rlsd]

Speaking of audio: Why do we need to press the horn to save the recorded video? The horn will irritate people. I only use it when there are no cars close to me. Why don't we just have a button to save the video?

 

[MP3Mike]

Why don't we just have a button to save the video?

You do.