Welcome to Tesla Motors Club
Discuss Tesla's Model S, Model 3, Model X, Model Y, Cybertruck, Roadster and More.
Register

Does FSD Beta use the steering wheel or the interior camera to know if youre paying attention?

This site may earn commission on affiliate links.
On autopilot, it asks me every few seconds to nudge the steering wheel or hit the gear stalk.

I've opted into FSD Beta. Once I am in FSD, does it continue to bug you to hit the steering wheel, or does it use that dash cam to track your eyes? or both?
 
Both, if Tesla was to label they would say Camera is Beta.

Screen Shot 2022-02-14 at 7.18.07 PM.png
 
Last edited:
On autopilot, it asks me every few seconds to nudge the steering wheel or hit the gear stalk.

I've opted into FSD Beta. Once I am in FSD, does it continue to bug you to hit the steering wheel, or does it use that dash cam to track your eyes? or both?

Yes. Both. If you think your current Autopilot nagging system is bothersome, it would get even stricter in FSD beta.
 
It's supposed to be both, but I haven't seen much evidence that it uses the camera.

In fact I could probably block the interior facing camera without any impact. I should try that to test my theory.
It does use the camera and blocking the camera will not work at all. Want a simple test. Just try to pick up your cell phone it will immediately set off the red alarm.
 
  • Like
Reactions: Darren F
Obviously those of us with older S and X don’t have interior cameras. I assume someday my 3 will only use the interior camera for monitoring and I won’t need to be concerned about constant light pressure on the steering wheel. But as for my “ancient S,” I imagine I won’t be so lucky.
 
This works great other that you can't enable the Beta with the camera blocked.🤣
There seems to be a lot of discrepancy between what gets reported here, and what I read about within the news. This is why I have to test it myself. :)

For example this article claims covering the camera didn't block the engagement of AP or FSD Beta.

 
It does use the camera and blocking the camera will not work at all. Want a simple test. Just try to pick up your cell phone it will immediately set off the red alarm.

I'm not going to do the cell phone test as I feel like its low hanging fruit neural network wise. It's pretty easy to train a neural network to detect a cell phone or what looks like a cell phone within view of the camera.

What I'm concerned by is the lack of any notification or alert when using the UI.

When Tesla released the V11 UI "upgrade" they caused hundreds of thousands of drivers to struggle to find controls where driving down the road while on AP or FSD Beta. I imagine quite a few didn't have the self restraint to stop themselves from menu diving while hurling down the road at 70mph.

The very fact that I was able to figure out this wretched UI is both an indication that the driver monitoring sucks, and indication that I need to be a bit more self restrained when being annoyed that I can't find something.

So I made a rule like I've done thousands of times while driving to do a better job.
 
  • Like
Reactions: sleepydoc
Definitely both. Sometimes I'll be paying attention to the road and it'll nag me about holding the steering wheel - and it'll turn out I was holding the wheel with both hands and balancing out the torque it needs for hand detection.
Yeah, I drive with my hand (singular) at the 6 o'clock position, but I have to deliberately move the wheel now and then. I find it easier to forget AP and just drive it myself.
 
  • Love
Reactions: Ramphex
I'm not going to do the cell phone test as I feel like its low hanging fruit neural network wise. It's pretty easy to train a neural network to detect a cell phone or what looks like a cell phone within view of the camera.

What I'm concerned by is the lack of any notification or alert when using the UI.

When Tesla released the V11 UI "upgrade" they caused hundreds of thousands of drivers to struggle to find controls where driving down the road while on AP or FSD Beta. I imagine quite a few didn't have the self restraint to stop themselves from menu diving while hurling down the road at 70mph.

The very fact that I was able to figure out this wretched UI is both an indication that the driver monitoring sucks, and indication that I need to be a bit more self restrained when being annoyed that I can't find something.

So I made a rule like I've done thousands of times while driving to do a better job.
May be low hanging fruit but it Does prove the camera is watching as you questioned by saying you could cover it. While v11 was different (people hate change) I personally found no issue with the update.
 
May be low hanging fruit but it Does prove the camera is watching as you questioned by saying you could cover it. While v11 was different (people hate change) I personally found no issue with the update.

Fundamentally they all come down to accommodating different types of users.

I don't think either the V11 UI nor the Driver Monitoring were really tested all that well.

The V11 UI has been rather thoroughly ridiculed on user forums. It's not just change, but its change to something where there was no obvious benefit from it.

The Driver monitoring system has no way to audit it so we have no idea how well its actually working. I plan on trying to duplicate CR's setup by having a slider like they did. The reason for this is I want to see what it does if I cover it AFTER engaging AP or FSD Beta.

Once I know how how it responds to being covered then I can figure out if there is anything about me to explain why it doesn't seem to work.
 
  • Like
Reactions: sleepydoc
..... I plan on trying to duplicate CR's setup by having a slider like they did. The reason for this is I want to see what it does if I cover it AFTER engaging AP or FSD Beta.

Once I know how how it responds to being covered then I can figure out if there is anything about me to explain why it doesn't seem to work.
I'll save you the trouble. Here is what happens when you cover the camera on FSD. Time stamp: 7:05

 
  • Informative
Reactions: jsmay311
I'll save you the trouble. Here is what happens when you cover the camera on FSD. Time stamp: 7:05

Is there something about putting a bag over the cabin camera that creates a different result from a slider? Need to understand the details here and why results are inconsistent
 
Is there something about putting a bag over the cabin camera that creates a different result from a slider? Need to understand the details here and why results are inconsistent

For me its really about comparing expected functionality, and what actually happens.

If I put my thumb over the camera I expect FSD Beta not to engage.
If I put my thumb over the camera while driving down the road on FSD beta I expect it to complain rather quickly and to have to take over.
If I put my thumb over the camera before engaging AP on the highway I expect it not to engage
If I put my thumb over the camera while driving down the road on AP I expect it to complain rather quickly and to have to take over.

Why do I have to test these?

Functionality changes between firmware builds, and the HW on a vehicle.

I'm sure there is a logical explanation behind why CR got the results they did.

Owners themselves are dissuaded to test the driver monitoring out of fear of a strike out so we don't have an ample amount of evidence as to why there are differences. With the blindspot monitoring cameras we know what the root cause is of different visual results. We know it took Tesla quite a few revisions to get the HW right. so it wasn't impacted by the turn signal light.

I would rather not test covering the camera as it's not the actual test I want to do. It's only a ground truth test like verifying a device under test is plugged in.

Verify that the base functionality is working, and then verify that it can see my face.
 
I’ve gotten nagged to ‘pay attention to the road,’ even when I’m looking straight ahead and doing just that. It also doesn’t seem to matter where I’m looking, I still get nagged to move the steering wheel every 10 seconds no matter what so while it may use the camera it’s not clear for what it’s using it; it certainly doesn’t seem to be for tracking driving attention.

And I’ll agree with @S4WRXTTCS - v11 is a wonderful example of how not to design a UI. Many times I’ve been thankful I have FSD so I can figure out the screen!
 
  • Like
Reactions: Ramphex and melsee
I’ve gotten nagged to ‘pay attention to the road,’ even when I’m looking straight ahead and doing just that. It also doesn’t seem to matter where I’m looking, I still get nagged to move the steering wheel every 10 seconds no matter what so while it may use the camera it’s not clear for what it’s using it; it certainly doesn’t seem to be for tracking driving attention.

And I’ll agree with @S4WRXTTCS - v11 is a wonderful example of how not to design a UI. Many times I’ve been thankful I have FSD so I can figure out the screen!
I received an FSD strike recently because the car insisted that I wasn't paying attention to the road, despite applying force to the wheel and looking dead ahead. I believe the camera was tricked by having the visor only partway down pointing toward me, as opposed to pointing toward the windshield. This despite it not blocking line of sight to my eyes. Since then, I take care with the visor and haven't had any other issues.