Editor’s note: This headline was updated. A previous version implied interior cameras are already in use.
A Tesla hacker has uncovered new details about the rearview-mirror-embedded camera in the company’s vehicles. He says the cameras are trained to recognize facial movements, which could impact decisions from the car’s computers.
The discovery was posted to Twitter by @greentheonly.
Among the things the cameras are observing are: BLINDED, DARK, EYES_CLOSED, EYES_DOWN, EYES_NOMINAL, EYES_UP, HEAD_DOWN, HEAD_TRUNC, LOOKING_LEFT, LOOKING_RIGHT, PHONE_USE, SUNGLASSES_EYES_LIKELY_NOMINAL, and SUNGLASSES_LIKELY_EYES_DOWN.
In case you were wondering what does the selfie camera in model 3 currently try to detect:
— green (@greentheonly) October 4, 2020
BLINDED
DARK
EYES_CLOSED
EYES_DOWN
EYES_NOMINAL
EYES_UP
HEAD_DOWN
HEAD_TRUNC
LOOKING_LEFT
LOOKING_RIGHT
PHONE_USE
SUNGLASSES_EYES_LIKELY_NOMINAL
SUNGLASSES_LIKELY_EYES_DOWN
These observations seem to judge how engaged someone is behind the wheel, or if their driving may be hampered because they’re on the phone or wearing sunglasses. Further, it aims to detect serious problems, such as a driver with their eyes closed.
Having a camera observe the cabin of the car, particularly the person behind the wheel, makes sense for the safety of Tesla’s planned Full Self Driving feature, but some owners may not be comfortable with the constant surveillance. It’s not clear when Tesla may start collecting such information or how they will request owners’ permission.
In the meantime, as Tesla continues to develop its self-driving capabilities, the ability to detect the alertness of the driver seems important to both safety and research for the technology.