Editor’s note: This headline was updated. A previous version implied interior cameras are already in use.
A Tesla hacker has uncovered new details about the rearview-mirror-embedded camera in the company’s vehicles. He says the cameras are trained to recognize facial movements, which could impact decisions from the car’s computers.
The discovery was posted to Twitter by @greentheonly.
Among the things the cameras are observing are: BLINDED, DARK, EYES_CLOSED, EYES_DOWN, EYES_NOMINAL, EYES_UP, HEAD_DOWN, HEAD_TRUNC, LOOKING_LEFT, LOOKING_RIGHT, PHONE_USE, SUNGLASSES_EYES_LIKELY_NOMINAL, and SUNGLASSES_LIKELY_EYES_DOWN.
These observations seem to judge how engaged someone is behind the wheel, or if their driving may be hampered because they’re on the phone or wearing sunglasses. Further, it aims to detect serious problems, such as a driver with their eyes closed.
Having a camera observe the cabin of the car, particularly the person behind the wheel, makes sense for the safety of Tesla’s planned Full Self Driving feature, but some owners may not be comfortable with the constant surveillance. It’s not clear when Tesla may start collecting such information or how they will request owners’ permission.
In the meantime, as Tesla continues to develop its self-driving capabilities, the ability to detect the alertness of the driver seems important to both safety and research for the technology.