TMC is an independent, primarily volunteer organization that relies on ad revenue to cover its operating costs. Please consider whitelisting TMC on your ad blocker or making a Paypal contribution here: paypal.me/SupportTMC

Is Tesla using the rear view camera for autopilot?

Discussion in 'Model S' started by ratsbew, Aug 31, 2015.

  1. ratsbew

    ratsbew Member

    Joined:
    Mar 3, 2012
    Messages:
    371
    Does anyone know if Tesla has integrated the pre-existing rear view camera in the autopilot? It seems like it's an extra sensor that could be used in certain cases.
     
  2. HankLloydRight

    HankLloydRight Fluxing

    Joined:
    Jan 18, 2014
    Messages:
    5,787
    Location:
    Connecticut
    I seriously doubt it. The rear view cam is an extreme wide angle lens, and beyond a few inches, it's a very distorted image. It's really only good for parking, or possibly the AP being able to alert you that you're about to be rear-ended. ;)
     
  3. RAW84

    RAW84 Member

    Joined:
    Oct 6, 2014
    Messages:
    340
    Location:
    Boston
    You don't think it's good for blind spot checking, or rather "pre" blind spot checking?
     
  4. HankLloydRight

    HankLloydRight Fluxing

    Joined:
    Jan 18, 2014
    Messages:
    5,787
    Location:
    Connecticut
    When you're driving, watch the rear view cam and you tell me if you can tell when a car is actually in your blind spot. Cars look much further away than they actually are. For anything AP related like blind spot checking, you really need a 3D view of the space around the car.
     
  5. electrish

    electrish I Sing the Body Electric

    Joined:
    Nov 8, 2014
    Messages:
    242
    Location:
    Ohio
    Using the rear camera would be an excellent way, in my opinion, to overcome the limited range of the ultrasonic sensors.
    Maybe I am ignorant, but I would think that the computer system can overcome the distortions of the fish eye perspective.
    Mobileye even mentions a rear camera system on their website: Rear Camera Applications - Mobileye
     
  6. RAW84

    RAW84 Member

    Joined:
    Oct 6, 2014
    Messages:
    340
    Location:
    Boston
    I definitely can tell a car is in my blind spot, in fact that's why I drive with the rear view camera always on. Cars do look further away than they actually are, but that's obvious so you just correct for that.

    But the car has blind spot sensors, so it wouldn't need to use the camera to tell that there's a car in the blind spot. I was thinking the camera could be useful to see if a car is coming up fast in the next lane so that it knows to just let him pass before attempting a lane change. If I can adjust my depth perception of the camera based on 'feel' I have to believe a computer can more accurately make those adjustments.
     
  7. electrish

    electrish I Sing the Body Electric

    Joined:
    Nov 8, 2014
    Messages:
    242
    Location:
    Ohio
    That's exactly what I was thinking: Warning of rapidly approaching vehicles.
    This could then be included into the self-driving part of the Autopilot system in order for the car to decide whether it is safe to change lanes.
     
  8. Soolim

    Soolim Member

    Joined:
    Jun 11, 2015
    Messages:
    849
    Location:
    Vancouver, BC, Canada
    I think what would be nice is to have camera under the side mirrors so that MS can have an all around view. I guess the MX should already have it. :wink:
     
  9. mgboyes

    mgboyes Member

    Joined:
    Apr 16, 2014
    Messages:
    811
    Location:
    United Kingdom
    Model X design studio just opened. It appears that it doesn't have a surround camera function. Only extra "toy" compared to the S is ventilated/cooled seats.
     
  10. W0QR

    W0QR Member

    Joined:
    Feb 4, 2015
    Messages:
    136
    Location:
    Lincoln, NE
    Sure they could..or could have. But probably they're not. Never mind the distortion..easily corrected with a transform algorithm. You should be able to easily detect delta positions..am I going to get hit..or is that car in a bad spot. Are those red lights!? Probably not a useful night time camera (infra red is filtered) but it is high def and you can do a lot with that information. I haven't heard about this..but never say never.
     
  11. Max*

    Max* Autopilot != Autonomous

    Joined:
    Apr 8, 2015
    Messages:
    4,875
    Location:
    NoVa
    This.
     
  12. MarkS22

    MarkS22 Member

    Joined:
    Apr 6, 2015
    Messages:
    309
    Location:
    Morris County, NJ
    There is no question the rear-view video footage can be used in conjunction with MobileEye software to enhance Autopilot. As mentioned previously, adjusting for fish-eye curvature is trivial. It could most definitely help with lane changes (i.e. fast approaching/overtaking cars), rapidly approaching car warnings, and enhancing the current ultrasonic blind spot detection. It could even be used to help with lane guidance. Basically, as a secondary verification that the car is centered in the lane with a completely different lighting angle. (In the case of faded or hard to see lines, the system might want to check the rear camera to ensure the paths continue to match.)

    That said, the question is whether the current processing hardware has the cycles to analyzing the footage. We know the front camera will be used for lane detection and it's already used to read speed limit signs. So, there's video analyzing hardware in the car already. The big unknown is if the rear camera can take advantage of this. If I had to guess, I'd assume the processing power is already being maxed out for the forward facing analysis.
     
  13. HankLloydRight

    HankLloydRight Fluxing

    Joined:
    Jan 18, 2014
    Messages:
    5,787
    Location:
    Connecticut
    I retract what I said -- I did some "empirical" testing today, and yes, the rear view can be used for (human) blind spot detection -- but the driver needs to realize that cars in the blind spots in the rear view camera appear to be at least 1.5, if not 2 full car lengths behind the rear end of the Model S, when in fact they are directly in the blind spot.

    But in all cases, I could see said "blind spot" cars either in my rear-view or side-view mirrors. So if your mirrors are properly set, you really shouldn't have any blind spots.
     
  14. SteveW25561

    SteveW25561 Member

    Joined:
    Jun 10, 2013
    Messages:
    564
    Location:
    Vancouver, Canada
    The current rear view camera is useless with rain splash on it. Other issues with distortion and wide angle can be compensated for with software (assuming enough horsepower which I doubt is currently installed).
     
  15. Stoneymonster

    Stoneymonster Active Member

    Joined:
    Jan 8, 2013
    Messages:
    1,554
    Location:
    Aptos, Ca
    The MobileEye system probably is capable of doing this in hardware. Their whole vision system is based on a custom hardware vision pipeline. Whether it is a suitable camera for the application (and I'm guessing it is not either due to quality/dynamic range or interconnect incompatibility) is another question.
     
  16. Max*

    Max* Autopilot != Autonomous

    Joined:
    Apr 8, 2015
    Messages:
    4,875
    Location:
    NoVa
    That's a really good point.
     
  17. Saghost

    Saghost Active Member

    Joined:
    Oct 9, 2013
    Messages:
    3,029
    Location:
    Delaware
    I've suggested this made sense a couple times before. So far no evidence has emerged that Tesla is doing anything of the sort - but the current "final" version of Autopilot to date doesn't make its own lane changes without the user signaling for it, so it doesn't really need the ability I suppose.
    Walter
     
  18. donv

    donv Member

    Joined:
    Jul 15, 2013
    Messages:
    571
    Location:
    Lake Jeanclia, OR
    Put a piece of tape over the rear camera, engage TACC, and see if you get any warning messages. That would be the easiest way to tell.
     
  19. Max*

    Max* Autopilot != Autonomous

    Joined:
    Apr 8, 2015
    Messages:
    4,875
    Location:
    NoVa
    It's not that easy.

    1. I doubt it's using the rear camera for TACC.
    2. If it's using the rear camera for the mystical autopilot and this mystical autopilot will work in rain, they could have a sensor fusion algorithm which uses the camera when the visibility is good (no rain, to make autopilot EVEN better), or doesn't use the camera (rain/snow/etc., makes the autopilot just OK, but still usable).
     
  20. HankLloydRight

    HankLloydRight Fluxing

    Joined:
    Jan 18, 2014
    Messages:
    5,787
    Location:
    Connecticut
    Or better yet, anyone with AP and the front camera kit (does anyone have this?) -- The front camera defaults to "on" all the time except when backing up. That would really cause AP to freak out, I'd guess.
     

Share This Page