TMC is an independent, primarily volunteer organization that relies on ad revenue to cover its operating costs. Please consider whitelisting TMC on your ad blocker or making a Paypal contribution here: paypal.me/SupportTMC

How much of Autopilot is Tesla and how much is straight Mobileye?

Discussion in 'Model S' started by Firewired, Nov 11, 2015.

  1. Firewired

    Firewired Member

    Joined:
    May 23, 2013
    Messages:
    367
    Location:
    San Antonio, Texas
    I know that Tesla uses Mobileye sensors, but I had thought that Autopilot was Tesla's own proprietary software for the sensors. The video in this link looks very similar to Autopilot to me. So I was wondering is Autopilot essentially just the rollout of off the shelf Mobileye package with some tweaking, or is it truly unique software that Tesla is writing to utilize the sensors?

    London welcomes Mobileye road safety technology | ISRAEL21c
     
  2. Max*

    Max* Autopilot != Autonomous

    Joined:
    Apr 8, 2015
    Messages:
    4,866
    Location:
    NoVa
    Tesla created the learning network that constantly updates the AP software. MobilEye has one too, but they are not the same.
     
  3. Firewired

    Firewired Member

    Joined:
    May 23, 2013
    Messages:
    367
    Location:
    San Antonio, Texas
    #3 Firewired, Nov 11, 2015
    Last edited: Nov 11, 2015
    I understand the herd learning thing being unique. I was surprised about it seeming that Autopilot was just an off the shelf package from a vendor which Tesla was essentially refining by crowd sourcing data.
     
  4. ArtInCT

    ArtInCT Always Learning

    Joined:
    Sep 2, 2014
    Messages:
    1,602
    Location:
    Southern Connecticut
    It is my opinion that Tesla Motors has implemented the Mobileye system of sensors, cameras and the associated software libraries. Tesla and Mobileye have probably worked closely with Mobile's pre sales support consultants to port and implement the Mobileye bits as a Tesla solution on the Tesla hardware platform of the S and X (perhaps Nvidia is also involved in this porting effort). Additionally, from what I have read, Tesla Motors has created a proprietary back end database and learning algorithms that is not shared with Mobile's similar version of the database.

    I did view a video of an early Mercedes or BMW beta of Lane Keeping. The UI was very similar to the Tesla driver's pod display with the exception of the automobile graphic. There was also a laptop that was showing camera views of the sensors' acquisition of the center and right hand lines and objects in nearby lanes. Additionally a running script log of events was scrolling. Darn it now but I have lost the link to that video. Sorry.
     
  5. scottf200

    scottf200 Active Member

    Joined:
    Feb 3, 2013
    Messages:
    1,271
    Location:
    Chicagoland ModelX S603
    Mobileye has the special chips and video interpretation software. It appears Tesla is a layer on that.

    Elon mentions HPP (holistic path prediction) as if it was Teslas but that is Mobileye. See this:
    Tesla Autopilot Vs Competition

    Good thread:

    Juicy tidbits on Autopilot, deep learning, Tesla's advantage from Nov 3 Mobileye Call

    Good thread: Juicy tidbits on Autopilot, deep learning, Tesla's advantage from Nov 3 Mobileye Call
     
  6. Cosmacelf

    Cosmacelf Active Member

    Joined:
    Mar 6, 2013
    Messages:
    3,399
    Location:
    San Diego
    Tesla uses the Mobileye eyeQ3 chip which decodes the video camera scene. It uses a static "deep learning" network (aka sophisticated neural network) to interpret the visual scene into cars, pedestrians, curbs, lane markings and other things. Tesla takes this information and then layers on top of it their own proprietary high resolution GPS map.

    Near as we can tell (best info has been from the Elon closed conference call with reporters about Autopilot), Tesla gathers GPS paths from the entire Tesla fleet, does some processing on the paths and thus creates very accurate lane maps, such that they know the center point of each lane on a multi lane freeway.

    So the Tesla lane keeping system uses both Mobileye visual scene decoding and Tesla high resolution GPS maps blended in some unknown way. We do know that the map information seems to update fairly rapidly unlike Mobileye which is static, doesn't change.

    So far in the car industry, Tesla is the only manufacturer that has developed a system that allows the cars to learn from driver input, and learn fairly rapidly. This is a huge advantage, and will allow Tesla to remain the Autopilot leader forever unless other car manufacturers (or Mobileye) decide to do this too. But since no one else has even talked about having a car as connected as Tesla, I'm not holding my breath on the rest of the industry catching up anytime soon.
     
  7. EarlyAdopter

    EarlyAdopter Active Member

    Joined:
    Jun 24, 2012
    Messages:
    2,496
    Location:
    Redmond, WA
    Mobileye does the vision processing. They normally work with an integrator, like Bosch, who does all the drivetrain and steering control logic. The integrator will then sell a complete package to car manufacturers, like Volvo and Mercedes, who can essentially drop in a plug and play system and be done.

    In the case of Tesla, they act as their own integrator, doing all of their own drivetrain and steering control logic. In addition, Tesla augments the Mobileye output with their own lane-based GPS data as well as fleet learning.

    Tesla is also in a unique position as an automaker to have a direct line of communication to Mobileye, as opposed to all others who have to go through their integrator for any changes.
     
  8. Firewired

    Firewired Member

    Joined:
    May 23, 2013
    Messages:
    367
    Location:
    San Antonio, Texas
    Thats really interesting. Thanks.
     
  9. Forty Creek

    Forty Creek Member

    Joined:
    Aug 27, 2013
    Messages:
    425
    Location:
    Carlisle, Ontario
    Does this suggest that whenever autopilot cars lose the GPS signal, they instantly become less capable?
     
  10. Zextraterrestrial

    Joined:
    Mar 11, 2010
    Messages:
    3,636
    Location:
    Humboldt/Los Altos
    is the mobileye stuff much different than opengl/openCVf? I was looking into some of the graphics processing modules for doing traffic counts and it all seems very similar to what one of the the mobileye videos that someone posted shows. It is pretty interesting and seems relatively easy to image analysis, I'd imagine processing speed is the limiter
     
  11. GasKilla

    GasKilla No Gas Know Peace

    Joined:
    Nov 11, 2015
    Messages:
    412
    Location:
    Los Angeles, CA
  12. EarlyAdopter

    EarlyAdopter Active Member

    Joined:
    Jun 24, 2012
    Messages:
    2,496
    Location:
    Redmond, WA
    I would characterize it as it just becomes as capable as other cars' lane holding. :)

    It's pretty hard to loose GPS lock with modern GPS chipsets and externally mounted antennas, like on a car. Tunnels maybe.
     

Share This Page