TMC is an independent, primarily volunteer organization that relies on ad revenue to cover its operating costs. Please consider whitelisting TMC on your ad blocker and becoming a Supporting Member. For more info: Support TMC
  1. TMC is currently READ ONLY.
    Click here for more info.

Seeing the world in autopilot, part deux

Discussion in 'Autopilot & Autonomous/FSD' started by verygreen, Sep 25, 2018.

  1. fmonera

    fmonera Member

    Joined:
    May 31, 2018
    Messages:
    65
    Location:
    Madrid
    Very interesting. It seems to me a proof that Mobileye is cheating, at least in that video. I don't see any other explanation. Anyone have another view about this?
     
    • Like x 5
  2. LargeHamCollider

    LargeHamCollider Battery cells != scalable

    Joined:
    Jan 10, 2015
    Messages:
    939
    Location:
    United States
    Seriously, this dude craps on approximately every autopilot thread on the site, endlessly boosting mobileye and all other non-Tesla pre-autonomous technologies, making each thread an unreadable mess.
     
    • Like x 8
    • Love x 2
  3. mongo

    mongo Well-Known Member

    Joined:
    May 3, 2017
    Messages:
    12,857
    Location:
    Michigan
    Mild push back:
    Why are people complaing that lane change is not fully automatic and requires driver confirmation? Is it due to false expectations generated by people who made the software do something it was not yet intended to?
    Instead of going from all driver commanded lane changes to AP suggested/ driver confirmed, people now feel like they are going from fully automatic to driver confirmed.

    What is a feature increase is turned into a feature decrease.

    Expectation management.
     
    • Disagree x 1
  4. strangecosmos

    strangecosmos Non-Member

    Joined:
    May 10, 2017
    Messages:
    1,039
    Location:
    The Prime Material Plane
    @Bladerskb @Joel @J1mbo I felt bad about helping to derail verygreen’s thread but I feel a bit better now that I’m not the only one. I created a megathread where we can move Mobileye vs. Tesla discussions when they crop up in other, unrelated threads:

    Mobileye vs. Tesla megathread

    Sometimes unrelated threads do create a genuine jumping off point for the Mobileye vs. Tesla discussion, but that discussion should be continued elsewhere to prevent people like poor verygreen from losing their threads to off-topic debates.
     
    • Helpful x 5
  5. Shateam

    Shateam Member

    Joined:
    Apr 13, 2016
    Messages:
    578
    Location:
    NJ
    They are probably just trying to level the playing field...
     
  6. verygreen

    verygreen Curious member

    Joined:
    Jan 16, 2017
    Messages:
    2,897
    Location:
    TN
    Well, the problem is the actual pedestrian recognition was kind of late. imagine that the pedestrian was about to cross the street, would you be able to stop in time at the distance it was detected as such?
     
    • Helpful x 1
  7. mongo

    mongo Well-Known Member

    Joined:
    May 3, 2017
    Messages:
    12,857
    Location:
    Michigan
    If the non-drivable area tracked the person with cart, the car would avoid them or stop. However, it would not do the preemptive "person who is waiting to cross at cross walk" local to me law though. The orientation of a person crossing the street with cart would also be different that this situation (90 rotation).
     
  8. strangecosmos

    strangecosmos Non-Member

    Joined:
    May 10, 2017
    Messages:
    1,039
    Location:
    The Prime Material Plane
    #288 strangecosmos, Oct 4, 2018
    Last edited: Oct 4, 2018
    @verygreen It seems to be an ongoing controversy whether without lidar HW2 Teslas are capable of estimating depth accurately. Would you or anyone you know be able to run a proper trial of Autopilot’s depth estimation metadata against some ground truth (like a long measuring tape or a laser distance measurer)? Ideally including as one of the tests from a distance as far away as you can accurately measure with your ground truth instrument.

    I think if Autopilot always comes in at within 20 cm or 8 inches of ground truth, that’s hands-down a win for Tesla. A bit worse would probably be fine, but humans only seem to manage about 20 cm of accuracy longitudinally when parking.

    Humans do better on lateral accuracy: about 10 cm or 4 inches. Does the Autopilot metadata provide a distance estimate for cars directly adjacent? If so, that would allow testing of Autopilot’s lateral accuracy as well.

    Edit: @jnuyens maybe you could conduct this trial?
     
    • Like x 2
  9. strangecosmos

    strangecosmos Non-Member

    Joined:
    May 10, 2017
    Messages:
    1,039
    Location:
    The Prime Material Plane
    @BigD0g would you be able to do the above described Autopilot metadata vs. ground truth test of depth estimation?
     
  10. BigD0g

    BigD0g Active Member

    Joined:
    Jan 12, 2017
    Messages:
    2,019
    Location:
    Somewhere
    No, that would require access to the raw meta-data. Last time I checked, Tesla doesn't give us access to the raw meta-data.
     
  11. strangecosmos

    strangecosmos Non-Member

    Joined:
    May 10, 2017
    Messages:
    1,039
    Location:
    The Prime Material Plane
    I thought maybe you had access to the same metadata as verygreen. Their videos show distances estimates down to 0.1 m / 10 cm.
     
  12. BigD0g

    BigD0g Active Member

    Joined:
    Jan 12, 2017
    Messages:
    2,019
    Location:
    Somewhere
    If you read the article, you'd know it's a special dev board he discovered.

    "They have now teamed up again for an even better look at what Autopilot can see after they bought an Autopilot Hardware 2.5 computer on Ebay that just happened to be a fully unlocked developer version."

    Watch a Tesla drive in Paris through the eyes of Autopilot
     
  13. strangecosmos

    strangecosmos Non-Member

    Joined:
    May 10, 2017
    Messages:
    1,039
    Location:
    The Prime Material Plane
    How do you have v9? Are you in the early access program? I don’t really understand how people are getting v9, who has developer permissions, or whatnot. It is all very mysterious to me, even after reading the article.
     
  14. BigD0g

    BigD0g Active Member

    Joined:
    Jan 12, 2017
    Messages:
    2,019
    Location:
    Somewhere
    Your confusing the two. The article is based on a developer ape board @verygreen found. V9 has absolutely nothing to do with that. Hope that clears it up for you.

    Anyone that has v9 that's talking about it, didn't get it from Tesla directly, otherwise they'd be under NDA.
     
    • Like x 2
    • Helpful x 1
  15. croman

    croman Active Member

    Joined:
    Nov 21, 2016
    Messages:
    4,624
    Location:
    Chicago, IL
    I'm interested in this super special blacklist. Seems to be a violation of us law. Shady Tesla, violating ownerso rights to root through copyright exceptions.
     
  16. BigD0g

    BigD0g Active Member

    Joined:
    Jan 12, 2017
    Messages:
    2,019
    Location:
    Somewhere
    But it's like fight club @croman, Tesla will never admit that it exists. Even when you go to the SC, they'll just say your car hasn't been slotted for a firmware that's compatible with your car and packages yet. Even though we know all firmwares are 100% generic.
     
  17. scaesare

    scaesare Well-Known Member

    Joined:
    Mar 14, 2013
    Messages:
    8,178
    Location:
    NoVA
    Between this and your "I'm never wrong" tirades, it's difficult to take you seriously.
     
    • Love x 3
    • Like x 1
  18. shudder

    shudder Member

    Joined:
    Aug 6, 2018
    Messages:
    13
    Location:
    Calabasas, CA
    I ran across this thread just now. Very interesting stuff, for sure. I have not read through all 15 pages of comments (!!), but wanted to throw this out there...

    In the OP I read "a pedestrian in red(dish?) jacket is not detected at all" (with the recommendation to maybe NOT wear red jackets in Cali and Norway...! hahahaha). I looked at that few seconds over and over and noted the car was turning (it looked like maybe it was even a u-turn). As I observed this short section over and over again, I saw that there is ANOTHER pedestrian, this one in black/gray, at about 3:34, just seconds after the redcoat, this one walking in the crosswalk, and even closer (it appears) to the car. Most importantly, it appears that ped ALSO was not recognized (I saw no bounding box around either the redcoat or this second person). Because the ped was in the crosswalk, and dressed in dark color, I think this needs to be pointed out as I find it even more distressing. Perhaps as a point of discussion or thought.

    Just thought I'd mention it.

    - shud
     
  19. verygreen

    verygreen Curious member

    Joined:
    Jan 16, 2017
    Messages:
    2,897
    Location:
    TN
    #299 verygreen, Oct 7, 2018
    Last edited: Oct 7, 2018
    So I have another old video for you. This one is interesting in that autopilot is identifying and tracking roadside structures like poles. There are also other unknown points mostly in the upper part of the picture, these are not radar, but purely vision-generated points, note how they often track cloud outlines in the sky, not just traffic signs and whatnot. I guess this is mostly to be used with HD maps for better localization.

    I think this shows that @jimmy_d analysis of old NNs was correct and there's a lot more of hidden not yet activated stuff there.



    There are two kinds of these things. Just anonymous point cloud and then there are points with an object type - you can tell them apart because latter ones have a number nearby denoting the type. We do not have a coherent picture of what each value represent.

    Also for whatever reason v9 and a even later v8.1 builds suddenly turned this detection off for some unknown reason, so it's entirely possible the code was experimental and did not live up to expectations?
     
    • Informative x 13
  20. Bladerskb

    Bladerskb Senior Software Engineer

    Joined:
    Oct 24, 2016
    Messages:
    2,068
    Location:
    Michigan
    v9 still doesn't have 3DVD i surmise?
     

Share This Page

  • About Us

    Formed in 2006, Tesla Motors Club (TMC) was the first independent online Tesla community. Today it remains the largest and most dynamic community of Tesla enthusiasts. Learn more.
  • Do you value your experience at TMC? Consider becoming a Supporting Member of Tesla Motors Club. As a thank you for your contribution, you'll get nearly no ads in the Community and Groups sections. Additional perks are available depending on the level of contribution. Please visit the Account Upgrades page for more details.


    SUPPORT TMC