TMC is an independent, primarily volunteer organization that relies on ad revenue to cover its operating costs. Please consider whitelisting TMC on your ad blocker and becoming a Supporting Member. For more info: Support TMC

Fixed object detection in Autopilot/FSD (out of main)

Discussion in 'TSLA Investor Discussions' started by ZeApelido, Dec 29, 2019.

  1. ZeApelido

    ZeApelido Active Member

    Joined:
    Jun 1, 2016
    Messages:
    2,469
    Location:
    The Peninsula, CA
    Sad. :(

    A reminder to investors, one of the key challenges (probably the single most important) for FSD and "March of 9s" is static object detection and classification. Is the fleet data enough for training and does HW3.0 allow for a big enough network to make a difference here? Remains to be seen
     
    • Like x 4
  2. JustMe

    JustMe Member

    Joined:
    Nov 21, 2016
    Messages:
    542
    Location:
    Seabrook
    Yes this is really awful and sad. God willing Tesla or someone else will soon make tragedies like this a thing of the past.

    My understanding is that FSD is not “better autopilot”. It’s a fundamentally different approach that allows the vehicles “understand “ their environment better. It’s great fsd can recognize traffic cones, pedestrians, trash cans, and traffic lights. But can it recognize the car is about to drive straight into a brick wall? It should be possible for the vehicles to use stereo imaging to see an imminent impact. I’ve never seen that discussed by Tesla reps.
     
    • Informative x 1
  3. EV Promoter

    EV Promoter Member

    Joined:
    Nov 30, 2019
    Messages:
    329
    Location:
    Europe
    I'm totally with you. All Emergency Brake Systems have the same problem (excluding apparently the unfeasible Lidar) and here is the technical limit of existing camera system (and hw). And is a huge problem. It's mostly here that fully autonomous drive plays its future.
    I'm wondering why there's no dedicated discussions. Honestly i can't believe to Fsd and Robotaxi feasibility without the demo on how Tesla overcome this limit. Hope they will succed but i don't feel actual camera resolution and Hw can deal with it. Hope Musk will surprise the world again.
     
  4. UnknownSoldier

    UnknownSoldier Unknown Member

    Joined:
    Apr 17, 2017
    Messages:
    1,689
    Location:
    WA
    Well Autopilot is well known to plow straight into non-moving objects because of how it fundamentally works. Teslas on Autopilot have hit concrete crash barriers, fire trucks, police cars, semis, etc. because Autopilot simply cannot be made to detect non-moving objects without also creating equally hazardous false positives which would cause the car to slam on the brakes randomly all the time and cause rear-end collisions instead.

    So if FSD can at least detect non-moving objects and not crash into them, while also not creating false positives, which is necessary for no human supervision whatsoever, then it's a huge step up from Autopilot. And yes, FSD is fundamentally different from Autopilot which is just TACC (Traffic-Aware Cruise Control), FSD means the car literally drives itself from point A to B while the human does nothing and could maybe even be asleep. They are completely different.
     
    • Like x 3
  5. JustMe

    JustMe Member

    Joined:
    Nov 21, 2016
    Messages:
    542
    Location:
    Seabrook
    Camera resolution isn’t the limit here. House flies get by with 1,000 retinal “pixels” It’s about high speed image processing. Next time one of you guys sees Elon or Karpathy, ask them about this please
     
    • Like x 2
  6. ByeByeJohnny

    ByeByeJohnny Member

    Joined:
    Dec 18, 2016
    Messages:
    698
    Location:
    on top of a rocket
    Don't have a car and obviously no auto drive then so as a nonuser is it correct to assume the problem is that a car would stop for a pedestrian or animal in the middle of a highway but not a car since the car is 'supposed' to be there? Only it can't be detected that it's stationary?

    Wouldn't the solution be to have all cars "talk" to all cars nearby so it would know that there is one stopped?
     
  7. EV Promoter

    EV Promoter Member

    Joined:
    Nov 30, 2019
    Messages:
    329
    Location:
    Europe
    The automatic braking systems works until a max speed, different for different makers, because the risk of false positives in making a difference btw several stationary objects. So, above certain speeds the system does work at all, no matter what object is in your lane.
     
  8. Krugerrand

    Krugerrand Is Cat

    Joined:
    Jul 13, 2012
    Messages:
    10,542
    Location:
    Tesla unfriendly place
     
  9. Krugerrand

    Krugerrand Is Cat

    Joined:
    Jul 13, 2012
    Messages:
    10,542
    Location:
    Tesla unfriendly place
    ?

    How is someone who was clearly not paying attention to the road a reminder for a FSD challenge?

    Tesla will have solved that challenge before FSD is turned on without driver oversight or regulators won’t allow it.
     
    • Like x 1
  10. jerry33

    jerry33 (S85-3/2/13 traded in) X LR: F2611##-3/27/20

    Joined:
    Mar 8, 2012
    Messages:
    19,388
    Location:
    Texas
    The first problem is recognition of stationary objects without false positives. AP can't do that, but FSD will. Total difference in ability.

    The second problem is that talking to other cars won't help unless every vehicle is equipped with the ability. It will still be up to the driver because there will always be those vehicles that aren't equipped. For years now, emergency vehicles have had the means to broadcast that they are coming (not sure if this is 100% of emergency vehicles or not), but car manufacturers haven't put in the receivers--even though doing so would help speed the emergency vehicle and wouldn't cost much.
     
    • Helpful x 1
    • Informative x 1
  11. StarFoxisDown!

    StarFoxisDown! Active Member

    Joined:
    Jan 23, 2019
    Messages:
    1,928
    Location:
    Seattle
    The problem of stationary objects above a certain speed always gets brought up as a way of trying to say FSD is ages away because this limitation can't be solved. It seems for some reason people forget hardware procession power, speed, latency and response time plays big roles in how quickly it can detect an object, identify that object, and then perform the appropriate action. They also seem to forget Hardware 3.0 specific code/software has not been active yet in any Tesla(except for the dev team who are actually running that Hardware 3.0 specific code).

    The state of how a Tesla reacts to stationary objects has absolutely no meaning to the current state of their actual FSD software because their retail code on active Tesla's is specific to Hardware 2.5 or below.
     
    • Like x 2
  12. ZeApelido

    ZeApelido Active Member

    Joined:
    Jun 1, 2016
    Messages:
    2,469
    Location:
    The Peninsula, CA
    Of course they won't. But it's a reminder that this problem needs to still be "solved".

    Simply having HW3.0 does not guarantee this success.
     
  13. ZeApelido

    ZeApelido Active Member

    Joined:
    Jun 1, 2016
    Messages:
    2,469
    Location:
    The Peninsula, CA
    I mean I agree with you. We have no idea how well HW3 will do. This is the crux of the problem that others argue require too much compute with cameras, (thus lidar). So it's just a reminder of this issue.
     
    • Like x 1
  14. 3Victoria

    3Victoria Active Member

    Joined:
    May 8, 2016
    Messages:
    1,762
    Location:
    Victoria, British Columbia
    Lidar requires much compute, too. It returns a bunch of dots as distances. The computer still needs to correlate all those dots, and determine that a group of them represents a stopped object. I suspect that this was a case of a lead car changing lanes, and the firetruck becoming a surprise.
     
  15. Krugerrand

    Krugerrand Is Cat

    Joined:
    Jul 13, 2012
    Messages:
    10,542
    Location:
    Tesla unfriendly place
    How do you know it hasn’t been solved? FSD is apparently complete per Tesla.
     
    • Funny x 1
  16. ZeApelido

    ZeApelido Active Member

    Joined:
    Jun 1, 2016
    Messages:
    2,469
    Location:
    The Peninsula, CA
    Not as much as needed for cameras.
     
  17. ZeApelido

    ZeApelido Active Member

    Joined:
    Jun 1, 2016
    Messages:
    2,469
    Location:
    The Peninsula, CA
    Considering there is an entire industry working on this problem, I will assume it hasn't until proven otherwise.

    Tesla has never indicated they have "solved" perception yet. They have indicated they are confident they will.

    I believe they will, because they have the data. But when do they have enough training compute, and then enough inference compute to fit in a car?

    Keep in mind the best deep learning algorithms are feeding in a few camera images at a time.

    These things need to be feeding in 3 to 5 seconds x 30 fps images ideally. Video.

    But they aren't yet because the training would be massive. Tesla agrees and that's why they are working on Project Dojo.
     
  18. EV Promoter

    EV Promoter Member

    Joined:
    Nov 30, 2019
    Messages:
    329
    Location:
    Europe
    In a reddit thread the problem of the need of stereoscopic view with cameras, so not only processing problems, was brought about.
    It would be good to separate the two issue to discuss the topic. I have no idea about stereoscopy, so i'm not stating anything.
     
  19. EV Promoter

    EV Promoter Member

    Joined:
    Nov 30, 2019
    Messages:
    329
    Location:
    Europe
    We have no evidence if the problems have been solved or not. I think looking to the complexity of the problems and the difficulties others are having, is legitimate to suspend the judgement and ask for evidences. Just believe because Musk appears faithful, is religion.
     
  20. humbaba

    humbaba sleeping until $7000

    Joined:
    Aug 25, 2018
    Messages:
    2,249
    Location:
    planet earth
    Maybe not topical, but IMO important and definitely related to Tesla's competitors. I have a strong belief that LIDAR should be banned due to the risk it poses to vision -- both of humans and animals.

    Roughly speaking, the argument in favor of LIDAR safety goes that the lasers are kept to low enough levels to avoid problems. However, I have not found anything convincing that this has been thoroughly studied or even takes into account individual variance. For example, what is the expected rate for eye damage with currently approved LIDAR systems? Does it assume an ideal state with only one LIDAR unit in use? How rigorous are the protocols for determining whether or not eye damage has occurred?

    My searching has not been particularly fruitful so maybe I have missed something and LIDAR has been shown to be safe. One article[1] I did find indicates that studies are "on-going" and that there is substantial risk to overlooking eye damage due to compensation concealing blind spots until the damage is severe. I am concerned that, unless checked, use of LIDAR on public roads will not only have an undesirable impact on animals, but also result in a wave of severe eye damage.

    Am I wrong? I'd love to be, and I admit I don't have much data to work with in drawing my conclusions. But as it stands, I think automotive LIDAR should be banned.

    1) Lasers and Eye Safety: Are Lasers Dangerous? | SemiNex
     
    • Informative x 6
    • Like x 5
    • Helpful x 1

Share This Page

  • About Us

    Formed in 2006, Tesla Motors Club (TMC) was the first independent online Tesla community. Today it remains the largest and most dynamic community of Tesla enthusiasts. Learn more.
  • Do you value your experience at TMC? Consider becoming a Supporting Member of Tesla Motors Club. As a thank you for your contribution, you'll get nearly no ads in the Community and Groups sections. Additional perks are available depending on the level of contribution. Please visit the Account Upgrades page for more details.


    SUPPORT TMC