TMC is an independent, primarily volunteer organization that relies on ad revenue to cover its operating costs. Please consider whitelisting TMC on your ad blocker and becoming a Supporting Member. For more info: Support TMC

Details of AP 2 reinforcement learning with video uploads? Pictures enclosed

Discussion in 'Model S' started by calisnow, Aug 4, 2017.

  1. calisnow

    calisnow Active Member

    Joined:
    Oct 11, 2014
    Messages:
    2,228
    Location:
    Los Angeles
    Here are the screenshots of an area I described before but without pictures. The first photo has a circle around the problem area and the second photo is zoomed in with path markers. When traveling north-east on highway 66 in the left lane, the car behaved perfectly until reaching the spot with the circle - at which it would immediately dive hard left toward oncoming lanes where the center divider disappeared. I have no idea why it never had problems with the three similar spots directly preceding it. However I drive each way on this road every day 2-5 times, sometimes more. So when I read about the video uploads I decided to see if I could help "train" the system. I let autopilot drive until the absolute last moment when I could "save myself" and then break away with the steering wheel. I am the only Tesla in the area AFAIK - have not spotted any others on this road in the 8 months I've been driving it. This "training" started when the car was shipped to me in, I believe late April/early May - it was on 17.17.4 8.1 when I got it and it was "misbehaving. 17.26.76 resulted in what I thought was a fix at first but later realized was not 100% - now the car would not go hard left at the divider but just go slightly jogged, but remain in lane - but unfortunately would not go right far enough when the median reappeared - so I had to break off every time to avoid what I thought would be a scraping of the concrete with my wheels - but I continued to use AP, stay in that troublesome lane - and break off each time at the last possible moment. Finally 17.28.c628869 was released a couple weeks ago and BAM - problem now completely gone - if anything the car actually jogs right maybe 2 inches when the median disappears - like it was spooked or something by all my "breaking away" at that spot. I've driven it dozens of times on 17.28.c628869 and the behavior is perfect each time.

    Proof that video uploads are being used for reinforcement learning? No - but I never saw learning like this of any particular spot on AP1. Hopefully a good sign of things to come...

    Screen Shot 2017-08-04 at 9.01.08 AM.png

    Screen Shot 2017-08-04 at 9.01.30 AM.png
     
    • Informative x 3
    • Like x 2
  2. BrainCandy

    BrainCandy Member

    Joined:
    Jul 19, 2017
    Messages:
    16
    Location:
    Milton, ON
    Nice report. Very interesting to see how it has improved in this spot over time. I've seen a lot of Teslas driving in my area over the past year so I'm interested to see how well my autopilot will handle the local roads when I get my delivery in September. There should be a lot of data from the other cars in the area so maybe they'll have all of these kinds of kinks ironed out already.
     
    • Like x 1
  3. calisnow

    calisnow Active Member

    Joined:
    Oct 11, 2014
    Messages:
    2,228
    Location:
    Los Angeles
    annnddddd - it was nice while it lasted. Car has gone back to diving into the curb at that spot. Still on 17.28.c628869
     
    • Funny x 2
    • Disagree x 1
  4. lunitiks

    lunitiks Memba

    Joined:
    Nov 19, 2016
    Messages:
    1,046
    Location:
    Norway
    I feel you. AP1 here. I've had a couple of "revelations" where I thought the car had finally learned. But no... I feel it's pretty random when the car acts allright and when it wants to kill me
     
    • Funny x 1

Share This Page