TMC is an independent, primarily volunteer organization that relies on ad revenue to cover its operating costs. Please consider whitelisting TMC on your ad blocker and becoming a Supporting Member. For more info: Support TMC
  1. TMC is currently READ ONLY.
    Click here for more info.

MuZero and the autonomous driving game

Discussion in 'Autopilot & Autonomous/FSD' started by Bet TSLA, Dec 23, 2020.

  1. Bet TSLA

    Bet TSLA Active Member

    Joined:
    Dec 8, 2014
    Messages:
    2,799
    Location:
    Cupertino, CA
    DeepMind's paper on MuZero is out in Nature. Here's their blog post:
    MuZero: Mastering Go, chess, shogi and Atari without rules

    For many years, researchers have sought methods that can both learn a model that explains their environment, and can then use that model to plan the best course of action.

    So does this portend a future without traffic laws? If we move to a world where the notion of rules of the road disappears, and all that's left is goal oriented behavior, then this paper shows that we already have some idea how to deal with that.

    If we have autonomous transportation software that can figure out the local conventions and preferences from scratch, then it can happily pilot pedestrians, bicycles, cars, trucks, delivery vans, tuk-tuks, etc. Why would rules be needed?
     
  2. powertoold

    powertoold Active Member

    Joined:
    Oct 10, 2014
    Messages:
    1,901
    Location:
    USA
    Seems like MuZero is a master at perfect information environments.

    Self-driving in the real world is a totally different problem. Not only is it an imperfect information environment, the environment can be arbitrary (like a chair falls off a truck).

    Some people like George Hotz thinks we'll eventually have an end-to-end machine learning solution for self-driving, but I have trouble seeing how that can happen (unless we've already achieved general intelligence). Then again, I'm not a machine learning specialist.
     
  3. jboy210

    jboy210 Supporting Member

    Joined:
    Dec 2, 2016
    Messages:
    4,603
    Location:
    Northern California
    Interesting question. Machine Learning models can be trained from experience and have an exploration component that tries new things that most of DeepMind's Reinforcement Learning models do. The issue is what happens when the rules or conventions change. Since ML models are experience-based, if they can train it with enough data it can adapt to changes in the same way we humans can.
     

Share This Page

  • About Us

    Formed in 2006, Tesla Motors Club (TMC) was the first independent online Tesla community. Today it remains the largest and most dynamic community of Tesla enthusiasts. Learn more.
  • Do you value your experience at TMC? Consider becoming a Supporting Member of Tesla Motors Club. As a thank you for your contribution, you'll get nearly no ads in the Community and Groups sections. Additional perks are available depending on the level of contribution. Please visit the Account Upgrades page for more details.


    SUPPORT TMC