Welcome to Tesla Motors Club
Discuss Tesla's Model S, Model 3, Model X, Model Y, Cybertruck, Roadster and More.
Register

MuZero and the autonomous driving game

Bet TSLA

Active Member
Dec 8, 2014
2,829
10,376
Cupertino, CA
DeepMind's paper on MuZero is out in Nature. Here's their blog post:
MuZero: Mastering Go, chess, shogi and Atari without rules

For many years, researchers have sought methods that can both learn a model that explains their environment, and can then use that model to plan the best course of action.

So does this portend a future without traffic laws? If we move to a world where the notion of rules of the road disappears, and all that's left is goal oriented behavior, then this paper shows that we already have some idea how to deal with that.

If we have autonomous transportation software that can figure out the local conventions and preferences from scratch, then it can happily pilot pedestrians, bicycles, cars, trucks, delivery vans, tuk-tuks, etc. Why would rules be needed?
 

powertoold

Active Member
Oct 10, 2014
2,173
3,981
USA
Seems like MuZero is a master at perfect information environments.

Self-driving in the real world is a totally different problem. Not only is it an imperfect information environment, the environment can be arbitrary (like a chair falls off a truck).

Some people like George Hotz thinks we'll eventually have an end-to-end machine learning solution for self-driving, but I have trouble seeing how that can happen (unless we've already achieved general intelligence). Then again, I'm not a machine learning specialist.
 

jboy210

Supporting Member
Dec 2, 2016
4,974
3,049
Northern California
Interesting question. Machine Learning models can be trained from experience and have an exploration component that tries new things that most of DeepMind's Reinforcement Learning models do. The issue is what happens when the rules or conventions change. Since ML models are experience-based, if they can train it with enough data it can adapt to changes in the same way we humans can.
 

About Us

Formed in 2006, Tesla Motors Club (TMC) was the first independent online Tesla community. Today it remains the largest and most dynamic community of Tesla enthusiasts. Learn more.

Do you value your experience at TMC? Consider becoming a Supporting Member of Tesla Motors Club. As a thank you for your contribution, you'll get nearly no ads in the Community and Groups sections. Additional perks are available depending on the level of contribution. Please visit the Account Upgrades page for more details.


SUPPORT TMC
Top