If this was a one time occurrence, it'd be easy to say - Tesla missed something - and they'll fix it - and the next release will be "silky smooth".
However, this has been happening with releases for 5 years.
When development is completed on a release, Tesla should be doing some internal testing.
Then they are likely sending it to their small group of hand-picked beta testers to bang on it.
And when they think it's OK, they start dribbling it out to cars in a seemingly random order.
And when they (inevitably) find a serious problem in the release, they suspend the release process and start over.
And they've been doing this for 5 years - and we still see obvious (and sometimes serious) problems slip through their testing and get into the "official" release.
What's sad, is that it is possible to do much better - without sacrificing quick time-to-market.
Two simple changes could help considerably:
- Allow owners to opt in or opt out of participating in Tesla's beta testing. With an increasing number of configurations, language, and owner expertise, allowing more eyeballs on the new software, while it is still in testing, may not guarantee better released code, but at least should increase the probability that most of these obvious problems would be detected before release.
- Add a "rollback" software option. While it's impractical to test rolling back to any arbitrary release, Tesla could support rolling back to a the most recent "stable" release - which is something that they should be able to test easily internally - and have beta testers verify as part of their commitment to participate in the beta testing program. With this ability - if a major bug did get into the released code - we wouldn't have to wait for Tesla to distribute a bug fix release, owners could rollback to a stable version, and continue using that until Tesla has a new update to install.
Additional changes that would be very useful:
- Provide release notes on the console display BEFORE an update is installed.
- Include in the release notes more details on what has changed, along with the major known bugs that haven't yet been addressed or aspects of the software that are not yet verified to be fully operational (which would be very useful for those trying to use AP2 - and having to guess after each release as to what is or isn't supposed to be working!).
- When every new release is available, provide an announcement to owners via e-mail about availability of the release and also a link to the release notes.
- And, provide owners the ability to determine if a release is available - and initiate it themselves or defer installation, without having to rely on the seemingly random distribution process Tesla has been using.
If Tesla really does sell 500,000 Model 3s per year - do we really think the software release strategy Tesla has been using is going to be acceptable, especially as Tesla moves beyond the more forgiving early adopters...