I was thinking the same thing the other day, then I remembered how many Model Ss and Xs there are in the Apple and Google parking lots (there are a lot of them). Soon there will be even more Model 3s. So I wouldn't be surprised to find the reliability and responsiveness of the other side of the system being addressed in a future phone OS update.That's exactly the problem though. Those variables will always be changing, unless tesla starts making phones. Right now they only control one side of a two sided system. That will create problems for the lifespan of the system.
Until then, I'll continue to casually take out my phone and launch the Tesla app as I walk to my car and press the unlock button as I arrive, avoiding the humiliation of pulling on a locked door handle...