At some point you just need to remember things man. What happens when you forgot your key fob to your Prius? Geez.
See, that's the thing: If I forgot the key fob for the Prius I'd walk out to the garage, be unable to start the car, and have to walk back into the house and get the fob. It's not possible to start the car without the fob, and if you have the fob the car always unlocks. (And starts if it does not break down, which mine never did in the 15 years I owned it.)
The problem with the Tesla is that you can start the car with the phone most of the time but then once in a while it doesn't work, and then you need the key card, which you forgot because you almost never need it. (Though hopefully that card holder that N5329K recommended will solve the problem for me, because then I'll always have the key card if I have my phone.)
And when you get to be my age you'll realize how glib "you just need to remember things" sounds.