i don't know how many other ways we can word it, but yes. whatever access you have to your car with your key card, they will also have in order to do the work.
if you're this paranoid about it I suppose you could unsync your contacts, clear your browser history, and remove your home location...