BT is blocked by water and we’re mostly water so it’s possible your body is blocking it just a little.
I carry my phone in my left front pocket and get that message every so often. I’m not sure if the antenna is in the center of the car or if it’s still trying to connect to the one in the right hand mirror (where will they put the antennas if they get approval to remove side mirrors?) but, either way, as soon as I lift the pocket with the phone away from my leg, it lets me drive.
Try putting the phone on the charge pad every time you drive and see if that changes the pattern. If so, try carrying it in a pocket closer to the antenna.
If all of that fails, it’s possible that your phone’s BT antenna has a hairline crack or some other issue that can be fixed/replaced. Or, if it’s happening with multiple phones, it’s possible the car’s BT antenna is the problem.
As for the keycard, yes, you have time after opening the door so there’s really no need to place the keycard on the center console and risk losing/forgetting it.