You can pull it off from the bottom using an allen key or equivalent hooked tool, if you're got nothing else handy. You tuck it under the bottom of the trim piece and pull - with more force than you think you should need, or feels safe.
I have no idea why the trim clips on that piece are so substantial, but whatever the reason it makes it very hard (in my opinion) to remove.
Once removed you will have a choice.. if you need to remove the console you will need to disconnect the CANBUS connector at the back of the console. Depending on the year of your car it'll either be white or blue. I would strongly recommend powering down the car (the "Power Off" option on the screen), leaving the drivers door ajar and waiting until you hear the "clunk" of the high voltage contactors. At this point the car is asleep.
if you want to be extra cautious then you should disconnect both the HV and LV batteries. I've never bothered to do this though, on the couple of occasions I've disconnected the CANBUS, because I watched a video where a guy didn't and there was no issues plugging it back in. Obviously whether you risk that is your choice
Unfortunately based on where it sounds like you've dropped the fob part - I don't think you'd be able to get to it without going through the motions as if you were going to remove the console, and then sortof levering it up. It is a tight fit against the seats so will probably stay wedged between them if you lift it high enough.
There is also a mini USB cable on the drivers side, about halfway down. This is also a massive pain to remove in my experience - you need to hold the connector (which is on a sortof flexible attachment) whilst pulling the cable out.
