So, according to Model 3 Support | Tesla it should be possible to open the charge port door by tapping it without unlocking the car if you have your phone key close
- "Outside your car: press the bottom right-hand corner of the charge port door when your car is unlocked, or have an authenticated Phone Key nearby."