Nope not one bit and I've taken to only having the fob on me quite often these days. There has been the rare occasion that there has been an ever so slight delay after I've pulled the handle, but thats it.
Perhaps try removing the fob and re-enrolling it to the car. Shouldn't fix it but you never know.
Also have you tried rebooting the car lately? Lots of these little gremlins can be fixed with a reboot I've found.
Initially the phone entry worked great no matter where in my pocket the phone was. I now find I have to take my phone out of my pocket before I push the handle. It's been like this for the last 3 or 4 weeks.