I have a same issue on my M3 driver side of rear door. I was searching for the reason and finally found it. It's sunken issues wasn't related with handle assembly part. Actually, the door handel was was attached on the another inner panel, and reveal the chrome parts through the outer panel hole...