Then have your software wiped and reloaded on your car at a service center (like a factory reset). Your situation is an aberration and only affecting a small group of people. Could be your specific model or the parts used on your model, or a software/setting corruption. Whatever the problem, there is a solution. If it's a hardware problem, then the service center can diagnose it. If it's a software problem, then a factory wipe and reload may help, or there is a bug with your specific hardware configuration which needs to be brought to Tesla's attention (either from you e-mailing them the exact details of your issue, or the service center sending notes) so they can analyze and fix in a future update.
Edit: A full factory wipe and reload the software on the car will likely kick you out of the FSD Beta - so you need to weight what's more important to you.