I have the same problem. Very intermittent for no apparent reason. It hardly ever works for my wife so that is a very big problem. Since I paid up front for FSD just to get this feature I am more than a little bit annoyed.
For a 'connected car' this seems like it should be a simple problem to...