A few thoughts for OP (congrats on the new Model X BTW!), from a Bay Area Model S owner:
1. You're concerned about waiting for an hour somewhere to charge at a Supercharger. Remember that unlike an ICE car you probably won't be "filling the tank" to full all the time you charge. Just charge enough to get you to your next charging stop, or to get you home if you're on your last leg. (Charging is slower the more full your battery is.) Yes this requires a little bit of advance planning, but not a lot for the destinations you named.
2. You might be able to go out and back without charging for some of these trips...have you planned them out with one of the trip planning Web sites or apps? (I'm assuming you can start your trips with a full battery.)
3. I bought a CHAdeMO adapter shortly after I got my car 2.5 years ago. I've used it twice (admittedly I really really really needed it those two times, because I was going to a part of California where, at the time, there were no Superchargers). I still bring it (plus my J1772 adapter) if I'm leaving the Bay Area, but Supercharging has sufficed for all the places I've been. I carry EVgo and ChargePoint cards in the car.
4. Remember that not all charging locations are equal. In addition to the energy delivery differences mentioned upthread, a lot of EVgo and ChargePoint installations have somewhere between 1-4 charging stalls...the EVgo and ChargePoint stalls closest to my house seem to be permanently filled with short-range EVs. I think the smallest Bay Area Supercharger has 8 stalls and most have more.
In my experience, if you're going to be within day trip range of the Bay Area, you can rely on the Supercharger network, with your J1772 adapter as a backup.
This might be worth a read...it was written for the Model S (before the Model X existed) but a lot of is applicable to the Model X (and Model 3 for that matter):
The Rules of Model S Road Tripping
Bruce.