I think it's a Bay Area effect. I live up the road from you in San Ramon and feel the same way. While we have about 5 Teslas on our block (including a Model 3), many still drive their "beaters" to work (including me - I still commute in my i3). I definitely feel an unspoken stigma about driving nicer cars to the workplace...can't quite explain it. My sister and brother-in-law in the North Bay have an MS and MX and were so worried about the workplace chatter the first time driving either to work, and they're both doctors.
That said, give it a few weeks/months, and you'll get over it and just enjoy the ride.
We were laughing the other day driving through San Ramon. It felt like every 4th car was a Tesla.