This statement somewhat confuses me ("plugged in the tesla wall charger"). While there was a time when tesla sold wall chargers with pigtails, that has been a while ago. Did you actually mean you plugged in a wall charger, or you plugged in a mobile connector? If its "plugged in a wall charger" how did the wall charger get the pigtail on it to be plugged in (did you buy it that way from tesla, or did you convert it yourself)?
I wouldnt charge at home on that circuit AT ALL until you have an electrician look at it, regardless of what your builder says. People normalize electricity, but its dangerous, and your panel tripping all those breakers is telling you you need to do something before you burn your home down. Additionally, since you mentioned you have your charger set to charge at night, you are not only risking a fire, but risking a fire while you presumably are sleeping.