From Gilroy to Tejon Ranch you're on Hwy 5, which is boring, ugly, and during holidays dangerous. If all you want to do is get to San Diego as quickly as possible then Hwy 5 is the ticket (assuming you're not doing this Thanksgiving weekend), but for an enjoyable road trip - the "mini-vacation" you want - you're going to want to get over to 101 if not Hwy 1.
Hwy 1 through Big Sur is a world-class drive, and absolutely worth doing if you've never done it before. Stop and eat at Nepenthe. Stop and walk under the highway to McWay Cove to see the only NA waterfall that dumps into the ocean. If you're doing the drive on Saturday and time it right, the tour of the Big Sur Lighthouse is also fun (and not touristy).
Heck, even 101 is better than 5. Atascadero or Santa Maria are way better places to stop than the Hwy 5 fast-food only rest-stops in the middle of nowhere. And, of course, there's Santa Barbara, which is a great town to find a good meal, a museum, or even just walk along the ocean.
Anyway, assuming you've got a full standard charge coming out of Fremont, it's about 100 miles to Gilroy. My advice is to top off (need at least 235 ideal miles in the battery), and take 156 to Hwy 1. Stop in Monterey for food. Unfortunately, at most a 30 amp J1772 charge. 17 mile drive is pretty nice, but no place to charge in Pebble Beach, unfortunately. Then take Hwy 1 down to Santa Maria and use one of the 70 amp J1772 chargers. The real prize place to stop is Santa Barbara, and at least one really nice hotel has charging facilities that will have you fully charged overnight. I recommend spending the evening and overnight in SB.
Then it's easier, from SB get on 101 to the Supercharger in LA, which gets you to San Diego.