I've had this same problem off and on for the past two months. Doesn't matter the length of the drive or temperature - once it happened when I backed the car out of the garage to move something then put the car back in the garage. (it had been in the garage all night) It was 75 degrees out that day... slightly cooler in the garage.
Opening and closing a car door turns the "loud fan" noise off, every time. And it only does it at home, not anywhere else.
I figure a software update will eventually come along and fix it.
We've had the same experience (all around).