On the MS/X, the contactors are closer to the rear; on the RAV4 EV, they're in the front in the battery pack, and as a driver you're basically sitting on top of them, so the noise is pretty clear.
In my case, I'm not certain that my noise was the contactors, but I haven't heard it again after...