Ludicrous is nice, but in reality you'll find you won't use it too often. There's a "process" to engage it, so it's not as if it's always on and ready to use. At the end of the day nobody can really make the decision for you, but I'd suggest going to drive a Performance Model 3 if you like the speeds. That said, if ride comfort is a major concern, the Model S Raven will have this in SPADES by comparison to the 3. The 3 is a firm ride no matter what trim you buy, and even more so shod in full Performance 20s.
Go drive both - bring a bunch of kiddie crap with you, too, so you can test trunk space etc etc. That's the only way you'll ever know for sure.