Very true. If you're just trying to jump from 5th fastest (P3D) to 4th (XP100D), that's a $42,700 jump. (Brand new on both, no FSD, since that has no bearing on performance).
The bargains in this thought exercise are the SP90D-L and SP85D-L. Cheapest 85 on ev-cpo.com right now is $48,400. But you'd be giving up things like AP hardware level, charging speed, and range.
Cheapest 90 is $57,800.
So yes, you can get some Teslas that are faster straight-line than a Model 3, but you have to be willing to sacrifice some things. It's a matter of what you value.
For me......I think the P3D is that "sweet spot" of range, tech, charging speed, and acceleration.