No, it's not the opposite at all. Misleading is misleading, lying is lying. Whether you are an aggrieved party because you bought FSD or not doesn't have any bearing on what Elon said being true or untrue. It simply determines if, and by how much, you are effected.
I didn't buy FSD, but that doesn't mean that Elon misleading isn't going to affect me in some way. How? Well, perhaps the share price is going to drop because he missed promises. And perhaps he devotes more resources (manpower dollars) to scramble to catch up to his promises. Does that mean they didn't open a service center because they didn't have enough money? Didn't make that change to the production line that would have made my car better? Didn't open that new supercharger near my house this year because they didn't have enough money to? Whatever, he still mislead. He still lied.
Yes, most of those things are very rare and very tangental. But the overall point is, you don't have to be affected in order for someone to have mislead.
So what's your claim? You want to sue Tesla for not making a product you wanted? I really don't think that's how things work in this country. But go ahead, if that makes them release FSD faster, I wholeheartedly support you!