I can emphatically say that my Teslas (Model S and X) are easily the least reliable cars I have ever owned, and by a long shot. If the contention is that people complaining about build quality and reliability are overly critical than in my individual case that would also apply to the cars I have owned in the past 5 years (Audi R8, Porsche Panamera 4S, Corvette Z06/Z07, Volvo V60 CC, BMW 3 series to name a few). All cars have minor delivery issues, but in the 3+ months I have owned my Teslas they have individually both been out of service for almost 15% of the days I have owned them and as I post this today they will actually both be at the Service Center as after getting my X back from service last week, it had Parking Brake and Steering warnings when my wife drove it Sunday and Tesla has had my S trying to fix some minor issues for almost a week now.
It is everything from small issues, like Slacker radio still not working properly after over a month of issues that I was told Tesla knows about, to issues with Wifi on all Teslas that took me getting a network engineer involved to find what was causing it (Tesla Wifi stack is designed poorly and restarts when it encounters certain network traffic), to bigger issues like the air suspension failing on my Model S and twice now my Model X having system failures that made it un-driveable.
You are correct there are people complaining about many individual cars and all brands have issues, but in my individual experience Tesla has more than others.
As an aside, if people feel Tesla has high build quality just post pictures of your door trim alignment on both sides of the car. I am willing to bet it is not aligned. You can say this doesn't matter, but it is an indicator of build quality for many people just like rattles and creaks.