I think we've all worked long hours, and under less than ideal situations, at one time or another during our lives. And most of us didn't become millionaires in the process.
I think what most people have a hard time visualizing (along with exponential growth), is that a moment in time is not forever. If you look at what the lifestyle of doctor residency is, or first or second year wall street bankers, you'll find it's common to literally work almost every waking second. That doesn't mean that's the way it'll be for their whole life...