What's the hardest part of being a founder?

Not funding, not hiring, not even product - I feel every founder I meet has a totally different answer to this.

For you, what’s been the hardest part?

1. Getting first users?

2. Building the right team?

3. Staying sane through the ups and downs?

Would love to hear the most real challenges you’ve faced.