It does not serve you or others to lose it. What’s important is not whether you are justified or unjustified in losing it. As a manager, you face more than enough situations where you have every reason to lose it. What’s important is that losing it has consequences. It can harm your reputation, hurt others, set back your progress on projects, or worse.
When you’ve had it, get away before you lose it, so you can gain perspective on the situation. Sometimes, it is good to get away fast.