Reality of taking a career break? Especially if you are a man where you can't easily hide under emotional duress?

Have any of you taken a career break and got back to work? Did you see any loss? Discrimination? Difficulty? Is it right decision to take a career break? I have no problem with savings I have it plenty. Am just worried about losing everything if there is a gap in my work timeline and if that will impact me from being hired again from say top firms or wherever? Please help.