Being Frugal vs Being Miser

Personally, I don't have irresponsible spending habits. But I feel that because of that I spend too little even if I can spend more. You can say I am a MISER. I want to change it for myself. I want to make myself a sensible spender, without having the guilt of over-spending. I mean, you understand that sweet spot. I want to hit that, but face a lot of difficulties. People who know me say, I am frugal and not a miser. And those who don't know or don't understand the thought behind this spending habit tell me I am a miser. Fellow Grapeviners. Can you help me with this out? P.S - My opinion is that since I was a single child of lower middle class parents who could not even afford school fees (took admission under EWS quota) to become a family who is financially strong. I feel extreme guilt, when I think of spending money and analysing the value vs money graph.