If you know you are done having kids what is the hang up about having a vasectomy?

I had a vasectomy six months ago. My wife and I talked we were done with having kids (biologically anyway) The next day I made an appoint for a consult and had it done. I know most men freak at the thought of one. Why? It is done out patient you are home that day. You are awake and honestly it was more painful to have my wisdom teeth pulled. It is safer to have it done than a woman to have her tubes tied. And if you have like two or three kids and don't want any more what is the problem. I am looking for men's honest fears on why they would never have it done and I am trying to dispel them. You still have semen no sperm. You still get your regular s and you are no less a man because of it. If you feel like you will be less of a man WHY?