Is your wife taking care of the baby full-time? Have you ever talked to your wife about how she is reacting? If she is the full time care giver to your child without any other form of help at home, it can be really stressful and tiring and even more so if your wife is a clean freak.
During my maternity leave, I was at home with my son 24 hours. Weekends I also just want my hubby to be at home. It was a very stressful season for me and I also lose my temper alot at my hubby, not because he is not doing enough but beacuse I really feel very tired and very stressed from the lack of social interaction for myself as well.
I think you should try to talk to your wife about her feelings and see what the root of the problem is then try to resolve it.