Some men just cannot handle babies. My friend's husband wasn't good with babies but now when they are bigger, he goes out with them very often.
If he treats you well, take that as a blessing and remember to appreciate him. I'm sure he will be more hands on when they are bigger.
Or if not, then you are still better than off than many many other ladies whose husband dont't even provide for the wife and dont't bring them out at all.