No worries! As long as your baby is growing well, there isn't a problem. And the weight gain WILL come! I didn't gain much in the first 4 months but once I hit my 5th month, I started gaining like crazy.
Eat well, dont't diet, and everything will be fine.