Can i ask what is your hubby working as? Maybe he is facing huge stress at work, that explains his behaviour bah. Well, if you think you can trust your maid to take of your 2 kids alone, then by all means return to the workforce. I personally think a woman must be financially independent.
As for the sex part, find a time when both are calm n relax and tok about it bah. I'm sure things can be worked out.