I understand how you feel jmumi. I was in your position 3 yrs ago. However i chose to quit. As what you say, it will defeat your purpose...if your son is older that shld be fine if you convert to PT however now he's still a baby...they still need to be care of even at that hour. My hubby told him at that point.....money cant weigh everything compare to the growing period of our kids. Once we miss their first walk, first talk and all their first means we will miss it forever however for job...we can still look for one later.
Till today, I shld I've made the right choice of leaving my job to take care of my son. I've recorded down when he said his first word, crawl, walk, run etc. And I'm happy everyday to discover new things together with him.
You can find some home base job to do while you take care of him at the same time. Like me, I'm working home base and at the same time still able to take care of him.
Hope this will help you.