Just take out the portion you intend to feed your baby from the freezer to the fridge the night before. It would be thawed by the time you need to reheat it. To heat it up, you can steam the puree.
You may wanna read this for more information:
Heating and Thawing Homemade Baby Food Purees - How to Heat and Thaw Homemade Baby Food