I used the Medela cooler bag to bring out my ebm. It's got an ice pack inside so it keeps the milk really cool. Then when you need to warm the milk, just put the bottle in a mug of hot water and wait for it to warm up.
I used to just keep the sterilised pump in a clean ziploc bag. At most i'd pump once when out.