I would think so... The heat will be trapped as wood is not much of a heat conductor... Also, heat loss is always higher if there are air movements. Also, if the wooden panes are not thick enough, they might warp... To facilitate heat exchange, why not have some grooves built in? Your chiller would also appreciate some grooves in its compartment...
Bookmarks