from what i keep hearing over & over from far more experienced hikers than i, fleece is just not going to match the weight to warmth ratio of a puffy (down or synthetic) insulation, even though it doesn't compress & loose insulation value like the puffy stuff.
but it does feel nice<g>.