I'm not sure, but I would guess that you don't have something tweaked right. I've not had any trouble with my down keeping me warm as long as it's dialed in.

Other than that, I can't imagine what could be wrong.