I suggest trying to possibly rig that bag as an underquilt. In my limited experience, and from what I've read on HF it seems under insulation is the most important.

FWIW in my limited experience...