MY 3 piece military bag doesn't keep me warm at about 30 degrees??

it has two bags and a gortex bive cover, should I ditch the bags asn get something with down?

PS sleeping in my skivvies..