I sounds like you may be overly insulated and getting condensation buildup in your clothing or insulation. If there's moisture in either that is touching your skin, that can lead to a hypothermic action that cools the body, and that moisture can also inhibit the insulating ability of your clothing or quilts. It's always important to remember that insulation is never adding heat, only reducing the heat that is taken away, and moisture on your skin or in your materials will affect the ability of those materials to retain the heat that your body produces.