insulate your windows by cutting pieces of bubble wrap to fit the window and spraying the inside of the window with a little water. Apply the bubble wrap with the bubble side on the glass, it will cling to the glass for weeks and comes off easily.
Source: AARP Bulletin
P.S. For those who reside where winters are longer this might not be that cost-effective.