@joillian Close your curtains before it gets dark to retain the heat.
I know it feels odd to shut out the daylight but it's easier to maintain heat than to warm the room.
On the same topic, you can use closed curtains during the summer to block heat coming into the house.