Talking to a friend yesterday she told me the price of fuel oil today is $5.69/gallon. Makes you wonder about alternatives.
In the past, electric resistance heating was always the most expensive but at that oil price and reasonable electric prices, they are very close.
If you want to do some comparisons, this is a simple to use calculator.