Fleece would certainly be comfy, but could be a bit bulky. And unless you keep the thermostat way down, it could get awfully hot. I keep a few fleece blankets on the couch for the chilly nights, and sometimes they are just too much. Early this spring on a chilly morning I wrapped a flannel sheet around myself and after about 5 minutes decided that by fall I might need to make myself a great kilt out of one just for around the house. Sort of a kilted "snuggie". When it gets real cold, pull the rest of it up around the shoulders. I love flannel in winter.

I also have one of those terry cloth bath wraps. Elastic waistband, velcro closure and a large pocket on the front "apron". Had it for about 15 years and love it. I've gained and lost upwards of 40 pounds since I had it and it always fit like a glove because of the elastic. (something to keep in mind maybe). Around the house I wear either that or my acrylic kilt almost every night.