I did it one year (actually tried to ride as much as possible and drive as little as possible for a full calendar year, including the winter - I only put 1,000 miles on my car that year - I got a bike trailer for grocery shopping and everything) but haven't ridden nearly that much since because my health hasn't been so great. Hopefully I'll get through some of the stuff setting me back and do it again sometime.
Anyway, winter riding: if it's really cold you have to think about your clothes/gear. Base layer **not** cotton (you'll sweat on it and it'll hold the moisture, which becomes cold later, against your skin.) Better to wear something made of a wicking fabric for your inside layer. Then something fleece over that and then whatever you're doing for an outer jacket (think about blocking the wind for that, also maybe something reflective for visibility. Although you should also have good lights and reflectors if you need to ride on the roads at night.)
I clip in, so I got a pair of bike boots to go over my bike shoes, which kept my feet pretty warm, but I also wore warm socks. Some kind of helmet cover is a good idea too, if you've been wearing a helmet with lots of ventilation (brrr.) You don't have to buy commercial stuff - you could even use something like saran wrap from your kitchen, but you want to cover all the holes.
If it gets cold enough to need a ski-mask type thing, and you wear glasses, they can fog up easiy, but there are products you can apply to the lenses that keeps that from happening. One is called cat crap. Yeah, that's not a typo.
I wear winter bike pants, and jeans on top of that (sometimes for an extra layer, sometimes for decency if I'm running errands.) Serious winter bike gloves with a separate liner (good for getting keys out, locking up your bike, without stripping all the way down to fingers.)
We sometimes get icy stretches here, so I got myself a pair of studded tires for my beater hybrid. Those are **amazing**. I had a friend who lived way up in the woods: the road to his house was like a big windy dirt path that went up this uneven climb, and in the winter it was covered with this thick layer of ice. There is no way I could have riden on that using regular tires, but with the studs, I'd fly straight up it like it was nothing. They just grab the ice.
I thought it was lots of fun riding in the winter, even when it got cold. You really warm up pretty quickly, so it's not as bad as it looks. People sitting in their cars waiting for them to warm up might actually be colder, because they're not pumping their legs like cyclists are. If it was *very* cold, like around 0F, I would limit myself to very short trips. But in the teens and up, sometimes it was like a fantasy world, having the place to yourself - so many people just don't do it. There were even times when the roads were too difficult for cars to travel on, but I could get around easily on a bike (either with the hybrid with studded tires for ice, or if there was just a massive amount of snow, then I'd take my mountain bike.) Actually doing some mountain biking was a good way to build skills for biking after a big snow storm.
Anyway, I had a blast. I would encourage anyone to try if they have the inclination