For me, it depends on the temps. If it is consistently below freezing, I go down - always. I have been in them sine the 90s and they keep me warm and I don't really baby them or loose sleep. I also haven't had any problems with condensation or moisture at all.
I have had tons of problems with synthetic loosing loft - all the time. Leave it compressed, leave it in a hot car, run it a few years, it all degrades them pretty quickly for what I paid.
I have a giant Marmot bag from about 97ish with a gore tex shell that hasn't lost much, if any loft. In a bivy sack, it is good to -20 in the Bridgers and I use it all the way up to +20 although I do want a second bag for lighter weight and packability.
With the quality of bags, down, backpacks and tents, stuff just doesn't get all that wet. When I was camping in a surplus Korean war tent with no floor in Boy Scouts, it was a different story.