The shakiness settles down after a while. Its most apparent after I've hiked to the top of a hill and my heart rate is still up. Since I glass for hours on end I am usually able to control it to manageable level and appreciate 10x over 8x. I don't wish I had 8x32. Particularly since I hunt open country. I would make magnification based on the country you hunt the deciding factor and the objective mm a secondary.
Yes, the 32mm loses out on some light gathering. Ceteris paribus an expensive pair of 8x30s or 10x32s or whatever is going to be brighter and sharper than a cheaper pair of the same size and magnification, but its tough for a 10x32 to beat a 10x50. its simply a function of physics.. Paying high end gets you good quality glass, coatings, mechanics, armor, asthetics, and warranty. It doesn't make you immune to physics. Just like blowing on glass on a cold rainy day. its going to fog on the outside no matter how much you spent. I've held up some $300 crappy 10x50s and they were brighter than my 10x32s at dusk which is to be expected.