In my limited experience and in general, it seems like there is better whitetail quality than mule deer quality. However, MT is a HUGE state so it all depends on where you're at. Mule deer for the win personally.
Ive seen some nice whitetail in the river bottom country in eastern and central MT, I've not hunted much on the western side of the state but its got a good reputation for whitetail.