Just got back a few weeks ago-Check out my elk in the elk section.
Great trip, but Idaho is VAST. 2-3 days may not be enough. Just getting to the wilderness is about 9 miles from any maintained road. (hunting is still open in the nez perce natl forest on your way to the wilderness) Also, the Frank Church and Gospel Hump make up the largest wilderness complex in the lower 48, so I'm sure there are areas that are better than others.
I pulled a deer tag just in case, but I was mostly there for elk. Saw a few whitetails, nothing bigger than a little 3x3. It was 'any deer' where we were, so you could have shot a doe. There are some muleys on the breaks of the Salmon, big ones, I would have gone after them if I had more time. Just remember, 9 miles is a long way with 1/2 a deer on your back.