Yes, lots of people on any weekend, and plenty during the week too. I think you need a permit for all camping before October 15th and the permits are not easy to get. You'll likely need to apply in the spring to get the good weeks.
If you want to go to that area and avoid the crowds, try hiking in through the Rat Creek drainage. Last time I checked there wasn't a formal trail, but rock climbers go up there occasionally (rarely). Its not a trivial hike, but you'll be alone.