Don't worry about it. With your draw length, your bow at 60lbs will be just as fast as my draw length at 70lbs. And I easily get passthroughs on elk with it.
Today's bows aren't as affected by backing off poundage like they used to be. The only effects would be draw length lengthening slightly, and MAYBE a tad more noise. Keep in mind though that you will have to retune, and possibly have to get new arrows in a different spine to keep it performing its best.