Factory loads or your reloads? Guns can Def have a sweet spot or grain range they like. Picture attached is from my bolt action 308.
Two "groups" both shot aiming at bullseye from 100yrds off bipod and rear bag. I was shooting the 180grn to verify zero and warm up barrel prior to shooting a load ladder.
The shots all over the place are 180grn factory loads, I had similar though smaller groups with 150grn factory ammo I tried (4 different factory loads).
The pair just below bullseye are 165grn Sierra game kings. The final 3 of that group were on my load development target and were sub moa.
That said I had to do similar with a Bear Creek AR barrel. It was 6moa, they replaced it and the new one is ~1.5moa with my basic plinking rounds.