I also clean between every shot - like, really clean.
I have noticed that a clean bore will pile them into a tight cluster at 100 yards. If I shoot a fouled bore, it will also shoot an equally tight cluster, but the point of impact will shift 3" or so.
I decided that I like hunting with a clean bore so I stick with the cleaning routine between each shot.