The good old 17 Remington is FAST, and if you reload up a bit, it's REALLY FAST! Wind drift is a function of many things, and "time exposure to wind" is one very important one. I will have to chrono both my 17 Rem, and my 204 loads, and then do some math, but I think the drift will be very similiar, (or the 17 Rem may have the edge) at least the effective range of both bullets. My 17 is the best thing I've ever shot coyotes with out to 150 yards. After that I would take the 204, even though I have yet to kill anything with it. I will say one thing about the 17 Remington vs. the 17 Fireball; for what it's worth, the Fireball produces a LOT less barrel heat.
Are you shooting ground squirrel/prairie dog type varmints or predator type varmints?