how close to the property line is too close?

well opening morn I hit the same place I hunt every year. it is a pretty decent percentage spot thanks to the neighboring land owners managing it for habitat. I know the land owners pretty well, but do not hunt with them....once was enough. Today they drive up to my pard woh is a strong 500 yds from the prop line and start ripping his ass talking about jumping him and all the silliest crap you can think of. ironically they were not on there own property, but felt they had the right to guard it from the public land side.....nice. I wish I had been there, I had my camcorder on me and I surely would have taped it (and me feeding mouth his teeth) and called the law for harrasing a sportsman. I imagine it would be enough to have their master hunter cards pulled.
I am fed up to the point that I might haul dave workman up to the area that I have killed most of my elk just keep the area pounded.
I am fed up with slobs. it sure was nice to be on a mule deer hunt where the only other guy I saw was my pard....this is rediculous.
I can't imagine waiting all year to go yell at people that get close to your property. if you are that guy, you sir are an *censored*.