Follow the charter boats.
That's the last resort for sure. Having your day dictated by charter boats would be a drag. Those charter boat guys really hate that also. We were on one of our spots minding our own bussiness not knowing it was on the charter boat list. A charter boat shows up and the deck hands grabbed rods with just mooching weights rigged and would cast and try to hit us. We just stayed out of range and laughed.
The other thing is that the sea state has to be one exact way for you to match speed with them and that's a different speed for each different charter boat. If it's flat, sport fishing boats are at least twice as fast as charter boats, so I would hate to run out at half throttle. If it's really rough, sport boats can't keep up and out in the ocean a really big charter boat disappears.