Thought I would give an update - we tried another day later in the trip, similar location, similar depth, and ended up with 2 in 2 pots. Nothing worth keeping, but if I return and have a boat (we could only swim and set) I would scout out some better locations and give it another whirl.