I would suggest, (seeing as there is obviously no wind under the water for the fish to feel) that it is a current related phenomenon. When the currents move in a certain direction, the fish for whatever reason go off/on the feed. Or move into or out of the area completely. Certain wind directions, especially over a prolonged period, could cause the currents that are putting the fish off, or causing them to move out of, a certain area. As Naki says, the rule would be different on different areas of coastline. The trick I guess, is to do enough fishing in your area as to be able to tell from your catches, which wind (current) direction works best.