I sometimes wear a life jacket when fishing the local river mouths (not so often nowadays because its waist deep for 90m out), but have never seen anyone else taken similar precautions even when it was running deep and fast. It still amazes me how many people do not wear any flotation when whitebaiting at the mouth.
I do not wear it when rock fishing in the Sounds, because most of the time it is mill pond flat.