Increase the weight,decrease the distance. Its up to you really.The braid will cut a lot of weed for you and it usually tests heavier than stated. I use 6 or 8lb most of the time and find it ideal. If you dont use bright coloured line give that a try next fill. It will buy you a few extra fish just because you can see whats happening.
I have had barracouta and kahawai off the wall at NIWA too pretty flat bottom but fish are passing there all the time.