I'm on some meds that stop symptoms of panic attacks at the moment but they'll step up now that i'v spoken to a specialist in mental health care.
I set myself a few goals that have helped in small ways, the first thing is to talk to someone about it who you regularly talk to (It REALLY helps) secondly instead of saying you CAN'T go tell yourself instead that you find it difficult to go in this situation. I dunno if this will help at all but it makes sense to flush out defeatist attitudes.
If you need someone to talk to i can lend an ear, email given.
All the best