It's not a fear of being alone either. I can poop alone, just not in a strange toilet. This is especially severe when I'm out of town. Or maybe I just notice more because I'm nowhere near a "safe" tiolet.
Other people aren't a factor at all. It's the bathroom. If it's public or unknown I just can't go.