Yeah, I used to think that as well, at least for a little while. That he was a sneering, stuck up t*sser.
But that's an image he deliberately tries to cultivate as part of his stage persona. Or to put it another way, it's part of the act.
He even asked the directors to film him from below during the making of Comedy Vehicle, to give the impression of him peering down his nose at you.
Out of character though, i've never detected the merest hint of snobbery from him.