I never found Anomen that annoying, and I included him in my party on virtually every run through the game. He's just too useful to leave behind. And as for his personality, I don't dislike that too much either. He's just written so well, IMO. His arrogance is clearly only a defence mechanism of his to silence his own insecurity and fears.
And I loved Jan's story about Ano the Dung Orc
