Annoying only to the contestants.
If you hear some (most actually) of them sing, you will come to understand why.
He's British to boot. They have like a culture of razorsharp wit and metaphorical insults. Seeing him in action is a joy to an Eng. Lit. student like me.