The 44-year-old former Oasis rocker, who is a self-confessed fan of the talent show, said that watching Gary brings to mind some of 007's greatest super foes.
He told Absolute Radio, 'Gary's sitting sideways a lot. Just like some James Bond baddie, isn't he? Where he kind of swivels round, 'Ah, yes, you're just not good enough'.
'Gary's all right, I've met him a few times, he's a good lad.'
But he was less flattering about Gary's fellow judge, X Factor veteran Louis Walsh.
'Louis Walsh, he's mad as a box of frogs, isn't he? He lives in a parallel universe,' Noel said.
'You think to yourself, 'Do you get British TV in Ireland? Oh, you do get it? You do know what's on the telly?' I mean, he's insane.'