The 34-year-old Welshman is hosting the US talent show and Cowell, 51, has previously said he's the only host that is taller and better looking than he is.
Speaking to UK newspaper The Sun, Jones said: 'I'll take that from him. He's a good-looking guy itself. He's cruelly handsome - like a Disney baddie.'
Jones added that he has been bonding with one of the other judges Nicole Scherzinger but said Cowell hasn't been joining in with the work nights out.
He said: 'Me and Scherzinger have hit it off big time. We became very close very quickly. We hit the karaoke like my life depended on it in Miami and did a rendition of Queen's Bohemian Rhapsody.
'Simon is difficult to get out. He's like a bloody hermit. He stays in his penthouse in whichever city we are filming just hatching plans.'