Nicole Scherzinger apparently feels "backed into a corner" by her boyfriend Lewis Hamilton.
The former Pussycat Dolls singer is dating the British Formula One racing driver, with both adjusting their busy schedules to make time for one another.
Last year Nicole served on The X Factor UK judging panel and her beau has apparently urged her not to return, fearing it could put their relationship to the test.
The pretty brunette is apparently annoyed Lewis has put her in such an awkward position.
"Nicole doesn't want to be backed into a corner and forced to make a career decision based on her personal life," a source told British magazine Star.
"She's still negotiating with producers over her return. Money is important to Nicole, so she wants the deal to be perfect - and she really doesn't appreciate Lewis giving her an ultimatum."
Nicole is currently promoting her new music while Lewis has racing obligations all over the world.
Should she return to The X Factor, she will be busy mentoring her acts and Lewis fears it will leave no time for him.
"Their busy schedules are conflicting at the best of times, but last year he felt that he barely got to see Nicole while she was on the show," the insider explained.
"Lewis has told Nicole that he'd really like her to put their relationship first. He really wants her to focus on music and spend more time with him - and not get caught up in all the drama that comes with appearing on X Factor. He's told Nicole it's best to quit while she's ahead and move on from the show."
Last year Nicole triumphed with her contestant James Arthur.
Should she return, she would be joining Louis Walsh and Gary Barlow on the panel as well as rumoured judge Sharon Osbourne.