According to British newspaper The Mirror, Rowland - who originally axed Lily in the first live show - has hardly spent any time with her act in the final week, even though they are to duet together at the Wembley show.
Kelly, 30, flew to Germany on Tuesday to promote her album and during Amelia's homecoming visit to Middlesbrough the next day, she apparently spent only 10 minutes at the 17-year-old's family home before returning to her hotel.
A source said: 'Kelly couldn't hide the fact she didn't want to be in Middlesbrough and seemed to spend most of her time in a hotel. Amelia was out all day trying to drum up support while Kelly was nowhere to be seen. The feeling is she's not too fussed about what happens and doesn't really want Amelia to win.'
A show source added: 'Kelly seems to feel embarrassed about the situation.
'She dumped Amelia, so what would it say about her expert opinion if that girl goes on to win the whole competition? It would probably be easier for her if she doesn't win.'
But the former Destiny's Child star's spokesperson has defended her, saying: 'She is working outside of the show, but that is because she has got an album to promote.
'She is the only judge who has that. But she is completely committed to Amelia, is working hard with her, and wants her to win.'
The X Factor's final at London's Wembley Arena takes place this Saturday and Sunday.