The 56-year-old Frasier star – who divorced Camille after meeting his new wife, air hostess Kayte Walsh - has asked the courts to grant him full-time care of daughter Mason, nine, and son Jude, six. This means that they will live with him at all times, except for half of the summer, and half of the winter school holidays.
But Camille's publicist has insisted that he will have a fight on his hands because the children are happy and settled living with her in Los Angeles.
'The children are at home with Camille where they want to be,' Howard Bragman told PopEater. 'If Kelsey thinks they will be joining him any time soon he needs to think again.'
And he accused Kelsey of seeking revenge on Camille for not granting him a 'quicky' divorce when he first asked for one.
'He is angry that she didn't walk away from the marriage without a fight,' Bragman explained. 'Kelsey is used to getting what he wants, when he wants it.
'After years of being in his shadow Camille has had enough. When it comes to her children she will fight for what's best for them.'