Often during that stage of the competition, the panellists take the acts in their charge to sunny or exotic locations and there had been plans for Gary coming to Majorca for the latest series.
But he is now thought to be looking at remaining in this country with his acts for the next phase of the series, which begins on ITV1 tomorrow.
Baby Poppy was delivered stillborn just under a fortnight ago when Gary's wife Dawn, a former dancer, was eight months pregnant.
Last year the Take That star was located at a home in Los Angeles, where he was accompanied by band mate Robbie Williams.
But a show source said Gary doesn't want to go too far, understandably.
During the judges' houses section of the programme Gary and his fellow panellists Louis Walsh, Tulisa Contostavlos and Nicole Scherzinger get to know their acts better, put them through their paces and then whittle down their number to decide who makes it to the live stages.
Not only was Robbie Williams expected to be joining him again this series but Andrew Lloyd Webber said after the Jubilee concert, which Barlow organised and composed the special official Jubilee song Sing with Webber, that the two would be working again over the summer on the island.
Webber has a number of houses in and around Deya and is currently here in Majorca working with former Spice Girl Melanie C who will play Mary Magdelene in the forthcoming Jesus Christ Superstar stadium tour of the UK which starts next month at the O2 in London.