He gave the thumbs up as he was pictured returning home after his horror fall
The music mogul, 58, returned from hospital in grey jogging bottoms, a black jumper and matching trainers and put on a brave face for the cameras, despite suffering from concussion.
His dramatic fall has left him unwell enough for the first live show - but he is expected to return to the show on Sunday.
The music mogul’s absence means Louis Walsh and Sharon Osbourne’s categories, the boys and girls respectively, featured in Saturday's show, having originally been planned for Sunday.
Simon and Nicole’s groups, including Sean and Conor Price, The Cutkelvins and Rak-Su, and Overs will instead be the last to perform this weekend.
And bosses have decided to stick with just the three judges on Saturday, rather than draft in a replacement.
A source close to Simon said: “There were some rumours that Cheryl was going to step in for Simon but this isn’t going to be the case.
“Simon is expected to be fine for Sunday’s show, but right now he needs as much rest as possible – every one knows he’s a workaholic and no one can stop him from returning.
“They’ll switch the singers which means they’ll be panic for some contestants but everyone totally understands.”
Simon was rushed to hospital this morning after an accident at his London home, the Sun’s Bizarre has revealed.
The X Factor mogul was stretchered out of his mansion in a neck brace after an ambulance was called at 8am this morning and underwent tests.
The 58-year-old is believed to have fainted and fallen down the stairs after fetching a cup of hot milk at 6.45am
We can now reveal Simon was alone in his mansion with three-year-old son Eric and a security guard when the accident took place.
Lauren was in New York with her son Adam, who is 11, while Simon was staying in London to look after their three-year-old toddler Eric.
She is rushing back having caught the first flight back to the UK.
Simon is now resting up at home and waiting for Lauren to arrive back in the UK.