The Love Island star already impressed viewers by jumping out of a helicopter on Sunday night with fellow contestant DJ Chris Moyles.
The viewers voted the reality star alongside singer Boy George to be the shows V.I.Ps which later was revealed to mean "very isolated people".
A spokesperson for the show has revealed that Olivia was removed from the jungle on medical grounds and it was not safe for her to return.
The reality star underwent some medical checks before a spokesperson told the BBC today: "Unfortunately, the medical team has advised it is not safe for Olivia to return to camp as there needs to be further investigation."
However, it had been made clear she will be sorely missed and that she has been "brillaint" so far.
Before skydiving 10,000 feet Olivia described it as a "once in a lifetime opportunity" and joked that she hoped she'd land safely with "both boobs, all the veneers, everything" all in tact.
After landing safely Olivia described it as being "the most amazing thing I've ever done".
After the announcement of her leaving Olivia said she is "heartbroken" to be going on medical terms.
A post on her Instagram said: "She dreamed of doing I'm a Celeb for years... however for reason beyond her control her journey has been cut short."
"You will hear the truth from Olivia in due course and she will be back on your screens in the New Year."
The rest of the V.I.Ps spent the night marooned on a island and will take on the first I'm a Celeb challenge tonight.