King Charles III, Prince Harry, Duke of Sussex and Meghan Duchess of Sussex

AsKing Charlesundergoescancer treatmentandKate Middletonrecovers fromabdominal surgery, many are wondering how things may have been drastically different for the royal family hadMeghan MarkleandPrince Harrynot stepped back from their working roles.

“This is a slimmed-down monarchy in the ways the King could never have anticipated. This puts into much sharper focus what a terrible mistake it was for Harry to leave,” royal biographer Sally Bedell Smith tells PEOPLE exclusively in this week’scover story. “If he and Meghan had stayed in Britain and stuck with their jobs, they could be very vital players right now.”

“They desperately need him, and nobody could have foreseen the set of circumstances that would expose that so dramatically,” adds Catherine Mayer, the author ofCharles: The Heart of a King.

Over a year and a half after the death ofQueen Elizabeth, who provided seven decades of stability to her family and the nation until her death at age 96 in September 2022, the royals appear vulnerable. Along with the absence of Prince Harry, 39, and Meghan, 42, following their decision to step back from their royal roles in 2020, the current onslaught of issues feels unprecedented.

Prince Harry, Meghan Markle, King Charles and Queen Camilla at the funeral of Queen Elizabeth on September 19, 2022.Andy Stenning - WPA Pool/Getty

Prince William, Prince of Wales, Prince Harry, Duke of Sussex, Meghan, Duchess of Sussex, King Charles III, Camilla, Queen Consort, Princess Anne, Princess Royal and Princess Beatrice observe the coffin of Queen Elizabeth II as it is transferred from the gun carriage to the hearse at Wellington Arch following the State Funeral of Queen Elizabeth II at Westminster Abbey on September 19, 2022 in London, England.

King Charles, 75, has postponed public-facing duties while receivingcancer treatment, while the Princess of Wales, 42, has also been outside of the spotlight while recovering fromabdominal surgeryin January.

Though Kensington Palace said Princess Kate was unlikely to return to public duty until after Easter, the lack of clarity sparked numerousconspiracy theoriesabout her health and whereabouts. In response to the speculation, the palace released arare second statementreiterating the initial timeline for her return to work.

Prince George, Kate Middleton and King Charles on Christmas Day, Dec. 25, 2023.Adrian Dennis / AFP via Getty

Britain’s Catherine, Princess of Wales and Britain’s Prince George of Wales (L) leave after attending the Royal Family’s traditional Christmas Day service at St Mary Magdalene Church on the Sandringham Estate in eastern England, on December 25, 2023

Adrian Dennis / AFP via Getty

“The monarchy needs to be that anchor in times of trouble, and any sense of instability, which is inevitable when you have two of the key players out of action, is understandable,” says Bedell Smith.

“This is massively exposing how the royal family has gone from too many people to too few in a short space of time,” adds Mayer.

Despite the distance between Prince Harry and his family, he flew from California to visit his father on Feb. 6, the day after the palace publicly announced the news about the King’s health. However, he did not see his brother, Prince William, or sister-in-law, Princess Kate, during his whirlwind 24 hours in the U.K. The Duke of Sussex has openly spoken about his desire for reconciliation and is thought to have contacted his brother, though there were “no plans” to meet, a palace source said at the time.

King Charles and Prince Harry at Queen Elizabeth’s lying-in-state procession on Sept. 14, 2022.Jeff J Mitchell - WPA Pool/Getty

Prince William, Prince of Wales, King Charles III and Prince Harry, Duke of Sussex walk behind the coffin during the procession for the Lying-in State of Queen Elizabeth II on September 14, 2022 in London, England.

Jeff J Mitchell - WPA Pool/Getty

A former courtier suggests Prince William’s “principal concern is his wife” amid her recuperation, but the lack of interactionhighlights the hurtbetween the brothers.

“It would be the normal run of things to go and see your sister-in-law who’s had a serious operation and also see your niece and nephews. But it isn’t normal. It’s terribly sad,” a source close to the royal household tells PEOPLE.

“I’m sure it was emotionally draining for both of them, but it was a step in the right direction. It was a positive move,” the source says of their quick visit. Having flown overnight from L.A., the Duke of Sussex would have liked to spend more than 30 minutes or so together, but he was “grateful to be able to speak directly to his father and show his support for him,” says a source.

PEOPLE Magazine, March 18.

PEOPLE ROYALS COVER 03-18-24

Can’t get enough of PEOPLE’s Royals coverage?Sign up for our free Royals newsletterto get the latest updates on Kate Middleton, Meghan Markle and more!

Trust continues to be a concern following Prince Harry’s candid memoirSpareand the Duke and Duchess of Sussex’s revealing Netflix docuseriesHarry & Meghan. During Harry’s visit with King Charles,Queen Camillamade a deliberate effort to be in the room.

“This is all to do with William’s wish to protect the institution of the monarchy, which he feels Harry can’t be trusted with. I don’t think William will ever agree to readmission of Harry into the family unless he clearly apologizes and moves forward,” says royal author Robert Lacey.

Adds royal biographer Ingrid Seward, author ofMy Mother and I,“Of course he would like Harry to be the prodigal son and come back and would be much happier if William and Harry were friends again. But he realizes that is just not about to happen.”

source: people.com