Prince Andrew's ties to Jeffrey Epstein gained momentum this week after a U.S. attorney said the royal has provided "zero cooperation" in their investigation
Prince Charles, Prince of Wales, Queen Elizabeth II and Prince Andrew, Duke of York
Prince Charles, Queen Elizabeth and Prince Andrew
| Credit: Max Mumby/Indigo/Getty

Queen Elizabeth is continuing to deal with family drama behind the scenes.

The 93-year-old monarch and her eldest son and heir, Prince Charles, have had talks including an “emergency meeting” at her Sandringham estate over Prince Andrew‘s connections to disgraced financier Jeffrey Epstein, reports The Sun.

“Both had hoped the Duke of York could perhaps be rehabilitated back into public life in time but that is now looking increasingly unlikely,” a source told the publication.

Prince Charles is at Sandringham where he is taking meetings about estate business, PEOPLE has confirmed.

Despite Andrew’s decision to step back from royal life in the wake of his bombshell BBC interview about his ties to Epstein in November, the scandal has gained momentum this week after a U.S. attorney said the 59-year-old royal has provided “zero cooperation” with authorities and the FBI in the ongoing investigation.

In the statement announcing the bombshell news, the father of Princess Beatrice and Princess Eugenie stated: “Of course, I am willing to help any appropriate law enforcement agency with their investigations, if required.”

Prince Andrew
Prince Andrew
| Credit: Mark Cuthbert/UK Press/Getty

In the disastrous interview, Prince Andrew discussed his years-long friendship with Epstein and the sexual abuse allegations of Virginia Roberts (now Virginia Giuffre). Giuffre’s accusations, which the prince denies, mentioned coercion to have sex with the royal three times between 1999 and 2002 in London, New York and on a private Caribbean island owned by Epstein, starting when she was just 17 years old.

The Queen’s second son was widely criticized for not showing empathy for the victims of Epstein — who died by suicide in jail in New York City in August while awaiting trial on multiple sex charges — and for his decision to stay with at the financier’s New York home in December 2010. That came just months after Epstein had served 13 months of an 18 month sentence for procuring a minor for prostitution.

Queen Elizabeth II and Prince Andrew
Prince Andrew and Queen Elizabeth go to church on Jan. 19
| Credit: Karwai Tang/WireImage

Despite his exit from royal life, Prince Andrew has continued to spend time with his mother. They were all smiles during a church outing on Jan. 19.

Queen Elizabeth, Meghan, Harry
Queen Elizabeth, Meghan Markle and Prince Harry
| Credit: Max Mumby/Indigo/Getty

Can’t get enough of PEOPLE‘s Royals coverage? Sign up for our free Royals newsletter to get the latest updates on Kate Middleton, Meghan Markle and more!

Earlier this month, Queen Elizabeth summoned Prince Charles and Prince William to Sandringham, where she typically spends Christmas and the month following the holiday, to discuss Prince Harry and Meghan Markle’s shocking decision to step back from royal life. After the 90-minute summit, the monarch announced that after a period of transition that ends this spring, Meghan and Harry will lose their “Royal Highness” titles, repay renovation costs to their Frogmore Cottage home and split their time between North America and the U.K.