Harry added that he had two conversations with his father, Prince Charles, "before he stopped taking my calls"
Queen Elizabeth, Meghan, Harry
Queen Elizabeth, Meghan Markle and Prince Harry
| Credit: Max Mumby/Indigo/Getty

Prince Harry is denying reports that his grandmother Queen Elizabeth and father Prince Charles were blindsided by his and Meghan Markle's decision to step back as senior members of the royal family.

During the couple's interview with Oprah Winfrey on Sunday, the TV host asked if they "blindsided" the monarch by releasing a statement in Jan. 2020 about stepping back to the public.

"No, I never blindsided my grandmother," Harry said. "I have too much respect for her."

For more on Prince Harry and Meghan Markle's interview with Oprah, listen below to the episode of PEOPLE Every Day.

The prince continued that he had three conversations about the subject with the Queen and two conversations with Prince Charles — "before he stopped taking my calls."

Prince Charles then asked Prince Harry to put their plan in writing. Harry did, including telling his family the date that they planned to announced the news.

Oprah With Meghan And Harry
Prince Harry and Meghan Markle
| Credit: CBS/Youtube

Meghan and Prince Harry announced in Jan. 2020 they intended to "step back as senior members of the Royal Family" and split their time between the U.K. and North America.

"After many months of reflection and internal discussions, we have chosen to make a transition this year in starting to carve out a progressive new role within this institution," they said in a statement. "We intend to step back as 'senior' members of the Royal Family and work to become financially independent, while continuing to fully support Her Majesty The Queen."

Can't get enough of PEOPLE's Royals coverage? Sign up for our free Royals newsletter to get the latest updates on Kate Middleton, Meghan Markle and more! 

Prince Harry, his father Prince Charles and his brother Prince William met with Queen Elizabeth at Sandringham, her country home, to discuss Harry and Meghan's announcement in what became known as the "Sandringham Summit."

After the 90-minute discussion, the Queen, 94, released a rare and emotional statement.

"Today my family had very constructive discussions on the future of my grandson and his family," she said.

"My family and I are entirely supportive of Harry and Meghan's desire to create a new life as a young family," she continued. "Although we would have preferred them to remain full-time working Members of the Royal Family, we respect and understand their wish to live a more independent life as a family while remaining a valued part of my family."

Prince harry and Megan and Oprah
Prince Harry, Meghan Markle and Oprah Winfrey
| Credit: Joe Pugliese/Harpo Productions

Less than a week after the couple announced that they are expecting their second child, Buckingham Palace confirmed that the couple will officially not be returning to their royal roles. The announcement came a few weeks shy of their 12-month review period.

Get the premiere issue of PEOPLE Royals for glamorous new photos and inside stories royals fans haven't seen or read elsewhere! Subscribe at peopleroyals.com/launch

Although Prince Harry and Meghan no longer use their coveted His/Her Royal Highness titles, they will retain them — along with their Duke and Duchess of Sussex titles.

"While all are saddened by their decision, The Duke and Duchess remain much loved members of the family," the Buckingham Palace announcement said.