Prince Harry and Meghan Markle’s wedding will be in May at St. George’s Chapel at Windsor Castle, the palace announced on Tuesday.

The latest arrangements were unveiled at a special briefing at Buckingham Palace just one day after Harry, 33, and Meghan, 36, shared the news of their engagement.

During the briefing, the couple’s Kensington Palace spokesman said the soon-to-be newlyweds are “extremely grateful following the warm public response” to their engagement.

“Windsor is a very special place for Prince Harry, and he and Ms. Markle have regularly spent time there during the last year,” said the spokesman. “They are delighted that the beautiful grounds of Windsor Castle will be where they begin their lives as a married couple.”

The day will be “shaped so that members of the public” feel like a part of it, he added. “This wedding, like all weddings, will be a moment of fun and joy and reflect the characters” of both the bride and groom. Harry’s grandmother Queen Elizabeth will be at the wedding, and the exact day is still to be announced. It is also not known yet if the Archbishop of Canterbury Justin Welby will officiate.

Announcement Of Prince Harry's Engagement To Meghan Markle
Harry and Meghan announcing their engagement on Nov. 27, 2017.
| Credit: Chris Jackson/Getty

The spokesman added that the royal family will foot the bill for the key parts of the wedding tab, including the church service, flowers, decorations and the reception.

Meghan, the rep added, will be baptized and confirmed in the Church of England prior to the wedding and is already going through the process of becoming a British citizen.

On Friday, Meghan will join Harry during a public engagement at Nottingham Cottage so he can show her the Full Effect project on World AIDS Day. “Ms. Markle cannot wait to meet many of the young people Prince Harry has already told her so much about,” the spokesman said.

In a wide-ranging BBC interview on Monday, the couple revealed how Harry popped the question during a “cozy” night as they cooked roast chicken at their new London home, Nottingham Cottage at Kensington Palace.

RELATED VIDEO: Prince Harry and Meghan Markle Share Proposal Details: ‘It Was a Cozy Night’

The wedding will take place during an exciting time for the royal family — Harry’s brother, Prince William, and sister-in-law, Kate Middleton, are expecting their third child in April.

The choice of the relatively low-key (for royals!) St. George’s Chapel is a departure from more sweeping settings of royal weddings past. Although William and Kate married in the grandeur of Westminster Abbey, William “would have liked to have married at St. George’s Chapel,” royal historian Hugo Vickers previously told PEOPLE. “The only reason was that it didn’t have a balcony [for the newlyweds’ big kiss]. He would have liked to have done it at Windsor too.”

Prince Charles and Camilla, Duchess of Cornwall wed at St. George’s in a “service of blessing” in April 2005. The royal family certainly likes the setting: Besides Charles and Camilla, it’s where Charles’s brother Prince Edward married Sophie, Countess of Wessex, and Princess Anne’s son Peter Phillips wed wife Autumn.