"The first anniversary was paper, and Meghan wrote out the wedding speech and had it framed for him," a source told PEOPLE

Prince Harry, Meghan Markle
Prince Harry and Meghan Markle
| Credit: Ben STANSALL - WPA Pool/Getty

Meghan Markle and Prince Harry are expert gift givers when it comes to their own wedding anniversary.

The couple, who are celebrating the third wedding anniversary of their May 19, 2018, royal wedding on Wednesday, traditionally mark their special day by exchanging gifts — but they do it their way.

"They love to do their own take on traditional wedding gifts," a source previously told PEOPLE. "The first anniversary was paper, and Meghan wrote out the wedding speech and had it framed for him."

On their second anniversary last year, "they both gave each other gifts based on 'cotton.' Undoubtedly, it was a very creative and romantic gesture as all their gifts are to one another," the source added.

Prince Harry and Meghan Markle on their wedding day

According to wedding site The Knot, "Cotton's woven threads symbolize how you become more interconnected as time goes on and learn to be more flexible."

The traditional third-anniversary gift is leather, as a symbol of something that only gets better with age.

The Duke and Duchess of Sussex typically spend their anniversary quietly as a family with their son Archie. This year, they have even more to celebrate as they are expecting their second child — a baby girl — this summer.

Just weeks before their first anniversary in 2019, Meghan and Harry welcomed their son Archie. And they celebrated both milestones with Meghan's mother, Doria Ragland, who came to the U.K. to meet her grandchild. They family sat down to a traditional Sunday lunch before Doria traveled back to Los Angeles.

Prince Harry also gave Meghan an eternity ring that he helped design to mark their first anniversary. She first wore it at Trooping the Colour the following month.

Archie Mountbatten-Windsor 1st birthday
Meghan Markle and Archie
| Credit: The Duke of Sussex/@SaveChildrenUK

The growing family has been settling into life in Montecito, California, since their move last summer.

Can't get enough of PEOPLE's Royals coverage? Sign up for our free Royals newsletter to get the latest updates on Kate Middleton, Meghan Markle and more!

"They are both extremely attentive parents. Harry wants to give Archie the childhood he always wanted," an insider previously told PEOPLE. "They spend a ton of time outside, and both Harry and Meghan love to play—all the private space is a dream for them."