"People left them alone," the restaurant's manager, Marc, tells PEOPLE

Kate Middleton and Prince William are going back to their romantic roots!

The couple took a break from their tour of Scotland on Tuesday with a night out together as they returned to the university town where they met and fell in love.

Kate and William, who were more often seen at Pizza Express in St. Andrews when they were college students nearly two decades ago, chose an upmarket contemporary restaurant "with a Scottish twist" when they dined out on Tuesday night. The couple stayed locally before their day of events in the town.

The pair, who celebrated their 10th wedding anniversary last month, were shown to a corner table in a secluded area at the back of Forgan's restaurant with a security detail seated close by.

Prince William and Catherine Duchess of Cambridge Prince William and Catherine Duchess of Cambridge land yachting
Kate Middleton and Prince William
| Credit: Tim Rooke/Shutterstock

"When word went around, a crowd gathered at the front, but as far as inside was concerned it was quiet for them. People left them alone," one of the managers, Marc, tells PEOPLE. "There was no pomp and circumstance or fanfare."

Forgan's wasn't built when William and Kate were attending St. Andrews University from 2001 to 2005. It is based in a converted butcher's warehouse.

Marc believes Kate was recommended it by one of her university pals. It is said to be popular with one of the societies that Kate was a member of, he added.

Get the premiere issue of PEOPLE Royals for glamorous new photos and inside stories royals fans haven't seen or read elsewhere! Subscribe at peopleroyals.com/launch

Catherine, Duchess of Cambridge
Kate Middleton
| Credit: ANDY BUCHANAN/POOL/AFP via Getty Images

Marc couldn't say what the couple ate, but a main dish of honey and whisky glazed short rib of beef, served with cabbage, carrot chili and apple slaw is $24. Current students say Forgan's is the kind of restaurant that you ask your parents to take you to when they come to visit or for a graduation celebration.

It is used to have prominent guests, like golfer Rory McIlroy, among its clientele, with the major courses attracting celebrities to the town. 

Marc adds, "They were very nice and complimentary when they left. Hopefully we will see them again."

Catherine, Duchess of Cambridge and Britain's Prince William, Duke of Cambridge
Prince William and Kate Middleton
| Credit: ANDY BUCHANAN/POOL/AFP via Getty Images

Can't get enough of PEOPLE's Royals coverage? Sign up for our free Royals newsletter to get the latest updates on Kate Middleton, Meghan Markle and more! 

Kate, 39, and Prince William, 38, visited the college where they first met and fell in love on Wednesday.

The duo "definitely had chemistry" at school, says Laura Warshauer, a New Jersey native and St. Andrews student who lived in the same dorm as the pair, previously told PEOPLE.

"Whenever Kate was in the room, Will was obviously paying attention to her," Warshauer added. "When we'd be sitting at lunch in the dining hall and the two of them would be talking, it was amazing to see how natural it was, how they had so much to say to each other. Looking back, there were all these small moments—certainly moments where I was like, 'Wow, this could really be something.'"