LuAnn de Lesseps' Fiancé Tom D'Agostino Speaks: 'I Never Dated Sonja or Ramona'

LuAnn de Lesseps' fiancé Tom D'Agostino clears the air about which RHONY he's had relationships with

Photo: Jimi Celeste/Patrick McMullan/Getty

So much for “friends with benefits!”

LuAnn de Lesseps fiancé Tom D’Agostino, Jr. is setting the record straight about his past relationship with Ramona Singer and Sonja Morgan!

“I don’t watch the show, but I get different pieces here and there, and a lot of the stuff I have heard? It’s so outlandish to me,” D’Agostino told PEOPLE at Monday night’s New York City premiere of the second season of Hulu’s Difficult People (the Countess has a cameo!).

“In terms of Ramona, we never dated,” said the 49-year-old. “We went out a couple of times – maybe two or three times to dinner with some friends.”

“There was never any chemistry. No interest at all,” he continued, of Singer.

Singer echoed those statements both on and off screen, telling ET recently, “Yes, I did date him, but we just didn’t have any chemistry. I do think he’s a nice guy.”

“Now that I’m single again, I’m realizing just how small the dating pool is and how funny it is that LuAnn and I overlapped,” the 59-year-old housewife said.

One person who appeared to not be laughing is de Lesseps, who stormed out of a dinner scene on Wednesday’s episode of The Real Housewives of New York City when Morgan insisted she and D’Agostino had been “friends with benefits for 10 years.”

D’Agostino refutes that statement: “Sonja, I’ve known for years,” the marketing CEO tells PEOPLE. “The funny part is, although I’ve known her for years, we got together once, but she’s on this kick that it was more than that,”

D’Agostino said he tried to get to the bottom of the discrepancy by talking directly to Morgan. “I saw her at a party two or three weeks ago, and I said to her, ‘Sonja, this is me, what are you talking about?’ and she says, ‘Oh, I’ll have to get my diary, I’ll tell you when,’ ” D’Agostino explained.

Morgan, who also cameos in Difficult People, stands by her statements.

“We were fun buddies – adults that had a nice understanding,” the 52-year-old told PEOPLE at the premiere, “and I just wanted to get that out on the table right away because I knew the girls were gonna tell [LuAnn], it was gonna come out.”

“He’s going to minimize it as much as possible, as all men do. They never tell the truth, guys, they never do,” she added.

RELATED VIDEO: Countess Luann De Lesseps Spills Her Wedding Deets: Dresses, Serenading, and Bachelorette Party!

De Lesseps, meanwhile, says she’s not going to let what the women say put a damper on her wedding planning. “We’re getting married no matter what the women have to say,” she told PEOPLE. “We are moving onward and upward with our wedding plans.”

“All I can say is, along the way you have to kiss a few frogs and toads to get to a Countess,” D’Agostino added.

As for whether Singer and Morgan will score invites to the New Year’s Eve nuptials, the 51-year-old Countess isn’t sure. She said she’s not deciding who of the bunch will be at her wedding until after the reunion – except for housewife Dorinda Medley, who will serve as her bridesmaid.

D’Agostino has his hands in the planning, but just barely. When asked how involved he is in the wedding planning, he laughed and said, “As much as most grooms-to-be are.” But since the wedding is also his 50th birthday celebration, he had a lot of say in where they re going to have it “and who’s going to be there” – meaning Singer and Morgan might want to watch what they say.

This will all be news to Morgan, who seems to think her invite is already in the mail. “Yes, of course,” she said, when asked if she will be attending the wedding. “I will never let a man come between me and LuAnn. And she obviously isn’t letting a man come between us because she’s getting down that aisle no matter what it takes – and dragging me with her!”

“She’s the one that’s in love; he’s her soulmate and we all know that,” Morgan said.

The Real Housewives of New York City airs Wednesdays (9 p.m. ET) on Bravo, and Difficult People season 2 is currently streaming on Hulu.