Multiple sources confirm to PEOPLE that Teresa told her Real Housewives of New Jersey castmates the news at the season 9 reunion taping earlier this month

It looks like Teresa Giudice and Joe Giudice’s marriage may not survive if he’s deported.

Multiple sources confirm to PEOPLE that Teresa, 46, told her Real Housewives of New Jersey castmates at the season 9 reunion taping earlier this month that if Joe is deported to Italy, “we’d go our separate ways.”

At a previous reunion, Teresa said she would consider moving overseas if Joe were deported. “I mean, Italy’s a beautiful place to live,” she admitted. “I wouldn’t mind, you know, I’m just saying. Listen, whatever God has planned for me, that’s what’s going to happen. I will embrace it the best I can.”

But this time, Teresa told host Andy Cohen that she had discussed the possibility with their four daughters — Gia, 18, Gabriella, 14, Milania, 12, and Audriana, 9 — and said that they would now be staying in the United States without him.

“Teresa told Andy that if Joe gets deported, she’s not going,” a source on the scene told PEOPLE. “She said that she and Joe had talked about it over the phone, and that he understood.”

The Giudices’ attorney James J. Leonard Jr. declined to comment. A rep from Bravo did not immediately respond for comment.

Teresa and Joe Giudice
| Credit: Paul Zimmerman/Getty Images for Mount Airy Casino Resort
Credit: Dave Kotinsky/Getty Images

According to a second source, Cohen then pressed Teresa about what would happen to their marriage — causing her to tell him that they’d split.

“She didn’t really express any sadness about that,” the second source explained. “She just focused instead on the girls. It was very matter of fact.”

Joe, 48, is currently serving a 41-month prison sentence for mail, wire and bankruptcy fraud that began in March 2016. Teresa served a little over 11 months in prison, herself, for the same crimes and was released on Dec. 23, 2015.

In October, an immigration court ruled to deport Joe to his native Italy after his prison sentence. (Even though he has lived in the United States since he was a child, he never obtained American citizenship, and immigrants can be deported if they are convicted of “a crime of moral turpitude” or an “aggravated felony,” according to U.S. law.)

Fabellini Wine Launch
Teresa and Joe Giudice
| Credit: Dave Kotinsky/Getty

Though Joe appealed the ruling in November, he still faces deportation. While his fate is unknown, an insider close to the couple said that they remain hopeful about the appeal.

“They are obviously optimistic that he is coming home,” said the insider. “Teresa’s hope is that they can remain together as a family.”

Back in November, Teresa told PEOPLE that she was taking Joe’s deportation “day by day” and doing “whatever we have to do.”

“He’s very upset,” Teresa said of Joe. “Hopefully they’ll be able to appeal this and Joe will be able to come home … You know, we’re going to fight this.”

The Real Housewives of New Jersey season 9 reunion will air on Bravo in February.