The country singer made the joke during her newest podcast episode, but quickly retracted her words and apologized in an Instagram post on Monday

Jana Kramer is delivering a public apology to her husband Mike Caussin after joking about his cheating scandal.

On Monday, the country singer, 35, and her husband, 31, released a new episode of her podcast Whine Down with Jana Kramer called “WAGs and Sister Wives.”

In the conversation, the pair discussed the polygamous relationships on TLC’s Seeking Sister Wife.

But the honest discussion triggered some emotions in Kramer, as Caussin was repeatedly unfaithful in 2016, seven months after their daughter, Jolie Rae, was born.

“What guy doesn’t want that… to have different partners and to have sex?” Kramer said amid their discussion, before adding, “I mean, that’s why my husband cheated on me.”

Though she immediately issued an apology on-air to Caussin, quickly saying “Sorry, babe” right after the jab, Kramer later delivered a longer heartfelt note to her husband of four years on Instagram Monday.

51st Academy Of Country Music Awards - Arrivals
Jana Kramer and Mike Caussin
| Credit: David Becker/Getty Images

“Open apology to my husband: I’m a very sarcastic person and I joke a lot which when people don’t know me it might be taken the wrong way,” she began in the post, alongside a mirror photo of Caussin kissing Kramer on the head with Jolie, 3, by their side.

“But sometimes there is something under a joke and it can hurt someone else,” she continued. “And that’s what happened on this week’s podcast and I’m sorry.”

“For me, sometimes my way of coping with pain and triggers is deflecting and making a joke. But that’s not the healthiest especially when it can hurt someone I care about,” Kramer acknowledged, before clarifying how great of a husband and father Caussin has recently been.

Credit: Jana Kramer/Instagram

“Truth is, the past year Mike has shown up in every way I could have hoped for,” she said of the former NFL player. “He’s an incredible father, and has been working his ass off for our family, me, and most importantly himself so I’m sorry Mike and I love you and so thankful for you and our family and all your hard work!”

Finishing her note, Kramer revealed her plans to stop bringing up Caussin’s affair “because it is in the past and that’s where it needs to stay,” and asked her followers to hold her accountable.

After news of his infidelity broke in 2016, Kramer and former NFL tight end announced they were taking a break, and Caussin subsequently entered a rehabilitation facility for treatment.

“I acknowledge that certain actions and behaviors have caused issues in my marriage and I am deeply sorry for the pain I have caused Jana,” Caussin told PEOPLE exclusively in 2016. “I have and will continue to take the steps needed to change who I am as a person in order to be a better husband and father.”

The pair were separated for some time but reconciled and renewed their vows in December, then suffered a miscarriage shortly thereafter. In November 2018, Kramer and Caussin welcomed their second child together, a son named Jace Joseph.

Los Angeles Premiere of Support The Girls
Jana Kramer and Mike Caussin
| Credit: Michael Kovac/Getty

Though Monday’s conversation was triggering for Kramer, this is not the first time the pair has openly discussed Caussin’s infidelity on the podcast.

This past May, the couple candidly talked about how their marriage is still a work in progress and revealed they were going to a marriage counseling.

Recalling how his wife wanted to see more change in him, Caussin said, “She said, ‘Look, I’m giving you every opportunity. I am here. I am willing to work on this. I want this family to work.’ Basically, step up or get out. And it got to a point of an ultimatum and that’s where I hit my breaking point. She hit her breaking point. I hit mine.”

“The thing is until someone wants to change themselves, there’s no amount of therapy, no amount of talking you can do about it until you make that decision for yourself,” Caussin said.

“I don’t want to lose her. I don’t want to lose Jana. I don’t want to lose our family. I don’t want to lose what we are trying to build,” he added.

RELATED VIDEO: Jana Kramer’s Husband Mike Caussin Apologizes As She Accuses Him of Cheating

That same month, on a separate episode, the pair opened up about their intimacy issues following the cheating scandal and how communication was key for them.

“Unfortunately the infidelity piece plays a part in this,” Kramer admitted just a few weeks later. “There’s times I do wanna have sex, and I play the game of waiting for you to come to me ’cause I’m like ‘Well, you know, why doesn’t he want me? Why doesn’t he wanna sleep with me since he slept with someone else?'”

“I wanna feel chosen. A part of me is like ‘You left me, so now choose me. Jump on me, you know what I mean?'” she added.

In response, Caussin explained that he doesn’t “wanna feel tested” and added that the duo was working on communicating their feelings to each other.

“Especially when there is infidelity involved, communication is key. You and I have slowly gotten better at this,” he said.