The on-and-off couple was accompanied by Kardashian's half-sisters Kendall and Kylie Jenner at the Hot 97 "Tip-Off" concert in N.Y.C.

Credit: Blue Flame Agency

Before whisking Khloé Kardashian away to a private island for Valentine’s Day, French Montana joined his on-again girlfriend for a night out at a concert on Thursday.

The couple arrived side-by-side to Hot 97’s “The Tip-Off” concert presented by CIROC, the official toast of the NBA, at Madison Square Garden in N.Y.C., which included performances by Puff Daddy, Lil’ Kim, Snoop Dogg and Big Sean.

“Khloé and French swayed back and forth to the sounds of the music, holding each other close, cuddling and almost always had their arms wrapped around one another throughout the entire duration of the show,” a source tells PEOPLE.

Joining them on their date night were Kardashian’s half-sisters Kendall and Kylie Jenner, who stayed close to their older sister during the concert.

“Khloe and French left the concert together after it was over,” continues the source. “It is clear that they are definitely seeing each other again.”

Kardashian, 30, was first spotted with Montana last spring, though they have split up twice since then.