Jennifer Lopez Becoming Short-Tempered Around Casper Smart

Less than a year into their whirlwind romance, "she's getting frustrated with him," a source tells PEOPLE

Photo: AKM-GSI

Her whirlwind romance with Casper Smart began last November as what one source close to the couple told PEOPLE was “a fun fling.”

But now, nearly a year later, could Jennifer Lopez be preparing to leave more than just her American Idol gig?

“He’s moved into her life – and a little too easily, too,” the source tells PEOPLE. “I think her family is watching him closely.”

Lopez’s possible cold front comes amid tabloid reports about Smart: One claims he visited a New York City exotic massage parlor, while another reports he was at a peep show next door. (Photographs show Smart going up a set of stairs that lead to the spa.) Lawyers for the couple call the stories “false, malicious and defamatory.”

PHOTOS: Jennifer Lopez & Casper Smart: So Into Each Other!

Those rumors coincided with her 43rd birthday, which they celebrated together in the city. But although they were all smiles as they were photographed heading to lunch, the source says “she’s getting frustrated with him” and she’s increasingly “short-tempered when she’s around him.”

This is a departure from the affection they displayed when they hit the town – and, recently, in a steamy music video for her single “Dance Again” (and again in a sweet clip during her current concerts for the song “Baby I Love U”).

But as Smart continues to tour with Lopez, a breakup may not be in their near future.

“Jennifer is the kind of girl who doesn’t like to be alone,” says the source. “Until she finds a replacement, I think, he’s around.”