But a source tells PEOPLE Baldwin wasn’t in the picture for long.
“Hailey was a fling, but Drake has always wanted to make things work with Rihanna,” the insider said.
“They are still dating,” the source added, of Rihanna and Drake. “Things get more serious when they’re in the same place.”
“Shout out to the most beautiful, talented woman I’ve ever seen,” Drake told the crowd, as captured on social media. “She goes by the name of Rihanna.. I’m getting my heart broken.”
Afterwards, the pair were spotted separately leaving an after party. They were also photographed separately in the early hours of Wednesday morning, leaving Nicole Scherzinger‘s birthday party at London’s Tape Nightclub.
RELATED VIDEO: Check Out Some of the Crazy Dressing Room Demands Rihanna Has for Ellen
Though she told Ellen DeGeneres in February she’s “single right now,” the source says the singers have been purposely hiding their relationship.
“They have been keeping it a secret because this time around, they want to do it right and keep their relationship private,” says the source of the couple, who were rumored to have dated a couple years ago.
Reps for the two have not commented.