Kevin Winter/Getty; FameFlynet
April 14, 2014 10:25 AM

Further evidence that Justin Bieber and Selena Gomez are back on?

Justin Bieber surprised Coachella-goers with a performance to support his friend and Chicago MC, Chance The Rapper, on Sunday. But the bigger surprise was the presence of Bieber’s on-again-off-again squeeze, Selena Gomez, who stood on the side of the stage to watch him sing.

“Right after his performance Bieber walked off stage and watched the rest of Chance’s set with Selena Gomez,” a source tells PEOPLE. “They were there for around 15 minutes until Bieber touched Gomez on her mid back as if to say, ‘Let’s go,’ and the two left together.”

According to an onlooker who posted on Twitter, the couple certainly had a cozy look about them.

Wrote Ryan Marker: “Just saw @justinbieber and @selenagomez holding hands back stage at coachella….looks like they are back together.”

While on stage the 20-year-old pop star performed his song “Confident” that features Chance. “She’s confident and I’m down with it,” he sang. Gomez, 21, recently expressed her own self-confidence when she opened up about issues she’s been struggling with – some of which may have led her to seek rehab in January.

“I’d be lying if I said I’ve never tried to make myself better by giving in because I have,” the actress said at a We Day conference in March this year. “But I’ve learned from my actions and for all of the things I’ve done, I’m proudest of that. I’ve learned from my mistakes.”

RELATED: Kylie Jenner, Vanessa Hudgens Debut Blonde-Dipped ‘Dos at Coachella

RELATED VIDEO: See How Justin Bieber Has Changed over the Years

You May Like