The rumored couple were spotted showing PDA backstage

By Abby Stern
Updated May 10, 2015 11:20 AM
Credit: Chelsea Lauren/WireImage; Kevin Winter/Getty

Taylor Swift may have just kicked off her 1989 world tour in Tokyo earlier in the week, but she’s made it back to the States in time to catch her rumored boyfriend, Calvin Harris, perform at 102.7 KIIS FM’s Wango Tango at the StubHub Center in Carson, California, on Saturday.

The crowd was buzzing as Harris began his set and while the “Blank Space” singer, 25, didn’t join him onstage, Big Sean did, performing their hit song “Open Wide”.

Why Taylor Swift Could Really be a Supermodel!

However, behind-the-scenes, Harris and Swift spent some quality time together. After arriving at the venue earlier in the day, the pair were “totally holding hands” on the way to Harris’s dressing room, an onlooker told PEOPLE. The band Haim, who are good friends with Swift, were also on hand for the fun evening.

Harris, 31, joined Swift and Haim at the side of the stage after he was done with his set. He and Swift once again held hands as they watched Justin Bieber perform, even dancing a little to “Boyfriend,” which opened the singer’s set.

Rumors about Swift and Harris have been swirling since March when they were spotted getting close at a Kenny Chesney concert. The following month, they attend a Haim concert in West Hollywood together.