The 'Sorry' singer has had an eventful time while stopped in Boston for his Purpose World Tour
Credit: Getty

Justin Bieber‘s wild Boston adventures continue!

Bieber, 22, headed to Storyville nightclub, where he kicked partiers out of the VIP room to claim it for himself, in the city’s Back Bay neighborhood on Wednesday night.

“There were people that were in the VIP room already that got kicked out,” a witness told PEOPLE. “I heard them outside, saying, ‘Justin Bieber kicked me out of my VIP!’ ”

Club-goers captured the “Sorry” singer dancing on the bar while smoking a cigarette and entertaining his fellow clubbers. One fan posted a video of the events on Instagram.

Instead of returning to the Four Seasons Hotel Boston, which was crowded with excited Beliebers, Bieber’s drivers drove past the hotel and dropped him off at the corner of the Boston Public Garden with a group of girls around 2 a.m. Bieber and company were spotted running and jumping in the air repeatedly.

“He was drunk. He’s running and jumping like four times before I got near him,” said a witness.

Bieber is in Boston as part of his Purpose World Tour. He performed his second concert at TD Garden earlier Wednesday before hitting up Storyville and several other bars, beginning with downtown dive The Tam in the Theater District. Around 10:45 p.m., he headed to STRIP by Strega in the Boston Park Plaza Hotel, where Bieber was spotted sitting alone at the bar and drinking Jack and Coke while chatting with the bartender.

“He was super nice and chatty with guests,” said a rep for the restaurant, who added that before Bieber left, he shook owner Nick Varano’s hand and thanked him.

“He hung around outside for a little bit, chatting with the managers, then went back in and waved goodbye to everyone, and everyone went crazy,” the rep continued, adding that Justin took a selfie with one manager.

Bieber’s wild night came after a day of strange behavior, including some time spent sitting in a tree in Boston Public Garden. He did take time to make a couple new friends though: On Wednesday afternoon, the Biebs sat in the Bristol Lounge at the Four Seasons, where he held one patron’s baby. A group of women looked on as Justin bounced the little one in his arms.

“His bodyguards were all trying to keep people back and saying, ‘No photos,’ and Justin turned and saw me there with the baby. He was like, ‘I’ll hold the baby, let me hold the baby’ and reached out for him,” the baby’s mother tells PEOPLE. “He was totally normal and very, very sweet. I think he was so overwhelmed with all the women there… He seemed like, ‘I just want a burger.'”