The couple hit the 40/40 club to party after his Madison Square Garden Show
Credit: Jamie McCarthy/WireImage

Newlyweds Jay-Z and Beyoncé partied with New York Yankee and new dad Alex Rodriguez in New York Tuesday night, where they playfully continued to dodge questions about their April 4 wedding.

After Jay-Z’s Madison Square Garden concert, the couple – dressed to match in black and white – separately walked the red carpet leading into the rap mogul’s 40/40 club.

Jay-Z jokingly cat-called to his wife as she strutted her stuff in front of cameras and ignored wedding queries, instead telling PEOPLE his fans can expect “more great things” from him: “I’ve got a couple more albums to give you.”

Inside the club – a 12,000 square foot lounge co-owned by Jay-Z – the newlyweds (neither of whom were wearing wedding rings) danced together to New Edition’s “Cool It Now”.

Later in the evening, Jay-Z and actress Joy Bryant broke out into the robot dance and Beyoncé boogied with a fellow clubgoer to Timbaland’s “The Way I Are.” To cap off the evening, Jay-Z did two rounds of Patron shots with Rodriguez (currently on the disabled list for a muscle strain), whose team lost to Cleveland Tuesday night.