January 20, 2014 11:00 AM

Nate Beckett/Splash News Online

It takes a lot to memorize lines and perform action stunts, but Supernatural star Jared Padalecki says his real challenge is at home.

“For grown men who are used to playing sports, babies are tough,” the actor, 31, who welcomed his second son, Shepherd, in late December, told PEOPLE on Thursday at the Critics’ Choice Awards.

“As they get older, you can play and communicate — it’s fine. When they’re babies, you’re like, ‘I don’t want to break you. I have big hands, I’m sorry.'”

Luckily, Padalecki — who is also dad to 22-month-old Thomas Colton credits his “pretty awesome” wife Genevieve, alongside the occasional nanny, with helping him conquer double diaper duty.

Being away from his Austin home to shoot the CW’s hit show in Vancouver has prevented Padalecki from getting a lot of quality time with his newborn, but he says “we’ll have a couple of weeks now.”

Although he and fellow costar Jensen Ackles — dad to daughter Justice Jay, 7 months — are considered heartthrobs of their TV network, they find fans appreciative that they are happily off-limits.

“I think it’s the opposite,” Ackles, 35, told PEOPLE when asked if his admirers are upset that he and Padalecki are married. “They’re super supportive. They love it.”

Echoes Padalecki: “Being on a show about two guys trying to do what’s right, I think they’re happy that we’re two guys trying to do what’s right.”

— Dahvi Shira

You May Like