"I enjoy all the pink everywhere, being Heather's husband and the daddy for the girls," says Nichols.

Since the birth of his 5-month-old daughter, Georgia Blue, country singer Joe Nichols is savoring each one of her adorable milestones.

“She’s growing like a weed and the changes are coming fast,” Nichols, 37, tells PEOPLE of his second daughter with wife Heather, 38. “She’s starting to giggle which is so cute and she’s getting her first little tooth on the bottom!”

Plus with his 2½-year-old daughter Dylan River already at home, the singer is loving being the only man of the house.

“I enjoy all the pink everywhere, being Heather’s husband and the daddy for the girls,” says Nichols, who also has a daughter, Ashelyn, 16, from a previous relationship. “I’ll do anything to make them happy.”

Joe Nichols Introduces Daughter Georgia Blue

Paul Costello

So what exactly is “anything?”

“I find real joy doing things I would never have imagined doing, like playing with princess dolls and fairies,” he says. “I’m the guy who wants to watch Bubble Guppies with Dylan and hold the baby.”

Though while he’s on tour promoting his album Crickets, life is a bit different.

“When I’m on the road, it’s a lot of cussin’ and guy stuff,” he says. “It’s a big transition.”

But with the holidays approaching, “the road is slowing down a bit,” he says. “I’m just really looking forward to spending some uninterrupted time with my family.”

For more photos of Joe Nichols and his entire family pick up the latest issue of PEOPLE, on stands Friday.

— Ana Calderone