"It probably has something to do with permanence," says Rory, who opened up on CBS Sunday Morning

By Danielle Anderson
Updated September 02, 2016 02:30 PM
Courtesy Rory Feek

.cbs-link {color:#4B5054;text-decoration:none; font: normal 12px Arial;}.cbs-link:hover {color:#A7COFF;text-decoration:none; font: normal 12px Arial;}.cbs-pipe {color:#303435;padding: 0 2px;}.cbs-resources {height:24px; background-color:#000; padding: 0 0 0 8px; width: 612px;}.cbs-more {font: normal 12px Arial; color: #4B5054; padding-right:2px;}Nearly six months after Joey Feek‘s death from cancer at age 40, her husband Rory still visits her grave daily.

He’s even added a bench to the burial site on the couple’s 60-acre farm in Tennessee, so he can sip his morning coffee with his wife.

There’s just one more thing he needs to add: a headstone.

“I don’t know why, I just can’t,” Rory, 51, says in an emotional interview for CBS Sunday Morning. “I don’t know if it’s that she’s so simple, and a wooden cross is part of what she would like.”

But he admits that his feelings play a large part, too. “It probably has something to do with permanence. So, for now, I can sit out here and feel like it’s – it’s maybe just temporary. Although I know it’s not.”

Joey Feek Laid to Rest in Private Funeral on Family’s Tennessee Farm

Don’t miss a beat of country music news, photos and videos! Click here to get all this and more in the PEOPLE Country Newsletter.

The singer-songwriter also revealed that he’s not ready to play music without his Joey + Rory duo partner.

“I don’t want to go on stage without her,” he says. “That’s what I’m thinking about right now. I just don’t want to make music without her. But I also know time changes things. So I won’t say never. It’s just where I am today.”

Rory admits that being on stage was more of Joey’s passion than his own.

“She loved to be onstage performing, and I loved to stand next to her,” he says. “I just had the best seat in the house to watch the world discover my wife.”

The couple’s 2-year-old daughter, Indiana, has been doing well, Rory shares. Although he previously shared a blog post that his little girl, who has Down syndrome, hadn’t asked for her mother since she died, he says there are occasions where she misses her mother, especially when they’re taking a drive.

“She’ll just sign ‘Mama’ or say ‘Mama’ every once in awhile, but usually it’s in the car because she wants to hear Mama sing,” Rory says.