The stars stayed close during their night out in Nashville
Credit: Ryan Turgeon/Splash News Online

Blake Shelton and Gwen Stefani took their romance out on the town in Nashville on Wednesday.

Following months of relationship speculation, Shelton, 39, and Stefani, 46, made their first appearance as a couple at a CMA Awards afterparty.

“They were very comfortable with each other,” says a source.

The duo sported casual looks, with Stefani pairing jeans with a black top and jacket and Shelton wearing a dark button-down shirt and jeans.

While balancing drinks, Stefani and Shelton held hands and walked with pals outside.

Hours earlier, a source confirmed to PEOPLE that the fellow Voice coaches "have begun dating."

The insider added, “They’ve been supporting each other through a difficult time and they’re really happy together.”

Prior to their outing, Shelton made a solo appearance at the CMAs. His ex-wife Miranda Lambert, 31, also stepped out for country music’s big night, although the former spouses did not interact.

Stefani and Shelton touched down in Tennessee Tuesday on the same flight, a source told PEOPLE.

Romance rumors gained steam after they were spotted leaving Jared Leto’s Halloween party in Los Angeles.