"This is their first house together as a married couple, so it's a big deal," a source tells PEOPLE of Justin Bieber and Hailey Baldwin

Justin Bieber and Hailey Baldwin have found their love nest!

A source tells PEOPLE the couple, who wed in September 2018, has officially moved into their new Beverly Hills house together.

“This is their first house together as a married couple, so it’s a big deal. They worked with a designer to furnish the house. It’s a fun project for them,” the source says.

Last month, PEOPLE confirmed that the “Sorry” singer, 25, purchased a five-bedroom, seven-bathroom home in Beverly Hills for $8.5 million. The 6,132-square-foot property was originally listed for $8.995 million.

“They are both very excited about their new house. Right after they got married, they rented a house and then stayed at a hotel. It wasn’t the best situation. They couldn’t wait to find the perfect house,” the source adds.

In October 2018, an insider told PEOPLE the pair was renting a Spanish contemporary home in Toluca Lake for close to $100,000 per month. The house was recently listed for sale for $8.5 million, but, per the source, Bieber asked for a month-to-month rental contract instead of opting to purchase the home.

Credit: Broadimage/REX/Shutterstock

Bieber and Baldwin’s latest milestone in their marriage comes amid his decision to prioritize his mental health.

“Justin is still receiving treatments and working on his health. Sharing his struggles and thoughts with fans seems to have been very beneficial to him,” the source says. “He seems to feel less pressure and is able to focus on his health in peace.”

On Wednesday, Bieber shared a selfie on his Instagram Story during a therapy session. “It’s cool to have a healthy mind and emotions,” he captioned the photo.

Credit: Justin Bieber/Instagram

Just days before, Bieber wrote to his fans explaining that he would return to music after repairing some of his “deep-rooted issues” in treatment.

“So I read a lot of messages saying that you want an album .. I’ve toured my whole teenage life, and early 20s, I realized and as you guys probably saw I was unhappy last tour and I don’t deserve that and you don’t deserve that,” he wrote. “You pay money to come and have a lively energetic fun light concert and I was unable emotionally to give you that near the end of the tour.”

Bieber also noted that prioritizing his mental health came from the desire to “sustain” his marriage to Baldwin and live up to the expectations he had created for himself as a future father.