By Jodi Guglielmi
Updated November 09, 2016 03:44 PM
Credit: Charley Gallay/Getty

Brad Pitt is willing to do whatever it takes to see his children — even if that means going through a complicated custody battle.

“The last few weeks have been tough for Brad,” a source close to the family tells PEOPLE in this week’s issue. “He has been very unhappy with the arrangement to see his kids.”

On Nov. 4, Pitt made that clear when he filed a response to Angelina Jolie‘s divorce petition and asked to share joint physical and legal custody of Maddox, 15, Pax, 12, Zahara, 11, Shiloh, 10, and 8-year-old twins Knox and Vivienne. Jolie has requested sole physical custody, with visitation for Pitt.

For now, per a temporary recommendation by L.A.’s Department of Children and Family Services, which has been investigating the family following allegations Pitt was verbally and physically abusive towards their son Maddox, Pitt has only been able to see their kids during supervised visits.

“Brad doesn’t want supervised visits,” says the source. “He loves his kids and wants to spend more time with them.”

The exes’ custody battle got even more complex this week. On Monday, a rep for Jolie, 41, released a new statement saying that the former couple have reached a legal agreement about the custody of their six children: Maddox, 15, Pax, 12, Zahara, 11, Shiloh, 10, and 8-year-old twins Knox and Vivienne. The statement said the children “will stay in their mother’s custody” and “continue therapeutic visits with their father.”

However, other sources close to the situation maintain the pair have not reached any new agreement or permanently settled their differences, and Pitt still plans to push for joint custody.

On Tuesday, Pitt stepped out to a public event for the first time since the split, attending a private screening of the movie Moonlight (which his company Plan B produced) in Los Angeles, where he was joined by longtime pal and Ocean’s costar Julia Roberts. He is also set to appear at the red carpet premiere of his World War II spy drama Allied on Wednesday.