The 52-year-old actor was in Turks and Caicos over the holiday, enjoying a weekend getaway with a friend at the popular celeb resort the Amanyara Villas.
“Brad had a very restful and relaxing stay in the company of an old friend,” the insider told PEOPLE.
The children — Maddox, 15, Pax, 12, Zahara, 11, Shiloh, 10, and 8-year-old twins Knox and Vivienne — spent their Thanksgiving with Jolie.
In years past, Pitt and Jolie had prioritized spending the holidays as a family.
“Every event is cherished,” Plan B exec Dede Gardner previously told PEOPLE. “Every birthday is cherished. The holidays are cherished. Events are made of every moment in the most positive way.”
Jolie requested sole physical custody of the children during her Nov. 4 divorce petition, while Pitt has filed a response asking to share joint physical and legal custody.
RELATED VIDEO: Brad Pitt Makes First Red Carpet Appearance Since Angelina Jolie Split at Allied Premiere
Complicating matters were allegations made that Pitt got physical with 15-year-old Maddox on the family’s private jet in September. Pitt was cleared by the FBI of the charges. The Los Angeles Department of Children and Family Services (DCFS) also concluded its investigation into the incident earlier this month with no findings of abuse.
For the past several weeks, the children have been living with Jolie with supervised visitation for Pitt — per a temporary recommendation by DCFS.
Pitt “has been very unhappy with the arrangement,” a source recently told PEOPLE. “He loves his kids and wants to spend more time with them.”