Celebrity Parents Biden's Grandkids Joined at White House After Inauguration — and Baby Beau Danced with President President Joe Biden held his grandson Beau while dancing along to Demi Lovato's performance of "Lovely Day" By Benjamin VanHoose Benjamin VanHoose Twitter Benjamin VanHoose is an Associate Editor on the Movies team at PEOPLE. He's worked at PEOPLE for over three years as a writer and reporter across our Entertainment, Lifestyle and News teams, covering everything from the Johnny Depp v. Amber Heard trial to the Oscars. He regularly covers red carpet events and has interviewed stars like Drew Barrymore, Ryan Reynolds and Kirsten Dunst. He previously worked as a copy editor at Topix Media Lab. People Editorial Guidelines Published on January 21, 2021 02:42 PM Share Tweet Pin Email President Joe Biden celebrated his inauguration by snuggling up with his 8½-month-old grandson. After the swearing in ceremony on Wednesday, the 46th president of the United States watched the Tom Hanks-hosted TV special featuring musical performances, with his grandchildren and wife Dr. Jill Biden at his side. During Demi Lovato's performance of Bill Withers' "Lovely Day," Biden, 78, could be seen holding his baby grandson while gently dancing along. The boy is Hunter Biden's son with his wife Melissa Cohen, whom they named after his late brother Beau Biden, who died from brain cancer in 2015 at age 46. The moment came hours after Biden took the oath of office with his large family watching beside him at the U.S. Capitol. In an inaugural address blending hope and certainty in democracy Biden declared: "This is America's day. This is democracy's day." getty images "Let's start afresh — all of us," Biden said, repeatedly urging unity as he has since first launching his presidential campaign in 2019. "Stop the shouting and lower the temperature. Without unity, there is no peace. Only bitterness and fury." The multiple generations of his family observed a fireworks display Wednesday night to cap off the Inauguration Day festivities, standing on the Truman Balcony to watch the captivating display of fireworks over the White House and the National Mall. Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories. RELATED GALLERY: A Peek at the Bidens Celebrating in the White House and More Notable Moments from the Inauguration Special In photos taken of Biden in the Oval Office after his inauguration, several family pictures can be seen arranged behind the Resolute Desk, including a 2009 shot of his late son Beau. Another photo of Biden with the incoming first lady sat next to it. On Tuesday, a day before the inauguration, Biden gave an emotional departure speech at the National Guard Reserve Center in Delaware named for his late son. "I only have one regret, he's not here," Biden said of Beau, "because we should be introducing him as president." In January 2020, he said during a segment on MSNBC's Morning Joe that "Beau should be the one running for president, not me." On Wednesday, with Beau's photo behind him, Biden began his term as president by signing several executive orders. Among those: a mandate requiring face masks on all federal property and during interstate travel, support for underserved communities and rejoining the Paris climate agreement.