The 30 Rock actor was handcuffed after going the wrong way down Manhattan's Fifth Avenue
Credit: Elder Ordonez/INF

Police took Alec Baldwin into custody Tuesday morning after he rode his bike in the wrong direction down a New York City street.

Baldwin, 56, was handcuffed and transported to the station in a patrol car, a source close to him tells PEOPLE, adding that he is now back home with his family. A law enforcement source says Baldwin, who was not carrying an ID, was issued two summonses before being released and will be fined.

The 30 Rock star took to Twitter on Tuesday afternoon to give his side of the story, criticizing the NYPD – along with the press.

“Officer Moreno, badge number 23388, arrested me and handcuffed me for going the wrong way on Fifth Ave,” he wrote. “Meanwhile, photographers outside my home ONCE AGAIN terrified my daughter and nearly hit her with a camera. The police did nothing. New York City is a mismanaged carnival of stupidity that is desperate for revenue and anxious to criminalize behavior once thought benign.”

Despite Baldwin’s angry Tweets, the source says the actor “calmly got into the police car and went to the police station,” adding that the incident “transpired very quickly.”

Baldwin has hit a rough patch in public life lately: He was fired from his own MSNBC show in November and has scuffled with paparazzi, allegedly using homophobic slurs during the incidents.

Earlier this year, Baldwin published an essay in New York magazine accusing the city of changing for the worse – and vowing to move to Los Angeles.