CHICAGO (AP) — The federal judge assigned to the case against Dennis Hastert will continue to preside over it after disclosing connections to the former U.S. House Speaker and several attorneys.

Prosecutors and lawyers for Hastert filed paperwork Thursday saying they’re willing to have U.S. District Judge Thomas Durkin remain on the case.

Durkin donated $500 in 2002 and $1,000 in 2004 to Hastert’s campaign. Before becoming a judge he also worked with attorneys from both sides and with Hastert’s son.

Durkin said during Hastert’s Tuesday arraignment that he believed he can be impartial but lawyers could decide whether he should be replaced.

Hastert is accused of agreeing to pay $3.5 million to keep past misconduct secret. He pleaded not guilty to charges of violating banking laws and lying to the FBI.