Wilmer Ortiz Torres is a former member at Iglesia Pentecostal De Bethlehem and faces arson and related charges over the April fires.
The (Allentown) Morning Call says 43-year-old Torres waived his right to a preliminary hearing on Thursday and then spoke briefly with reporters.
When asked if he set the fires, Torres replied yes and that he was "mad at God." His attorney declined to comment.
Northampton County District Attorney John Morganelli says Torres, who remains in jail, has "some mental health issues."
Police say Torres held a grudge against the church that "festered and festered."
The first fire gutted the church's sanctuary. A second fire damaged the roof. No one was injured.
Information from: The Morning Call, http://www.mcall.com
Copyright 2019 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.