Investigators were reviewing images recorded by surveillance cameras in the area, the chief said.
A pile of rubbish on a post office loading dock was ignited just after 7 p.m. Saturday, authorities said.
It raised immediate concerns, Batelli said, because it was "in close proximity to a building, unlike the others.
"We take these incident seriously because of the potential damage that could occur and the danger of volunteers of fire equipment going to a scene that is false," he said.
"Simply because of the minor nature of these fires they should not be taken lightly."
The aronist wasn't doing it for profit "but most likely for the thrill of setting a fire," Batelli said.
Anyone with information that could help the investigation is asked to call Mahwah police: (201) 529-1000.
Click here to follow Daily Voice Mahwah-Ramsey and receive free news updates.