Robert Grembowiec, 49, apparently became upset over a water cooler that leaked in front of his apartment door, according to Capt. Darren DeWitt, the officer in charge of the department.
Grembowiec knocked on her door and she opened it on Monday holding her 9-month-old child, the captain said.
Grembowiec then hit her several times on the arm with a mini souvenir baseball bat, he said.
The woman went to Hackensack University Medical Center after complaining of pain in her arm, DeWitt said.
Police arrested Grembowiec on aggravated assault and child endangerment charges. They also seized the bat as evidence.
Grembowiec has a criminal history that stretches back to 1994 in New Jersey and Florida.
Offenses with convictions -- and either jail or prison time -- have included mostly burglary, but he's also been arrested over the years on charges that include grand theft, trafficking in stolen property and drug possession, records show.
Grembowiec remained held Wednesday in the Bergen County Jail pending court action.
Click here to follow Daily Voice Hackensack and receive free news updates.