Russell Dawson was being held on $50,000 bail in the Bergen County Jail following the incident at a Kansas Street apartment building around 8:45 p.m.
Police were trying to determine what caused the argument that led to Dawson hitting the neighbor with the bottle, shattering it.
She was taken to Hackensack University Medical Center.
Dawson, meanwhile, was arrested without incident on charges of aggravated assault and weapons possession.
(An earlier version of this story misidentified the victim.)
MUGSHOT: Courtesy BERGEN COUNTY SHERIFF
Click here to follow Daily Voice Hackensack and receive free news updates.