Alan Falcone, who was taken into custody at his sister's house on Saturday, is charged with attempted murder and weapons offenses.
He remained held pending extradition to New Jersey.
Falcone is the ex-boyfriend of a girl that the victim was dating, law enforcement officials told Daily Voice.
The Burns Avenue victim remained in critical but stable condition Sunday at Hackensack University Medical Center after just after midnight Thursday.
"He has no movement in the lower half of his body," a senior law enforcement officer said. "He's likely to be paralyzed for life."
Click here to follow Daily Voice Garfield-Lodi and receive free news updates.