Jason Parris, 34, was stopped on Hudson Avenue for a traffic violation around 11:55 a.m., police said.
When officers checked his license they found he was driving on a suspended license and that his license had been suspended five times in the past, police said.
During his arrest, police also found the gravity knife and a quantity of an alleged controlled substance, police said.
He was charged with aggravated unlicensed operation of a vehicle; criminal possession of a controlled substance and criminal possession of a weapon.
Parris is being at the Rockland County Jail on $2,500 bail.
Click here to follow Daily Voice Tappan-Blauvelt and receive free news updates.