Local resident Matt Moyer streamed from the scene live on Facebook around 9:30 a.m., calling the incident a hostage situation.
Initial reports given to police said that the suspect had held the children at gunpoint and was armed with a handgun, according to police.
The suspect had already fled the scene on the 1200 block of Market Street on Monday when patrol units arrived, Harrisburg police said.
The Dauphin County Crisis Response Team was called to help insure the children were safe.
The unidentified suspect has turned themselves in to authorities and is facing domestic violence related charges, according to police.
Click here to follow Daily Voice Lower Paxton and receive free news updates.