The fire, which began around 6:30 a.m. Tuesday, is believed to have started in the basement, but the building quickly became engulfed in smoke, with smoke coming out of the top of the building.
The Dutchess County Sheriff's Office said they have investigators on the scene.
The Library's Board said that even amid the fire, it wanted to remind residents to vote as the library's budget is on the ballot.
"Your vote today is much more critical," they wrote. "We will do all we can to save the books and the building and when the fire is out we will immediately begin rebuilding."
This continues to be a developing story. Check back to Daily Voice for updates.
Click here to follow Daily Voice Southwest Dutchess and receive free news updates.