The fire, which began early Wednesday morning badly damaged the home, which was torn down late Wednesday night after firefighters cleaned out the house.
The Fire Department said an engineer from an insurance company did an assessment and deemed the house not structurally sound.
On Thursday, the house was a pile of rubble, as crews worked to clear debris. No one was inside the house at the time of the fire, Assistant Chief Matthew Scarduzio said.
Firefighters do not know what caused the fire or where the fire began. Scarduzio said the fire did not appear to be suspicious, but nothing has been ruled out.
Scarduzio said the owner of the home was taking his son to college, while the owner's brother, who also lived in the house, was staying at his mother's in Ossining at the time of the fire.
One firefighter was taken to the hospital for smoke inhalation, but he was treated and released, Scarduzio said.
"The fire was always ahead of us," Scarduzio said. "The house was loaded with a lot of stuff. It was hard to gain access."
Click here to follow Daily Voice Ossining and receive free news updates.