The unidentified owner and pooch were walking along Wallace Drive in Leonard Park in the biting cold when the latter went to get a sip of water from the pond, police said.
The dog went in, and his owner waded in after him, police said.
By the time rescue units arrived, both were back on dry land, police said.
Police said the man was given a blanket and checked over, but declined further medical attention.
They are warning folks that, despite the frigid temperatures of late, most ponds and lakes do not have ice that is thick enough to safely walk on.
Click here to follow Daily Voice Mt. Kisco and receive free news updates.