Silver Lake was originally called Stebblings' Pond after Benjamin Stebblings who owned land at the outlet where the Barnard General Store now stands. When Benjamin Stebblings moved out of the area, the lake became known as Barnard Pond. In 1869, Barnard Pond was renamed Silver Lake.