Sylvester Wilcox was born in 1782. He married Abigail Bacon (b. 1784), and they had two daughters, Rebecca Wilcox Birdsey (1805-1888) and Ansta Wilcox Coe (1807-1895).