Dr. Dudley Woodbridge graduated with a medical degree from Harvard in 1724. He would go on to become a successful physician in Mystic, CT, where he began the building of Whitehall Mansion in 1771. The home was completed in 1775, where he lived with his wife and nine children. All of his children would marry and move out of the home except two, one having died at 12 years of age. Woodbridge passed away in 1790 and his wife six years later.