The Surgeons' Quarters, though not within the stockade area of Fort Winnebago, is its only remaining building. It was originally owned by Francois LeRoi, who operated a portaging business and probably built it before 1824. He sold it to the army in 1828. For six years it was a sutler's store and then in 1834 remodeled as a home for Post medical officers and their families.

That same year a hospital was built nearby. After the evacuation of the Fort, the Surgeons' Quarters was sold and occupied for about eighty years by a succession of families who altered it to suit their respective needs, including using the hospital as a barn.