Hermione House was built in 1855 and now serves as the headquarters for the Madison Historical Society, Inc., and home to Madison Parish History. The antebellum home was completely restored as a museum and donated to the Historical Society in 1997. It showcases period pieces and exhibits depicting the history of the parish, including artifacts from the Civil War and also from the ancient Indian civilizations that once populated the area. Madison Parish is also the birthplace of Madam C. J. Walker, a self-made millionaire. Born Sarah Breedlove in 1867 to sharecropper parents in Delta, Louisiana, Walker built her wealth in cosmetics and used her prominence to support civic, educational, and social aid for African Americans. Her birth home has been preserved and currently serves as the Delta City Hall.

To preserve, present and promote Madison Parish, Louisiana history using the facilities of Hermione Museum as a depository for artifacts and records.

Society began in 1993 by three people. In one year the membership was 12. These were charter members of Society. Current membership 89.

Museum building Hermione House was donated to the Society in 1997 and began operation as a museum January 1 2000. Building was a home built in 1855 near location of Milliken's Bend, the site of the Civil War Battle, "The battle of Milliken's Bend" involving General Grants forces and General Walker of the Texas Rangers in 1863. This campaign was a part of Grant's siege of Vicksburg (eighteen miles east of Milliken's Bend and in Mississippi. Hermione House was used as Grant's hospital and was spared the torch.