In 1868, five hundred dollars in tax funds were appropriated for the Milford Free Library, the first public library in Milford, New Hampshire. Located in the town hall, the postmaster also served as librarian. When a new town hall was completed in 1870, town offices and the library were relocated there.

In 1932, Fannie Boynton Wadleigh created a trust fund of $100,000 to be used to build a new library in memory of her husband, William Y. Wadleigh. Planning did not begin until 1943 for a site on a piece of land, a gift from the Lull estate, located on Nashua Street across from the town hall. Work on the new library began in 1949, and the Wadleigh Memorial Library opened its doors on July 19, 1950.

In 1986, an addition was added that was designed to serve a population of 12,000 and last 20 years. When the library opened in 1950 there were approximately 18,000 volumes. Today the library houses about 70,000 books, nearly 200 magazine and newspaper subscriptions, over 3,000 films, documentaries, and television series, and over 2,000 music CDs.

Presently the town is involved in a “Library Expanovation Project” which will create an expanded and improved facility that will serve the needs of library patrons and community.