This pavilion was designed by Landis Gores, of the famous Harvard Five group of modern architects. His clients were Jack Irwin, U.S. ambassador to France and an Undersecretary of State, and his wife, Jane Watson, whose father was the founder of IBM. Designed as a pool house and personal lodge for the Irwins, it is set about a hundred yards from the Irwins' more conventional house, in New Canaan's Irwin Park. When it was threatened with demolition in 2006, supporters of modern architecture, led by the Historical Society, rallied to protect it.

The Gores Pavilion now serves as a museum and cultural center highlighting the legacy of New Canaan's modern architects and architecture. It offers exhibit and meeting space for artists, students, and town residents. It is also a symbol of the New Canaan Historical Society's commitment to raising awareness of and protecting our Town's extensive modern heritage.