And so it was. “The Manor” traces the history of the house and its inhabitants, quickly leaving the garden behind to explore archaeology and research that range from West Africa to Barbados and back to Shelter Island. When Griswold stumbled upon the place, it was inhabited by Andrew and Alice Fiske, descendants of the original owners, Nathaniel and Grizzell Sylvester. Called Sylvester Manor, the house had been in the family in an unbroken line since the 1650s, providing an extraordinary lens with which to view a complex American story about (among other things) race, religion and the history of slavery in the North — largely documented.
Somehow deeds, charters, letters and other crucial historical documents, dating back to 1666, were simply kept in an album by the Fiskes, many of them in the original envelopes. The first document Andrew Fiske shows to Griswold is a charter from Richard Nicolls, the first governor of what became New York, describing how the island was purchased by Nathaniel and his brother Constant. “Why isn’t this incredible document about the very earliest colonial history of this country in a museum or a library?” Griswold wonders. “Like the several hundred acres of open land that Andy still owns, reduced from the original 8,000-acre domain, the creased old charter has survived intact for more than three centuries through a combination of design and accident and pure luck.”
Griswold picked up this find and gradually guided others to it, first through her own research, then through her instrumental role in bringing an archaeological team from the University of Massachusetts at Boston to carry out a dig starting in 1997 (the cataloguing of the materials found continues to this day). Ultimately Alice Fiske endowed the Andrew Fiske Memorial Center for Archaeological Research at U.Mass in honor of her late husband, who had worked so hard to preserve the history of the land and house.
The Fiskes seemed unperturbed by the racism and slave labor that helped build and maintain the house (in fact, Griswold notes late in the book, Alice does not invite any black residents of Shelter Island to the house). This aspect of the house’s history is the primary theme that Griswold follows from West Africa to Barbados to the United States. While slavery was not as long-lived or pervasive in the Northern United States (by 1840, virtually all slavery was below the Mason-Dixon line, and it had been abolished above the line), it did shape Northern life as well as Southern.
The book is strong in its vivid and compassionate description of the horrors of the slave trade. No matter how many times one has read about the middle passage, an explicit description never fails to horrify, and Griswold hits hard with it. She is also careful to note black resistance to slavery, particularly in Barbados. And she also makes clear the gradual, step-forward, step-back way that abolition came to the North. The Sylvesters exemplified some of the paradoxes of that process — they were Quakers, once hosting George Fox, the founder of the faith, at their home. But their faith did not move them to free their slaves for many years. As Griswold puts it, “Everything depended on the Sylvesters’ needs and wishes, which would trump Quakerism.”
Griswold’s passion for her subject is obvious, and the degree to which the history of the house has been preserved is impressive, but it’s easy for the reader to get lost in the many names, journeys, digs, historians, historical figures et al. While an exclusive focus on slavery might have been too narrow, Griswold’s focus is a little too wide.
Even so, history buffs will love “The Manor,” and it tells a story that needs to be told. As for Sylvester Manor, its tale continues. The house still stands on Shelter Island, brought to new life by a new generation. It now functions as an organic farm and history museum — a far cry from its original roots and a suitable new act for a remarkable relic of American history.
’s most recent novel is “The Taste of Salt.”