Francis (Frank) Bannerman VI, father of the “Army and Navy” store, was born in Dundee, Scotland in 1851 and came to the United States to live in Brooklyn, at the age of three. His father, Francis V, was a seaman in the United States Navy during the Civil War. Young Frank, while still in school, found work to support the family, collecting scrap from the nearby harbor. When his father returned from service, they increased their wares by buying surplus stock at government auctions. Founded in Brooklyn in 1865, the business known as the “Bannerman’s” continued to grow. As more material was acquired, the business moved several times, until finally settling at 501 Broadway, Manhattan in 1905 where it became a mecca for collectors and sportsmen for the next 54 years.

In December 1898, when the Spanish-American war ended, Bannerman made a trip to Havana, Cuba and was successful in purchasing almost all of the captured Spanish arms and ammunition. With the warehouses overflowing and restrictions from city laws, Bannerman searched for storage outside city limits for their military surplus. They found Pollepel Island, a small rocky island a few miles north of West Point in the Hudson River and purchased it in 1900. In 1901 Bannerman began the construction of his island arsenal and simple residence, designing the plans on scrap paper and fashioning the buildings in the shape of Scottish castles that reminded him of his heritage. Equipment of every description as well as ammunition was shipped to the Arsenal for storage until sold.

During World War I he contributed cannons, uniforms, and blankets to the U.S. government. Bannerman also outfitted many important entertainment acts and various organizations during the early 20th century. They include Buffalo Bill’s Wild West Show, Pawnee Bill’s Wild West Show, Grand Army of the Republic, and many cadet and boys organizations. But with the change of state and federal legislation, the early 20th century saw Bannerman’s sales of military weapons to civilians decline.

The Island Arsenal construction ceased in 1918, with the death of Francis Bannerman VI. Interest in maintaining the castle declined and the structures have suffered some major damage since. In 1920, the Island Armory was partly destroyed when an ancillary structure with 200 pounds of shells and powder exploded. After the ferryboat servicing the island sank in 1950, the Arsenal and island were left vacant. The island and buildings were acquired by the State of New York in 1967, and for a short time there were guided tours of the island, until a fire devastated the Arsenal in 1969 leaving it structurally unsafe. Mostly in ruins, portions of the exterior walls still stand including part of a wall advertising the “Bannerman Island Arsenal”. Currently under the care of “The Bannerman Castle Trust, Inc.”, the non-profit organization is dedicated to stabilizing the remaining structures and raising awareness of the island’s value and history.