Castle Pickney Located on Shutes Folly, a small island about one mile off the Charleston shore in the harbor sits a small masonry fortification called Castle Pickney. Constructed by the United States government in 1810 it was used briefly as a prisoner-of-war camp and artillery position during the American Civil War. Some say the fort never fired a single hostile shot during its existence. Today the fort has gone through some r estoration efforts but with its location access is difficult and it is gradually being reclaimed by nature.