Take your digital camera and a steady hand!
Fort Delaware and the Civil War prison camp were located on Pea Patch Island in the middle of the Delaware River with about a mile of water on either side. There is a 6-9 foot tidal surge up the river passing Pea Patch Island every 12 hours - you can acutally see the water rushing up river. So his being swept up-river to New Castle was entirely possible.
Hugh