I had an ancestor with the Virginia State Line Moccasin Rangers', who was in the same shipment of CSA POW's as your ancestor. They were sent by rail to Baltimor and then south by Steamer to City Point.

The Official Records of the War of Rebellion discuses their journey. Evidently a number of the prisioners were afflicted with Small Pox.