Gloria --

There is a William Rogers about that age living in Anne Arundel Co. in 1860, but there are a couple of others in the state who could be the one you described. Reviewing Mississippi records through 1880, I find no one who appears to match.