Reading a few diary entries later, I believe that 'S M' means 'School Marms'.

These were Northern ladies who went South to educate the children of former slaves. You can compare them to a 19th-century Peace Corps going into uncivilized and destitute parts of the world.

Isaac Knapp was more than a little curious about these woman and what in heaven's name they were doing in North Carolina.