The Veteran's Administration will provide a military tombstone. Contact them for information and the necessary paperwork.

Also, the graveyard management, if a larger facility, usually have the application forms and will assist you in obtaining the stone.

A local Federal CW veterans sons organization may assist in setting the stone and providing the proper service. Sorry, but I do not know
the correct title of the group. Could be Sons of Union Veterans.

Best wishes