Custer grew out of the various mineral rushes of the 1870s. After a grass fire destroyed the nearby town of Bonanza, Custer grew even more populous. It was just a one street town, but it was stirring with men, women, and children. However, as the mining industry dried up and gold was was more scant, the town was deserted.

But thanks to a 1981 designation as a historic site, the ghost town was saved from obsolescence. Significant portions have been restored and docents are on site during the summer to provide historical information. A few private cabins, the town schoolhouse, and the Empire Saloon have been restored and maintained in their 19th century state. The saloon no longer offers libations, and docents have water for sale but nothing else, so carry food and water if you plan to stay a while.