The previous generations were part of the Separatist and Pietist movements that came to America. They were seeking escape from severe persecution for not agreeing to follow the rules and practices of the European State church. In one account, descendants of those who fled to America, Reverend Isaiah Custer and his wife, Mary Watson Custer, were credited for being among the first settlers in Northern Adams County, choosing to locate in the small community that became Marble Furnace. They had traveled all the way from Germantown, Pennsylvania in the mid 1800's and then used their covered wagon as a residence until they harvested enough timber from the dense forest on their land to build a simple log cabin.

The marble in Marble Furnace referred to the white limestone found in the area that was used in constructing the iron furnaces. From a distance, the chimney of the main furnace, built out of the rock that had been "dressed and hammered," resembled a superior and beautiful grade of white marble.

Rev. Custer was soon gaining popularity, traveling on horseback between small settlements and villages in the area spreading the faith and beliefs of the Church of the Brethren. However, the establishment of a permanent church building for the Marble Furnace citizens became his passion.

An election was held on April 7, 1877, at which it was decided to build a permanent church. James Hooper agreed to donate the land with Custer providing a large part of the manual labor to construct the plain building. The church was remodeled and an annex addition project was completed in 1928. The church was connected to electric service in 1940.

Custer also had a hand in the development of Peebles Station as a community. He platted the area in 1881 where the railroad was to cross Zane Trace. The crossing contained an area for a structure to be built for use as a train station. The first train pulled into Peebles Station in 1882. That first building was destroyed by the Peebles fire of 1906 but was quickly rebuilt. Custer's Plat of Peebles is still being used today. His name appears on property deeds when a purchase and land transfer is in the 'Custer Division.'

As the monument's inscription suggests, the church was able to continue serving the area for many years but eventually became a victim of economics and other societal changes as well as the aging of its members. A report written for the Brethren Churches listed membership at fifteen in 1920. For comparison, by 2000, less than a handful of the church's members were left. That's when it was decided to permanently close the church by agreement with the executives of the Southern Ohio District Church of the Brethren.

Several items inside the church were donated to the Brethren Heritage Center located in Brookville, Ohio. The original minister's bench, speaker's table and deacon's bench are used in a display representing a meeting house layout. Many of the written administrative, program and financial records along with a small selection of photographs have been archived for future generations.

However, the church piano is another story. As plans were being made for demolition of the building, it was agreed the instrument had been used well throughout its life and was ready for retirement. The Heritage Center was limited in space, had no staff to take care of moving it, and no funding for the extensive restoration that would be needed. It was decided the piano should remain in its present location. After that area of the church was torn away and cleaned up, a hole was dug, and the piano was lowered down in, facing the same direction, looking toward the cemetery where many of the members are buried, including its last pianist, Burneda Bailey.

The monument was dedicated on July 25, 2004. The inscription reads:

"This site was home for the Marble Furnace Church of the Brethren from 1877 until 2003. The congregation was made up mostly of local farmers and area residents. The Brethren have a strong fundamental belief in God as taught by the Holy Bible. The church flourished for many generations. As the economic climate changed and the faithful died off the church began to decline in membership. In the year 2000 only four members remained.

It is hoped that as people pay their respects to their departed friends and family members at the adjacent cemetery, perhaps they will stop and reflect on their own salvation and belief in God."