Joseph Williams is buried at the Ebenezer Presbyterian Church Cemetery, near Midway, Georgia. His tombstone reads: “In Memory of Rev. Joseph Williams – Founder of Presbyterianism among the colored people of Georgia – Born in Providence Island West Indies A. D. 1805 – Died at Riceboro Ga U.S.A. Nov. 22, 1899.”