The Old Jail Museum on Milstead Avenue, the headquarters of the Rockdale County Historical Society, not only exhibits many fascinating artifacts that give a peek into the fabric of everyday life in Rockdale centuries ago as a mill and agricultural society, but is also an important piece of Rockdale history itself. It was built in 1897, was used all the way up until 1969 and served as the living quarters of the sheriff and his family in one part of the building. Peep holes allowed the sheriff to peer in from the living quarters of the building to the jail portion of the building.