According to Indian legend, Rabun Bald Mountain is inhabited by fire-breathing demon people. Campers and other visitors often report hearing strange sounds throughout the night.

Tallulah Gorge is located in Rabun County and is 1,000 feet deep. The river feeding its waterfall was diverted through a tunnel in the 1930s, when a power plant was built there. The waterfall was recently reactivated, and is the highest in the state.

Rabun County is bounded on the west by the mountain ridges of the Appalachian Trail. The Tallulah River, which flows through Lakes Burton, Seed and Rabun to join the Tugaloo River, forms a central pass through the mountains. This, and surrounding areas, were ruled by Chief Attakullakulla, "Little Carpenter," who mediated early conflicts between the Cherokee Indians and the white settlers.