Cave Spring The former East Tennessee Virginia and Georgia depot at Cave Spring was built around 1880; it later served ETV&G successor Southern Railway. (On Alabama Street west of downtown). Cave Spring is a city of 989 in southwestern Floyd County in northwest Georgia.   Georgia's Railroad History & Heritage. Copyright, Steve Storey. Railroad History | The Depot List | Locomotives On Display | Odds & Ends | Sources & References | Home