Colbert is a city in Madison County, Georgia, United States. The population was 630 at the 2020 census. The Georgia General Assem…Colbert is a city in Madison County, Georgia, United States. The population was 630 at the 2020 census. The Georgia General Assembly first incorporated the place in 1899 as the "Town of Five Forks"; it was officially renamed "Colbert" in 1909 by a new act of legislature. The present name is after James Fletcher Colbert, an early settler.