According to the United States Census Bureau, the town has a total area of 174.3 km² (67.3 mi²). 174.2 km² (67.2 mi²) of it is land and 0.2 km² (0.1 mi²) of it is water. The total area is 0.10% water.
As of the census of 2000, there are 4,666 people, 1,881 households, and 1,269 families residing in the town. The population density is 26.8/km² (69.4/mi²). There are 4,174 housing units at an average density of 24.0/km² (62.1/mi²). The racial makeup of the town is 96.25% White, 1.59% African American, 0.24% Native American, 0.39% Asian, 0.09% Pacific Islander, 0.19% from other races, and 1.26% from two or more races. 1.05% of the population are Hispanic or Latino of any race.
There are 1,881 households out of which 27.1% have children under the age of 18 living with them, 56.7% are married couples living together, 7.0% have a female householder with no husband present, and 32.5% are non-families. 28.3% of all households are made up of individuals and 12.8% have someone living alone who is 65 years of age or older. The average household size is 2.35 and the average family size is 2.87.
In the town the population is spread out with 22.4% under the age of 18, 7.3% from 18 to 24, 25.4% from 25 to 44, 26.9% from 45 to 64, and 18.0% who are 65 years of age or older. The median age is 41 years. For every 100 females there are 105.2 males. For every 100 females age 18 and over, there are 104.2 males.
The median income for a household in the town is $36,379, and the median income for a family is $41,923. Males have a median income of $30,767 versus $23,561 for females. The per capita income for the town is $19,003. 12.0% of the population and 7.5% of families are below the poverty line. Out of the total people living in poverty, 17.3% are under the age of 18 and 5.3% are 65 or older.