Granby is the least populated incorporated town in the state, with 83 in the last census. The town has never been more than some buildings gathered around some Mills. As time and timber for the mills disappeared so did the population. At one point in Granby's history the population got so low they had to give up their incorporation, but regained it in 1822.