 He was the son of Abel Chittenden (1779–1816) and Anna Hart (née Baldwin) Chittenden (1784–1845).His siblings included Henry Baldwin Chittenden and Sarah Dudley Chittenden, both of whom died young.He attended Guilford Academy.