 From 1964 to 1994, he was a member of the Maharashtra Legislative Council; during that time, he was Deputy Chairman of the Legislative Council from 1968 to 1978, Chairman from 1978 to 1984, and twice Leader of the Opposition of the Legislative Council from 1986 to 1988 and from 1990 to 1991.In 1998, Gavai was elected to the 12th Lok Sabha from Amravati.He was member of Rajya Sabha from Maharashtra State April 2000 till April 2006.