Walker and Milwaukee Mayor Tom Barrett have previously clashed when the state in 2012 used some of the money from a mortgage industry settlement to plug a budget hole rather than address foreclosed homes.