But Andrews's decision to leave comes as he's faced years of allegations that he violated House rules and federal law by using campaign funds to pay for personal trips to Scotland and Los Angeles and by using a graduation party for his daughter to raise campaign cash.