But if they request them, you have to produce them or you may end up owing additional tax and/or penalties.” Generally, the Internal Revenue Service says you should keep tax records for three years from the date you filed your original return, or two years from the date you paid the tax, whichever is later.