Li, talking during a China-Japan dialogue on Tuesday, said there had been improvements in the relationship but the foundations were still not solid, according a government statement published on Wednesday.