RealKIE: Five Novel Datasets for Enterprise Key Information Extraction
Benjamin Townsend Madison May Christopher Wells
We introduce RealKIE, a benchmark of five challenging datasets aimed at
advancing key information extraction methods, with an emphasis on enterprise
applications. The datasets include a diverse range of documents including SEC
S1 Filings, US Non-disclosure Agreements, UK Charity Reports, FCC Invoices, and
Resource Contracts. Each presents unique challenges: poor text serialization,
sparse annotations in long documents, and complex tabular layouts. These
datasets provide a realistic testing ground for key information extraction
tasks like investment analysis and legal data processing.
  In addition to presenting these datasets, we offer an in-depth description of
the annotation process, document processing techniques, and baseline modeling
approaches. This contribution facilitates the development of NLP models capable
of handling practical challenges and supports further research into information
extraction technologies applicable to industry-specific problems.
  The annotated data and OCR outputs are available to download at
https://indicodatasolutions.github.io/RealKIE/ code to reproduce the baselines
will be available shortly.