Enabling Search for Facts and Implied Facts in Historical Documents

Keywords

fact extraction, implied facts, historical documents

Abstract

Building a database of facts extracted from historical documents to enable database-like query and search would reduce the tedium of gleaning facts of interest from historical documents. We propose a solution in which historical documents themselves constitute the stored database. In our solution, we use information-extraction techniques to produce a conceptualized external annotation of facts found in each document, and we superimpose the conceptualization over the document collection. The annotation process populates the conceptualization producing a repository of extracted facts, and a reasoner obtains inferred facts from these extracted facts. Our query interface accepts free-form queries and converts them to formal queries over the extracted and inferred facts. Displayed results include, in addition to standard query results, images of original documents with results highlighted along with reasoning chains for inferred facts grounded in these highlighted facts. Along with giving the implementation status of our proof-of-concept prototype, we present results for extraction accuracy and efficiency and point to current and future work needed to enable a practical solution for the envisioned historical-document database.

Original Publication Citation

D.W. Embley, S.W. Liddle, D.W. Lonsdale, S. Machado, T. Packer, J. Park, N. Tate, and A.Zitzelberger (2011). Enabling Search for Facts and Implied Facts in Historical Documents. Proceedings of the International Workshop on Historical Document Imaging and Processing (HIP 2011), Beijing, China, pp. 59-66

Document Type

Peer-Reviewed Article

Publication Date

2011

Publisher

Historical Document Imaging and Processing

Language

English

College

Humanities

Department

Linguistics

University Standing at Time of Publication

Associate Professor

Share

COinS