Quote
J. Munkelt, “Creation of a DNB Retrieval Test Collection.” Cologne: Institute for Information Science at the Technical University of Cologne, 2018 [Online]. Available: https://publiscologne.th-koeln.de/frontdoor/deliver/index/docId/1210/file/BA_Munkelt_Johanna.pdf
Content
Since fall 2017, the German National Library has been using a fully automated process to catalog the content of certain media works. The quality of this process, which can significantly shape the way libraries organize their workflows, is the subject of heated debate among experts. Their viewpoints are first explained in sufficient detail before the necessity of a quality assessment of the process and its underlying principles is outlined. A central component of a future assessment is a test collection. This paper focuses on its creation and documentation. In this context, the history of its development and the requirements for successful test collections are also addressed. Finally, a retrieval test is conducted to demonstrate the operational feasibility of the developed test collection. Its results serve exclusively to verify functionality. A quality assessment of automated content indexing—either specifically or in general—is not performed and is not the objective of this study.
References and Relationships
URN urn:nbn:de:hbz:79pbc-opus-12107