Directly to content
  1. Publishing |
  2. Search |
  3. Browse |
  4. Recent items rss |
  5. Open Access |
  6. Jur. Issues |
  7. DeutschClear Cookie - decide language by browser settings

Multilingual research projects: Challenges for making use of standards, authority files, and character recognition

Arnold, Matthias

[thumbnail of Arnold_Multilingual_research_2021.pdf]
Preview
PDF, English - main document
Download (5MB) | Lizenz: Rights reserved - Free Access

Citation of documents: Please do not cite the URL that is displayed in your browser location input, instead use the DOI, URN or the persistent URL below, as we can guarantee their long-time accessibility.

Abstract

Academic research about digital non-Latin script (hereafter: NLS) research data can pose a number of challenges just because the material is from a region where the Latin alphabet was not used. Not all of them are easy to spot. In this paper, I introduce two use cases to demonstrate different aspects of the complex tasks that may be related to NLS material. The first use case focuses on metadata standards used to describe NLS material. Taking the VRA Core 4 XML as example, I will show where we found limitations for NLS material and how we were able to overcome them by expanding the standard. In the second use case, I look at the research data itself. Although the full text digitization of western newspapers from the 20th century usually is not problematic anymore, this is not the case for Chinese newspapers from the Republican era (1912-1949). A major obstacle here is the dense and complex layout of the pages, which prevents OCR solutions to get to the character recognition part. In our approach, we are combining different manual and computational methods, like crowdsourcing, pattern recognition, and neural networks to be able to process the material in a more efficient way. The two use cases illustrate that data standards or processing methods which are established and stable for Latin script material may not always be easily adopted to non-Latin script research data.

Document type: Preprint
Place of Publication: Heidelberg
Date Deposited: 10 Dec 2021 12:12
Date: 2021
Faculties / Institutes: Service facilities > Exzellenzcluster Asia and Europe in a Global Context
Philosophische Fakultät > Institut für Sinologie
Service facilities > Heidelberg Center for Transcultural Studies (HCTS)
DDC-classification: 004 Data processing Computer science
020 Library and information sciences
400 Linguistics
490 Other languages
890 Literatures of other languages
950 General history of Asia Far East
Controlled Keywords: Mehrsprachigkeit, Metadaten, Optische Zeichenerkennung, Segmentierung
Uncontrolled Keywords: language bias; multilingual and non-Latin script research data; metadata standards; document layout analysis; optical character recognition; page segmentation
About | FAQ | Contact | Imprint |
OA-LogoDINI certificate 2013Logo der Open-Archives-Initiative