Shamela: A Large-Scale Historical Arabic Corpus

Yonatan Belinkov; Alexander Magidow; Maxim Romanov; Avi Shmidman; Moshe Koppel

Shamela: A Large-Scale Historical Arabic Corpus

Yonatan Belinkov, Alexander Magidow, Maxim Romanov, Avi Shmidman, Moshe Koppel

Computer Science

Technion - Israel Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Arabic is a widely-spoken language with a rich and long history spanning more than fourteen centuries. Yet existing Arabic corpora largely focus on the modern period or lack sufficient diachronic information. We develop a large-scale, historical corpus of Arabic of about 1 billion words from diverse periods of time. We clean this corpus, process it with a morphological analyzer, and enhance it by detecting parallel passages and automatically dating undated texts. We demonstrate its utility with selected case-studies in which we show its application to the digital humanities.

Original language	Undefined/Unknown
Title of host publication	Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH)
Place of Publication	Osaka, Japan
Pages	45-53
Number of pages	9
State	Published - 1 Dec 2016

Access to Document

https://aclanthology.org/W16-4007

Cite this

@inproceedings{10c025c2360740fb80d2f200a5803c78,

title = "Shamela: A Large-Scale Historical Arabic Corpus",

abstract = "Arabic is a widely-spoken language with a rich and long history spanning more than fourteen centuries. Yet existing Arabic corpora largely focus on the modern period or lack sufficient diachronic information. We develop a large-scale, historical corpus of Arabic of about 1 billion words from diverse periods of time. We clean this corpus, process it with a morphological analyzer, and enhance it by detecting parallel passages and automatically dating undated texts. We demonstrate its utility with selected case-studies in which we show its application to the digital humanities.",

author = "Yonatan Belinkov and Alexander Magidow and Maxim Romanov and Avi Shmidman and Moshe Koppel",

year = "2016",

month = dec,

day = "1",

language = "!!Undefined/Unknown",

pages = "45--53",

booktitle = "Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH)",

}

TY - GEN

T1 - Shamela: A Large-Scale Historical Arabic Corpus

AU - Belinkov, Yonatan

AU - Magidow, Alexander

AU - Romanov, Maxim

AU - Shmidman, Avi

AU - Koppel, Moshe

PY - 2016/12/1

Y1 - 2016/12/1

N2 - Arabic is a widely-spoken language with a rich and long history spanning more than fourteen centuries. Yet existing Arabic corpora largely focus on the modern period or lack sufficient diachronic information. We develop a large-scale, historical corpus of Arabic of about 1 billion words from diverse periods of time. We clean this corpus, process it with a morphological analyzer, and enhance it by detecting parallel passages and automatically dating undated texts. We demonstrate its utility with selected case-studies in which we show its application to the digital humanities.

AB - Arabic is a widely-spoken language with a rich and long history spanning more than fourteen centuries. Yet existing Arabic corpora largely focus on the modern period or lack sufficient diachronic information. We develop a large-scale, historical corpus of Arabic of about 1 billion words from diverse periods of time. We clean this corpus, process it with a morphological analyzer, and enhance it by detecting parallel passages and automatically dating undated texts. We demonstrate its utility with selected case-studies in which we show its application to the digital humanities.

M3 - منشور من مؤتمر

SP - 45

EP - 53

BT - Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH)

CY - Osaka, Japan

ER -