论文标题
Devanagari诗的语言识别
Language Identification of Devanagari Poems
论文作者
论文摘要
语言识别是几种文本处理管道中非常重要的一部分。在这一领域进行了广泛的研究。本文提出了一种用于诗歌分析诗的自动语言识别的程序，由印度的10种基于Devanagari的语言组成，即Angika，Angika，Awadhi，Braj，Bhojpuri，Chhattisgarhi，Garhwali，Garhwali，Garhwali，Haryanvi，Haryanvi，Haryanvi，Hindi，Magahi，Magahi和Maithili。我们整理了各种长度的诗歌，并研究了词汇一级的10种语言中诗歌的相似性。最后，应用和评估了基于监督机器学习和深度学习技术的各种语言识别系统。
Language Identification is a very important part of several text processing pipelines. Extensive research has been done in this field. This paper proposes a procedure for automatic language identification of poems for poem analysis task, consisting of 10 Devanagari based languages of India i.e. Angika, Awadhi, Braj, Bhojpuri, Chhattisgarhi, Garhwali, Haryanvi, Hindi, Magahi, and Maithili. We collated corpora of poems of varying length and studied the similarity of poems among the 10 languages at the lexical level. Finally, various language identification systems based on supervised machine learning and deep learning techniques are applied and evaluated.
