论文标题
Tourbert：旅游业的验证语言模型
TourBERT: A pretrained language model for the tourism industry
论文作者
论文摘要
来自变形金刚（BERT）的双向编码器表示目前是自然语言最重要，最新的模型之一。但是，也已经证明，对于特定领域的任务，在特定于域的语料库上预处理伯特很有帮助。在本文中，我们介绍了Tourbert，这是一种验证的旅游语言模型。我们描述了Tourbert是如何开发和评估的。评估表明，Tourbert在所有特定于旅游业的任务中都表现出色。
The Bidirectional Encoder Representations from Transformers (BERT) is currently one of the most important and state-of-the-art models for natural language. However, it has also been shown that for domain-specific tasks it is helpful to pretrain BERT on a domain-specific corpus. In this paper, we present TourBERT, a pretrained language model for tourism. We describe how TourBERT was developed and evaluated. The evaluations show that TourBERT is outperforming BERT in all tourism-specific tasks.
