论文标题

在干草堆中找到针头:自动识别可访问性用户评论

Finding the Needle in a Haystack: On the Automatic Identification of Accessibility User Reviews

论文作者

AlOmar, Eman Abdullah, Aljedaani, Wajdi, Tamjeed, Murtaza, Mkaouer, Mohamed Wiem, Elglaly, Yasmine N.

论文摘要

近年来,移动可访问性已成为一个重要趋势,目的是允许所有用户使用任何应用程序而无限制。用户评论包括可用于应用程序发展的见解。但是,随着收到的评论的数量增加,手动分析它们是乏味且耗时的,尤其是在搜索可访问性评论时。本文的目的是支持用户评论中可访问性的自动识别,以帮助技术专业人员优先考虑其处理,从而创建更具包容性的应用程序。特别是,我们设计了一个模型,该模型以输入可访问性用户评论,学习基于关键字的功能,以做出二进制决策,以进行给定的审查,以了解其是否与可访问性有关。使用总共5,326个移动应用程序评论评估该模型。研究结果表明,(1)我们的模型可以准确识别可访问性评论,表现优于两个基准,即基于关键字的检测器和一个随机分类器; (2)我们的模型通过相对较小的培训数据集实现了85%的精度;但是,随着我们增加培训数据集的规模,准确性会提高。

In recent years, mobile accessibility has become an important trend with the goal of allowing all users the possibility of using any app without many limitations. User reviews include insights that are useful for app evolution. However, with the increase in the amount of received reviews, manually analyzing them is tedious and time-consuming, especially when searching for accessibility reviews. The goal of this paper is to support the automated identification of accessibility in user reviews, to help technology professionals in prioritizing their handling, and thus, creating more inclusive apps. Particularly, we design a model that takes as input accessibility user reviews, learns their keyword-based features, in order to make a binary decision, for a given review, on whether it is about accessibility or not. The model is evaluated using a total of 5,326 mobile app reviews. The findings show that (1) our model can accurately identify accessibility reviews, outperforming two baselines, namely keyword-based detector and a random classifier; (2) our model achieves an accuracy of 85% with relatively small training dataset; however, the accuracy improves as we increase the size of the training dataset.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源