论文标题
UKP-Square：一个在线提问回答研究的平台
UKP-SQUARE: An Online Platform for Question Answering Research
论文作者
论文摘要
NLP和信息检索的最新进展导致了一组各种各样的问答任务（例如，提取性，抽象性），需要不同的模型体系结构（例如，生成，歧视性）和设置（例如，有或没有检索）。尽管有大量功能强大的QA管道（我们称为技能），它们考虑了一个域，模型或设置，但没有框架，用户可以轻松地探索和比较此类管道并根据需要扩展它们。为了解决此问题，我们提出了UKP-Square，这是一个可扩展的在线质量检查平台，可用于研究人员，允许用户通过用户友好的Web界面和集成的行为测试来查询和分析大量现代技能。此外，质量检查研究人员可以使用我们的微服务来开发，管理和共享其自定义技能，这些微服务支持广泛的模型（变形金刚，适配器，ONNX），数据存储和检索技术（例如稀疏和密集）。 UKP-Square可在https://square.ukp-lab.de上找到。
Recent advances in NLP and information retrieval have given rise to a diverse set of question answering tasks that are of different formats (e.g., extractive, abstractive), require different model architectures (e.g., generative, discriminative), and setups (e.g., with or without retrieval). Despite having a large number of powerful, specialized QA pipelines (which we refer to as Skills) that consider a single domain, model or setup, there exists no framework where users can easily explore and compare such pipelines and can extend them according to their needs. To address this issue, we present UKP-SQUARE, an extensible online QA platform for researchers which allows users to query and analyze a large collection of modern Skills via a user-friendly web interface and integrated behavioural tests. In addition, QA researchers can develop, manage, and share their custom Skills using our microservices that support a wide range of models (Transformers, Adapters, ONNX), datastores and retrieval techniques (e.g., sparse and dense). UKP-SQUARE is available on https://square.ukp-lab.de.
