论文标题

一种方法和软件体系结构,以支持设计可解释性

A Methodology and Software Architecture to Support Explainability-by-Design

论文作者

Huynh, Trung Dong, Tsakalakis, Niko, Helal, Ayah, Stalla-Bourdillon, Sophie, Moreau, Luc

论文摘要

算法在控制或影响我们生活的各个方面的许多技术系统中起着至关重要的作用。结果,根据法律,法规,行为准则和公众,对他们的决策提供解释以满足用户和组织的需求。但是,由于法律和法规没有规定如何满足这种期望,因此通常会留下组织来设计自己的解释性方法,不可避免地增加合规性和良好的治理成本。因此,我们设想通过设计解释性,这是一种以主动措施为特征的整体方法,包括在决策系统设计中的解释能力。该方法包括三个阶段:(a)说明要求分析,(b)解释技术设计以及(c)解释验证。本文介绍了阶段(b),这是一种技术工作流程,可从域专家针对特定应用程序上下文提出的要求实现解释能力。此阶段的输出是一组配置,允许可重复使用的解释服务利用目标应用程序提供的日志来创建应用程序决策的出处痕迹。然后可以查询出处以提取相关的数据点,可以在解释计划中使用,以构建对消费者的个性化解释。在工作流程之后,组织可以设计其决策系统,以产生满足指定要求的解释。为了促进该过程,我们提出了一个软件体系结构,其中包含可重复使用的组件,将所得的解释功能纳入应用程序。最后,我们将工作流程应用于两个应用程序方案,并测量了相关的开发成本。结果表明,该方法在开发时间方面是可以处理的,每句话可能低至两个小时。

Algorithms play a crucial role in many technological systems that control or affect various aspects of our lives. As a result, providing explanations for their decisions to address the needs of users and organisations is increasingly expected by laws, regulations, codes of conduct, and the public. However, as laws and regulations do not prescribe how to meet such expectations, organisations are often left to devise their own approaches to explainability, inevitably increasing the cost of compliance and good governance. Hence, we envision Explainability-by-Design, a holistic methodology characterised by proactive measures to include explanation capability in the design of decision-making systems. The methodology consists of three phases: (A) Explanation Requirement Analysis, (B) Explanation Technical Design, and (C) Explanation Validation. This paper describes phase (B), a technical workflow to implement explanation capability from requirements elicited by domain experts for a specific application context. Outputs of this phase are a set of configurations, allowing a reusable explanation service to exploit logs provided by the target application to create provenance traces of the application's decisions. The provenance then can be queried to extract relevant data points, which can be used in explanation plans to construct explanations personalised to their consumers. Following the workflow, organisations can design their decision-making systems to produce explanations that meet the specified requirements. To facilitate the process, we present a software architecture with reusable components to incorporate the resulting explanation capability into an application. Finally, we applied the workflow to two application scenarios and measured the associated development costs. It was shown that the approach is tractable in terms of development time, which can be as low as two hours per sentence.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源