论文标题
价值卡:通过审议来教授机器学习的社会影响的教育工具包
Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation
论文作者
论文摘要
最近,越来越多的呼吁计算机科学课程以与公平,问责制,透明度和道德有关的主题进行补充现有的技术培训。在本文中,我们提出了Value Card,这是一种教育工具包,可通过审议向学生和从业者告知不同机器学习模型的社会影响。本文在大学水平的计算机科学课程中提出了我们方法的尽早使用。通过课堂活动,我们报告了方法的经验数据,以实现我们的方法的初始有效性。我们的结果表明,使用价值卡工具包可以提高学生对绩效指标的技术定义和权衡的理解,并将其应用于现实世界中的环境,帮助他们认识到考虑各种社会价值观在算法系统部署中的重要性,并使他们能够交流,谈判和合成各种观点的参与者。我们的研究还证明了使用价值卡工具包的不同变体时需要考虑的许多警告。最后,我们讨论了我们方法的挑战以及未来的应用。
Recently, there have been increasing calls for computer science curricula to complement existing technical training with topics related to Fairness, Accountability, Transparency, and Ethics. In this paper, we present Value Card, an educational toolkit to inform students and practitioners of the social impacts of different machine learning models via deliberation. This paper presents an early use of our approach in a college-level computer science course. Through an in-class activity, we report empirical data for the initial effectiveness of our approach. Our results suggest that the use of the Value Cards toolkit can improve students' understanding of both the technical definitions and trade-offs of performance metrics and apply them in real-world contexts, help them recognize the significance of considering diverse social values in the development of deployment of algorithmic systems, and enable them to communicate, negotiate and synthesize the perspectives of diverse stakeholders. Our study also demonstrates a number of caveats we need to consider when using the different variants of the Value Cards toolkit. Finally, we discuss the challenges as well as future applications of our approach.