论文标题

当联合学习遇到区块链时:一种新的分布式学习范式

When Federated Learning Meets Blockchain: A New Distributed Learning Paradigm

论文作者

Ma, Chuan, Li, Jun, Ding, Ming, Shi, Long, Wang, Taotao, Han, Zhu, Poor, H. Vincent

论文摘要

由最终用户设备的爆炸性计算功能以及共享敏感原始数据的越来越多的隐私问题所激发的动机,名为Federated Learning(FL)的新机器学习范式已经出现。通过在每个客户端的本地培训模型并在中央服务器上汇总学习模型,FL具有避免直接共享数据的能力,从而减少隐私泄漏。但是,传统的FL框架在很大程度上取决于单个中央服务器,如果这种服务器行为恶意,可能会崩溃。为了解决这个单点的故障问题,这项工作调查了区块链辅助分散的FL(Blade-FL)框架,这可以很好地防止恶意客户毒化学习过程,并进一步为客户提供了自我激励和可靠的学习环境。详细说明,模型聚合过程已完全分散,将FL和挖掘的区块链培训任务集成到每个参与者中。此外,我们研究了该框架中的独特问题,并为可能的解决方案提供了分析和实验结果。

Motivated by the explosive computing capabilities at end user equipments, as well as the growing privacy concerns over sharing sensitive raw data, a new machine learning paradigm, named federated learning (FL) has emerged. By training models locally at each client and aggregating learning models at a central server, FL has the capability to avoid sharing data directly, thereby reducing privacy leakage. However, the traditional FL framework heavily relies on a single central server and may fall apart if such a server behaves maliciously. To address this single point of failure issue, this work investigates a blockchain assisted decentralized FL (BLADE-FL) framework, which can well prevent the malicious clients from poisoning the learning process, and further provides a self-motivated and reliable learning environment for clients. In detail, the model aggregation process is fully decentralized and the tasks of training for FL and mining for blockchain are integrated into each participant. In addition, we investigate the unique issues in this framework and provide analytical and experimental results to shed light on possible solutions.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源