论文标题
无线通信用于协作联合学习
Wireless Communications for Collaborative Federated Learning
论文作者
论文摘要
物联网(IoT)服务将使用机器学习工具有效地分析IoT设备收集的各种数据的推理,自主权和控制目的。但是,由于资源限制和隐私挑战,Edge IoT设备可能无法将其收集的数据传输到中央控制器以进行培训机器学习模型。为了克服这一挑战,已经提出了联合学习(FL),作为使边缘设备能够在没有数据交换的情况下训练共享的机器学习模型的一种手段,从而减少了沟通开销并保留数据隐私。但是,Google的开创性FL算法要求所有设备都与中央控制器直接连接,这大大限制了其应用程序方案。在这种情况下,本文介绍了一个新颖的FL框架,称为协作FL(CFL),该框架使Edge设备能够以较少依赖中央控制器来实现FL。开发了该框架的基本原理,然后提出了许多通信技术,以提高CFL的性能。为此,首先介绍了集中学习,Google的开创性FL和CFL的概述。对于每种类型的学习,介绍了基本体系结构及其优势,缺点和使用条件。然后,提出了三个CFL性能指标,并引入了一套通信技术,从网络形成,设备调度,移动性管理和编码进行了优化,以优化CFL的性能。对于每种技术,还讨论了未来的研究机会。简而言之,本文将展示如何在大规模无线系统(例如物联网)的边缘有效地实现所提出的CFL框架。
Internet of Things (IoT) services will use machine learning tools to efficiently analyze various types of data collected by IoT devices for inference, autonomy, and control purposes. However, due to resource constraints and privacy challenges, edge IoT devices may not be able to transmit their collected data to a central controller for training machine learning models. To overcome this challenge, federated learning (FL) has been proposed as a means for enabling edge devices to train a shared machine learning model without data exchanges thus reducing communication overhead and preserving data privacy. However, Google's seminal FL algorithm requires all devices to be directly connected with a central controller, which significantly limits its application scenarios. In this context, this paper introduces a novel FL framework, called collaborative FL (CFL), which enables edge devices to implement FL with less reliance on a central controller. The fundamentals of this framework are developed and then, a number of communication techniques are proposed so as to improve the performance of CFL. To this end, an overview of centralized learning, Google's seminal FL, and CFL is first presented. For each type of learning, the basic architecture as well as its advantages, drawbacks, and usage conditions are introduced. Then, three CFL performance metrics are presented and a suite of communication techniques ranging from network formation, device scheduling, mobility management, and coding is introduced to optimize the performance of CFL. For each technique, future research opportunities are also discussed. In a nutshell, this article will showcase how the proposed CFL framework can be effectively implemented at the edge of large-scale wireless systems such as the Internet of Things.