论文标题
在智能手机上识别的联合学习算法的评估和比较
Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones
论文作者
论文摘要
普遍的计算促进了智能设备在我们的生活空间中的集成,以开发为人们提供帮助的服务。这样的智能设备越来越依赖基于云的机器学习,这在安全性(数据隐私),依赖(延迟)和通信成本方面提出了问题。在这种情况下,已将联合学习(FL)作为一种新的机器学习范式引入,从而增强了本地设备的使用。在服务器级别,FL汇总模型在分布式客户端本地学习,以获得更通用的模型。这样,没有通过网络发送私人数据,并且降低了通信成本。但是,不幸的是,最受欢迎的联邦学习算法已被证明不适合一些高度异质的普遍计算环境。在本文中,我们提出了一种新的FL算法,称为FedDist,可以通过识别客户之间神经元之间的差异来修改培训期间的模型(在此,深度神经网络)。这允许在不损害概括的情况下考虑客户的特殊性。 Feddist在三种大型异质移动人类活动识别数据集上使用了三种最先进的联邦学习算法进行了评估。结果表明,Feddist适应异质数据的能力以及FL能够处理异步情况的能力。
Pervasive computing promotes the integration of smart devices in our living spaces to develop services providing assistance to people. Such smart devices are increasingly relying on cloud-based Machine Learning, which raises questions in terms of security (data privacy), reliance (latency), and communication costs. In this context, Federated Learning (FL) has been introduced as a new machine learning paradigm enhancing the use of local devices. At the server level, FL aggregates models learned locally on distributed clients to obtain a more general model. In this way, no private data is sent over the network, and the communication cost is reduced. Unfortunately, however, the most popular federated learning algorithms have been shown not to be adapted to some highly heterogeneous pervasive computing environments. In this paper, we propose a new FL algorithm, termed FedDist, which can modify models (here, deep neural network) during training by identifying dissimilarities between neurons among the clients. This permits to account for clients' specificity without impairing generalization. FedDist evaluated with three state-of-the-art federated learning algorithms on three large heterogeneous mobile Human Activity Recognition datasets. Results have shown the ability of FedDist to adapt to heterogeneous data and the capability of FL to deal with asynchronous situations.