论文标题

PROTEA:使用花的联合系统内的客户分析

Protea: Client Profiling within Federated Systems using Flower

论文作者

Zhao, Wanru, Qiu, Xinchi, Fernandez-Marques, Javier, de Gusmão, Pedro P. B., Lane, Nicholas D.

论文摘要

联邦学习(FL)已成为一种前瞻性解决方案,可促进对高性能的集中模型的培训,而不会损害用户的隐私。尽管成功,但目前的研究受到了在实验初期建立现实的大规模FL系统的可能性的限制。模拟可以帮助加速这一过程。为了促进对异质客户的有效可扩展的FL模拟,我们设计和实施Protea,这是使用FL框架Flower的联合系统中灵活且轻巧的客户型分析组件。它允许自动收集系统级统计信息并估算每个客户所需的资源,从而以资源感知方式运行模拟。结果表明,我们的设计成功地增加了1.66 $ \ times $更快的壁式时间和2.6 $ \ times $更好的GPU利用率的并行性,这可以对异构客户进行大规模实验。

Federated Learning (FL) has emerged as a prospective solution that facilitates the training of a high-performing centralised model without compromising the privacy of users. While successful, research is currently limited by the possibility of establishing a realistic large-scale FL system at the early stages of experimentation. Simulation can help accelerate this process. To facilitate efficient scalable FL simulation of heterogeneous clients, we design and implement Protea, a flexible and lightweight client profiling component within federated systems using the FL framework Flower. It allows automatically collecting system-level statistics and estimating the resources needed for each client, thus running the simulation in a resource-aware fashion. The results show that our design successfully increases parallelism for 1.66 $\times$ faster wall-clock time and 2.6$\times$ better GPU utilisation, which enables large-scale experiments on heterogeneous clients.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源