论文标题
朝着云和设备上的传输友好和强大的CNN型号
Towards Transmission-Friendly and Robust CNN Models over Cloud and Device
论文作者
论文摘要
在无处不在的物联网(IoT)设备上部署深层卷积神经网络(CNN)模型,引起了行业和学术界的广泛关注,因为它通过提供各种快速响应服务来大大促进我们的生活。由于IoT设备的资源有限,CNN模型的云辅助培训已成为主流。但是,大多数现有的相关作品都遭受了大量模型参数传输和弱模型鲁棒性。为此,本文提出了一个云辅助的CNN训练框架,具有低模型参数传输和强大的模型鲁棒性。在拟议的框架中,我们首先引入Monocnn,其中仅包含一些可学习的过滤器,而其他过滤器则无法检测。这些不可检测的滤波器参数是根据某些规则(即滤波器生成函数(FGF))生成的,可以通过几个随机种子保存和再现。因此,云服务器只需要将这些可学习的过滤器和一些种子发送到IoT设备。与传输所有模型参数相比,发送几个可学习的滤波器参数和种子可以显着降低参数传输。然后,我们研究了多个FGF,并使IoT设备能够使用FGF生成多个过滤器,并将它们组合到单核中。因此,单体不仅受训练数据的影响,而且受到FGF的影响。 FGF规则在正规化单体方面发挥了作用,从而改善了其稳健性。实验结果表明,与最先进的方法相比,我们提出的框架可以减少云服务器和物联网设备之间的大量模型参数传输,同时在处理损坏的数据时将性能提高约2.2%。该代码可从https://github.com/voxlos/mono-cnn-pytorch获得。
Deploying deep convolutional neural network (CNN) models on ubiquitous Internet of Things (IoT) devices has attracted much attention from industry and academia since it greatly facilitates our lives by providing various rapid-response services. Due to the limited resources of IoT devices, cloud-assisted training of CNN models has become the mainstream. However, most existing related works suffer from a large amount of model parameter transmission and weak model robustness. To this end, this paper proposes a cloud-assisted CNN training framework with low model parameter transmission and strong model robustness. In the proposed framework, we first introduce MonoCNN, which contains only a few learnable filters, and other filters are nonlearnable. These nonlearnable filter parameters are generated according to certain rules, i.e., the filter generation function (FGF), and can be saved and reproduced by a few random seeds. Thus, the cloud server only needs to send these learnable filters and a few seeds to the IoT device. Compared to transmitting all model parameters, sending several learnable filter parameters and seeds can significantly reduce parameter transmission. Then, we investigate multiple FGFs and enable the IoT device to use the FGF to generate multiple filters and combine them into MonoCNN. Thus, MonoCNN is affected not only by the training data but also by the FGF. The rules of the FGF play a role in regularizing the MonoCNN, thereby improving its robustness. Experimental results show that compared to state-of-the-art methods, our proposed framework can reduce a large amount of model parameter transfer between the cloud server and the IoT device while improving the performance by approximately 2.2% when dealing with corrupted data. The code is available at https://github.com/evoxlos/mono-cnn-pytorch.