论文标题

部分可观测时空混沌系统的无模型预测

A reinforcement learning-based link quality estimation strategy for RPL and its impact on topology management

论文作者

Ancillotti, Emilio, Vallati, Carlo, Bruno, Raffaele, Mingozzi, Enzo

论文摘要

在过去的几年中,标准化工作正在巩固路由协议对低功率和有损网络(RPL)作为基于IPv6的无线传感器网络(WSN)的标准路由协议的作用。尽管许多核心功能是明确定义的,但其他核心功能则取决于实施。其中,有效的链路质量估计(LQE)策略的定义至关重要,因为它既影响了所选网络路线的质量和节点的能耗。在本文中,我们提出了RLProbe,这是RPL中链接质量监测的新型策略,该策略可以准确地衡量链接质量与最小的开销和能源浪费。为了实现这一目标,RLProbe利用同步和异步监视方案来维持有关链路质量的最新信息,并迅速对突然的拓扑变化做出反应,例如由于流动性。我们的解决方案依靠增强学习模型来推动监视程序,以最大程度地减少主动探测操作引起的间接费用。通过模拟和实际实验评估所提出的解决方案的性能。结果表明,RLProbe有助于有效提高数据包损耗率,从而使节点能够迅速对链接质量变化以及由于节点移动性引起的失败而链接失败。

Over the last few years, standardisation efforts are consolidating the role of the Routing Protocol for LowPower and Lossy Networks (RPL) as the standard routing protocol for IPv6 based Wireless Sensor Networks (WSNs). Although many core functionalities are well defined, others are left implementation dependent. Among them, the definition of an efficient link quality estimation (LQE) strategy is of paramount importance, as it influences significantly both the quality of the selected network routes and nodes' energy consumption. In this paper, we present RLProbe, a novel strategy for link quality monitoring in RPL, which accurately measures link quality with minimal overhead and energy waste. To achieve this goal, RLProbe leverages both synchronous and asynchronous monitoring schemes to maintain up-to-date information on link quality and to promptly react to sudden topology changes, e.g. due to mobility. Our solution relies on a reinforcement learning model to drive the monitoring procedures in order to minimise the overhead caused by active probing operations. The performance of the proposed solution is assessed by means of simulations and real experiments. Results demonstrated that RLProbe helps in effectively improving packet loss rates, allowing nodes to promptly react to link quality variations as well as to link failures due to node mobility.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源