论文标题

在不确定性下进行探索的风险感知元级决策

Risk-aware Meta-level Decision Making for Exploration Under Uncertainty

论文作者

Ott, Joshua, Kim, Sung-Kyun, Bouman, Amanda, Peltzer, Oriana, Sobue, Mamoru, Delecki, Harrison, Kochenderfer, Mykel J., Burdick, Joel, Agha-mohammadi, Ali-akbar

论文摘要

机器人对未知环境的探索从根本上是一个在不确定性下做出决策的问题,在这种情况下,机器人必须考虑传感器测量,定位,操作执行以及许多其他因素的不确定性。对于大规模探索应用,自主系统必须克服依次确定哪些环境区域的挑战,可探索哪些区域,同时安全地评估与障碍和危险地形相关的风险。在这项工作中,我们提出了一个风险感知的元级决策框架,以平衡与本地和全球勘探相关的权衡。元级决策是基于经典的等级覆盖计划者,通过在本地和全球政策之间切换,其总体目标是选择最有可能在随机环境中最大化奖励的政策。我们使用有关环境历史记录,穿术风险和动力学约束的信息,以推理成功执行本地和全球政策之间的策略执行的可能性。我们已经在模拟和各种大规模现实世界硬件测试中验证了解决方案。我们的结果表明,通过平衡本地和全球探索,我们可以更有效地显着探索大规模的环境。

Robotic exploration of unknown environments is fundamentally a problem of decision making under uncertainty where the robot must account for uncertainty in sensor measurements, localization, action execution, as well as many other factors. For large-scale exploration applications, autonomous systems must overcome the challenges of sequentially deciding which areas of the environment are valuable to explore while safely evaluating the risks associated with obstacles and hazardous terrain. In this work, we propose a risk-aware meta-level decision making framework to balance the tradeoffs associated with local and global exploration. Meta-level decision making builds upon classical hierarchical coverage planners by switching between local and global policies with the overall objective of selecting the policy that is most likely to maximize reward in a stochastic environment. We use information about the environment history, traversability risk, and kinodynamic constraints to reason about the probability of successful policy execution to switch between local and global policies. We have validated our solution in both simulation and on a variety of large-scale real world hardware tests. Our results show that by balancing local and global exploration we are able to significantly explore large-scale environments more efficiently.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源