论文标题
Hyperpalm:基于DNN的手势识别接口,用于与三倍机器人在3D空间中的智能通信
HyperPalm: DNN-based hand gesture recognition interface for intelligent communication with quadruped robot in 3D space
论文作者
论文摘要
如今,自动移动机器人在许多人在人类存在多余或太危险的地区为人们提供支持。他们在探险,天然气行业,矿山,仓库等中成功证明了自己。但是,即使是腿部的机器人也可能陷入崎rough的地形条件下,需要人类的认知能力来浏览该系统。尽管游戏板和键盘方便用于轮式机器人控制,但3D空间中的四倍机器人可以沿所有线性坐标和欧拉角移动,需要至少12个按钮才能独立控制其DOF。因此,需要更方便的控制接口。 在本文中,我们介绍了超大型:一种与四足机器人直观人类机器人相互作用的新型手势界面。如果没有其他设备,操作员可以通过仅有5个手势和6个DOF手动运动的手势识别,可以通过手势识别在3D空间中对四倍的机器人进行完整的位置和方向控制。 实验结果表明,将5个静态手势分类为高精度(96.5%),可以准确预测手在三维空间中手的6D位置的位置。所提出方法的绝对线性偏离根均方根偏差(RMSD)为11.7 mm,比第二个测试方法低几乎低50%,所提出方法的绝对角度偏差RMSD为2.6度,比第二次测试方法低几乎低27%。此外,进行了用户研究,以通过建议的手势接口探索用户从人机交互中的主观体验。参与者评估他们与超级友善的互动为直观(2.0),不会引起挫败感(2.63),并且需要较低的身体需求(2.0)。
Nowadays, autonomous mobile robots support people in many areas where human presence either redundant or too dangerous. They have successfully proven themselves in expeditions, gas industry, mines, warehouses, etc. However, even legged robots may stuck in rough terrain conditions requiring human cognitive abilities to navigate the system. While gamepads and keyboards are convenient for wheeled robot control, the quadruped robot in 3D space can move along all linear coordinates and Euler angles, requiring at least 12 buttons for independent control of their DoF. Therefore, more convenient interfaces of control are required. In this paper we present HyperPalm: a novel gesture interface for intuitive human-robot interaction with quadruped robots. Without additional devices, the operator has full position and orientation control of the quadruped robot in 3D space through hand gesture recognition with only 5 gestures and 6 DoF hand motion. The experimental results revealed to classify 5 static gestures with high accuracy (96.5%), accurately predict the position of the 6D position of the hand in three-dimensional space. The absolute linear deviation Root mean square deviation (RMSD) of the proposed approach is 11.7 mm, which is almost 50% lower than for the second tested approach, the absolute angular deviation RMSD of the proposed approach is 2.6 degrees, which is almost 27% lower than for the second tested approach. Moreover, the user study was conducted to explore user's subjective experience from human-robot interaction through the proposed gesture interface. The participants evaluated their interaction with HyperPalm as intuitive (2.0), not causing frustration (2.63), and requiring low physical demand (2.0).