论文标题

驾驶员碰撞警告的神经符号混合方法

Neurosymbolic hybrid approach to driver collision warning

论文作者

Yun, Kyongsik, Lu, Thomas, Huyen, Alexander, Hammer, Patrick, Wang, Pei

论文摘要

自动驾驶系统有两种主要的算法方法:(1)端到端系统,其中一个深层神经网络学会将感觉输入直接映射到适当的警告和驾驶响应中。 (2)介导的混合识别系统,其中通过组合检测每个语义特征的独立模块来创建系统。尽管一些研究人员认为深度学习可以解决任何问题,但其他研究人员认为,需要采用更具工程和象征性的方法来应对具有较少数据的复杂环境。从复杂的游戏玩法到预测蛋白质结构,仅深度学习就可以在许多领域取得了最新的结果。特别是,在图像分类和识别中,深度学习模型达到了与人类一样高的准确性。但是有时候,如果深度学习模型不起作用,则可能很难进行调试。深度学习模型可能很脆弱,并且对数据分布的变化非常敏感。概括可能是有问题的。通常很难证明为什么它可以工作或不起作用。深度学习模型也可能容易受到对抗性攻击的影响。在这里,我们将基于学习的对象识别和跟踪与自适应神经符号网络代理相结合,称为非轴向推理系统(NARS),可以通过基于感知序列构建概念来适应其环境。与COCO数据预训练的模型相比,与IOU 0.31相比,我们在自适应再培训模型中实现了0.65的相交对象识别性能的改进。我们在模拟环境中使用雷达传感器改善了对象检测极限,并通过将基于深度学习的对象检测和跟踪与神经符号模型相结合,证明了编织的汽车检测能力。

There are two main algorithmic approaches to autonomous driving systems: (1) An end-to-end system in which a single deep neural network learns to map sensory input directly into appropriate warning and driving responses. (2) A mediated hybrid recognition system in which a system is created by combining independent modules that detect each semantic feature. While some researchers believe that deep learning can solve any problem, others believe that a more engineered and symbolic approach is needed to cope with complex environments with less data. Deep learning alone has achieved state-of-the-art results in many areas, from complex gameplay to predicting protein structures. In particular, in image classification and recognition, deep learning models have achieved accuracies as high as humans. But sometimes it can be very difficult to debug if the deep learning model doesn't work. Deep learning models can be vulnerable and are very sensitive to changes in data distribution. Generalization can be problematic. It's usually hard to prove why it works or doesn't. Deep learning models can also be vulnerable to adversarial attacks. Here, we combine deep learning-based object recognition and tracking with an adaptive neurosymbolic network agent, called the Non-Axiomatic Reasoning System (NARS), that can adapt to its environment by building concepts based on perceptual sequences. We achieved an improved intersection-over-union (IOU) object recognition performance of 0.65 in the adaptive retraining model compared to IOU 0.31 in the COCO data pre-trained model. We improved the object detection limits using RADAR sensors in a simulated environment, and demonstrated the weaving car detection capability by combining deep learning-based object detection and tracking with a neurosymbolic model.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源