论文标题
将显着性检测到级联的细节建模和身体填充
Disentangle Saliency Detection into Cascaded Detail Modeling and Body Filling
论文作者
论文摘要
长期研究了显着的对象检测,以识别图像/视频中最具视觉上最具吸引力的对象。最近,已经提出了越来越多的方法,所有方法都依赖轮廓/边缘信息来提高检测性能。边缘标签要么直接放入损失中,要么用作额外的监督。边缘和身体也可以单独学习,然后融合。两种方法要么导致边缘附近的高预测错误,要么不能以端到端的方式训练。另一个问题是,由于缺乏有效的特征融合机制,现有方法可能无法检测到各种大小的对象。在这项工作中,我们建议将显着性检测任务分解为两个级联的子任务,\ emph {i.e。},细节建模和身体填充。具体而言,细节建模的重点是通过监督明确分解的细节标签来捕获对象边缘,该标签由嵌套在边缘和边缘附近的像素组成。然后,填充的身体将学习身体部位,这些部分将填充到细节图中,以生成更准确的显着图。为了有效地融合不同尺度的特征并处理对象,我们还提出了两个新颖的多尺度细节注意力和身体注意块,以进行精确的细节和身体建模。实验结果表明,我们的方法在六个公共数据集上实现了最先进的性能。
Salient object detection has been long studied to identify the most visually attractive objects in images/videos. Recently, a growing amount of approaches have been proposed all of which rely on the contour/edge information to improve detection performance. The edge labels are either put into the loss directly or used as extra supervision. The edge and body can also be learned separately and then fused afterward. Both methods either lead to high prediction errors near the edge or cannot be trained in an end-to-end manner. Another problem is that existing methods may fail to detect objects of various sizes due to the lack of efficient and effective feature fusion mechanisms. In this work, we propose to decompose the saliency detection task into two cascaded sub-tasks, \emph{i.e.}, detail modeling and body filling. Specifically, the detail modeling focuses on capturing the object edges by supervision of explicitly decomposed detail label that consists of the pixels that are nested on the edge and near the edge. Then the body filling learns the body part which will be filled into the detail map to generate more accurate saliency map. To effectively fuse the features and handle objects at different scales, we have also proposed two novel multi-scale detail attention and body attention blocks for precise detail and body modeling. Experimental results show that our method achieves state-of-the-art performances on six public datasets.