论文标题
图像通过共裂分段进行骨骼化
Image Co-skeletonization via Co-segmentation
论文作者
论文摘要
图像的联合处理的最新进展肯定表明了其优势比个人处理。不同于现有的工程,适合进行共裂或共定位,在本文中,我们探讨了一个新的关节处理主题:图像共骨骼化,该主题定义为图像集合中对象的关节骨架提取。单个自然图像中的对象骨骼化是一个具有挑战性的问题,因为几乎没有关于对象的先验知识。因此,我们求助于对象共骨骼化的想法,希望在图像上存在的典型性可能会有所帮助,就像对其他关节处理问题(例如共裂分段)一样。我们观察到骨骼可以为分割和骨骼化提供良好的涂鸦,然后需要良好的分割。因此,我们提出了一个耦合框架,以进行共骨骼和共段任务,以便它们相互了解,并互相协同受益。由于这是一个新问题,因此我们还通过注释近1.8k的图像分布在38个类别中来构建基准数据集。广泛的实验表明,所提出的方法在所有三种可能的联合加工情况下实现了有希望的结果:弱监督,监督和不受监督。
Recent advances in the joint processing of images have certainly shown its advantages over individual processing. Different from the existing works geared towards co-segmentation or co-localization, in this paper, we explore a new joint processing topic: image co-skeletonization, which is defined as joint skeleton extraction of objects in an image collection. Object skeletonization in a single natural image is a challenging problem because there is hardly any prior knowledge about the object. Therefore, we resort to the idea of object co-skeletonization, hoping that the commonness prior that exists across the images may help, just as it does for other joint processing problems such as co-segmentation. We observe that the skeleton can provide good scribbles for segmentation, and skeletonization, in turn, needs good segmentation. Therefore, we propose a coupled framework for co-skeletonization and co-segmentation tasks so that they are well informed by each other, and benefit each other synergistically. Since it is a new problem, we also construct a benchmark dataset by annotating nearly 1.8k images spread across 38 categories. Extensive experiments demonstrate that the proposed method achieves promising results in all the three possible scenarios of joint-processing: weakly-supervised, supervised, and unsupervised.