论文标题
学会适应单眼深度估计
Learn to Adapt for Monocular Depth Estimation
论文作者
论文摘要
单眼深度估计是环境感知的基本任务之一,并且在深度学习方面取得了巨大的进步。但是,由于不同数据集之间的差距,在其他新数据集上使用时,受过训练的模型的性能往往会降解或恶化。尽管某些方法利用域自适应技术共同训练不同的领域并缩小它们之间的差距,但训练有素的模型不能推广到不涉及培训的新领域。为了提高深度估计模型的可传递性,我们提出了一个对抗深度估计任务,并在元学习管道中训练模型。我们提出的对手任务减轻了元拟合的问题,因为网络以对抗性方式进行了训练,并旨在提取域不变表示。此外,我们提出了一个限制,以强加于交叉任务深度一致性,以强迫深度估计在不同的对抗任务中相同,从而改善了我们方法的性能并使训练过程平滑。实验表明,在测试过程中几乎没有训练步骤后,我们的方法很好地适应了新数据集。
Monocular depth estimation is one of the fundamental tasks in environmental perception and has achieved tremendous progress in virtue of deep learning. However, the performance of trained models tends to degrade or deteriorate when employed on other new datasets due to the gap between different datasets. Though some methods utilize domain adaptation technologies to jointly train different domains and narrow the gap between them, the trained models cannot generalize to new domains that are not involved in training. To boost the transferability of depth estimation models, we propose an adversarial depth estimation task and train the model in the pipeline of meta-learning. Our proposed adversarial task mitigates the issue of meta-overfitting, since the network is trained in an adversarial manner and aims to extract domain invariant representations. In addition, we propose a constraint to impose upon cross-task depth consistency to compel the depth estimation to be identical in different adversarial tasks, which improves the performance of our method and smoothens the training process. Experiments demonstrate that our method adapts well to new datasets after few training steps during the test procedure.