论文标题

seasondepth:在多个环境下的跨季节单眼预测数据集和基准测试

SeasonDepth: Cross-Season Monocular Depth Prediction Dataset and Benchmark under Multiple Environments

论文作者

Hu, Hanjiang, Yang, Baoquan, Qiao, Zhijian, Liu, Shiqi, Zhu, Jiacheng, Liu, Zuxin, Ding, Wenhao, Zhao, Ding, Wang, Hesheng

论文摘要

不同的环境对长期自主驾驶的室外强大视觉感知构成了巨大挑战,并且在不同环境上对基于学习的算法的概括仍然是一个开放的问题。尽管最近对单眼深度预测进行了充分的研究,但很少有作品集中在不同环境中基于学习的深度预测的鲁棒性上,例如由于缺乏这种多种环境现实世界中的数据集和基准,改变了照明和季节。为此,引入了第一个跨季节单眼预测数据集和基准Seasondepth,以基准在不同环境下进行深度估计性能。我们使用新构建的指标研究了几种最先进的代表性开源监督和自我监督的深度预测方法。通过对当前自动驾驶数据集的拟议数据集和交叉数据集评估进行广泛的实验评估,对多种环境影响的性能和鲁棒性进行了定性和定量分析。我们表明,长期的单眼预测仍然具有挑战性,并认为我们的工作可以提高对户外视觉感知的长期鲁棒性和概括的进一步研究。该数据集可在https://seasondepth.github.io上找到,并且基准工具包可在https://github.com/ seasondeppth/seaseasondepth上获得。

Different environments pose a great challenge to the outdoor robust visual perception for long-term autonomous driving, and the generalization of learning-based algorithms on different environments is still an open problem. Although monocular depth prediction has been well studied recently, few works focus on the robustness of learning-based depth prediction across different environments, e.g. changing illumination and seasons, owing to the lack of such a multi-environment real-world dataset and benchmark. To this end, the first cross-season monocular depth prediction dataset and benchmark, SeasonDepth, is introduced to benchmark the depth estimation performance under different environments. We investigate several state-of-the-art representative open-source supervised and self-supervised depth prediction methods using newly-formulated metrics. Through extensive experimental evaluation on the proposed dataset and cross-dataset evaluation with current autonomous driving datasets, the performance and robustness against the influence of multiple environments are analyzed qualitatively and quantitatively. We show that long-term monocular depth prediction is still challenging and believe our work can boost further research on the long-term robustness and generalization for outdoor visual perception. The dataset is available on https://seasondepth.github.io, and the benchmark toolkit is available on https://github.com/ SeasonDepth/SeasonDepth.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源