论文标题
通过元学习对真实域进行泛化
Towards Generalization on Real Domain for Single Image Dehazing via Meta-Learning
论文作者
论文摘要
基于学习的图像去悬式方法对于协助自主系统提高可靠性至关重要。由于合成域和真实域之间的域间隙,从合成图像中学到的内部信息通常在真实域中是最佳选择,从而导致严重的性能下降模型。在探索一些看不见的域样本中的内部信息的能力的驱动下,通常采用元学习来通过测试时间培训来解决此问题,这是高参数敏感且耗时的。相比之下,我们提出了一个基于元学习的域泛化框架,以挖掘实际朦胧域的代表性和歧视性内部特性,而无需测试时间训练。为了获得代表性域特异性信息,我们将两个称为适应网络的实体和距离感知的聚合器附加到我们的飞行网络。适应网络有助于从几个朦胧的样本中提取域中的信息,并将其缓存到一系列功能中。远距离感知的聚合器致力于总结生成的特征,并过滤误导性信息,以获得更多代表性的内部属性。为了增强对蒸馏的内部信息的歧视,我们提出了一种新颖的损失函数,称为域相关的对比正则化,这鼓励了从同一领域产生的内部特征更相似,并且来自不同领域的不同领域。生成的代表性和歧视性特征被认为是我们飞行网络的某些外部变量,以回归给定域的特定功能。在RTTS和URHI等实际朦胧数据集上进行的广泛实验验证,我们所提出的方法比最先进的竞争对手具有优越的概括能力。
Learning-based image dehazing methods are essential to assist autonomous systems in enhancing reliability. Due to the domain gap between synthetic and real domains, the internal information learned from synthesized images is usually sub-optimal in real domains, leading to severe performance drop of dehaizing models. Driven by the ability on exploring internal information from a few unseen-domain samples, meta-learning is commonly adopted to address this issue via test-time training, which is hyperparameter-sensitive and time-consuming. In contrast, we present a domain generalization framework based on meta-learning to dig out representative and discriminative internal properties of real hazy domains without test-time training. To obtain representative domain-specific information, we attach two entities termed adaptation network and distance-aware aggregator to our dehazing network. The adaptation network assists in distilling domain-relevant information from a few hazy samples and caching it into a collection of features. The distance-aware aggregator strives to summarize the generated features and filter out misleading information for more representative internal properties. To enhance the discrimination of distilled internal information, we present a novel loss function called domain-relevant contrastive regularization, which encourages the internal features generated from the same domain more similar and that from diverse domains more distinct. The generated representative and discriminative features are regarded as some external variables of our dehazing network to regress a particular and powerful function for a given domain. The extensive experiments on real hazy datasets, such as RTTS and URHI, validate that our proposed method has superior generalization ability than the state-of-the-art competitors.