论文标题
最大化无监督域适应的条件独立性
Maximizing Conditional Independence for Unsupervised Domain Adaptation
论文作者
论文摘要
无监督的域适应研究如何将学习者从标记的源域转移到具有不同分布的未标记的目标域。现有方法主要集中于匹配源和目标域的边际分布,这可能会导致来自同一类但不同域的样本的未对准。在本文中,我们通过从新的角度实现了班级条件转移来处理这种未对准。我们旨在最大程度地提高繁殖内核希尔伯特空间中特征和域的条件独立性。有条件独立性度量的优化可以看作是最大程度地减少特征和域之间某些互信息的替代品。对条件依赖性的可解释的经验估计是与无条件案例相关的。此外,我们通过考虑班级条件分布来对目标误差提供上限,这为大多数班级条件传输方法提供了新的理论见解。除了无监督的域适应性外,我们还以自然而优雅的方式将方法扩展到多源场景。对四个基准测试的广泛实验验证了所提出的模型在无监督的域适应和多个源域的适应性中的有效性。
Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributions of the source and target domains, which probably lead a misalignment of samples from the same class but different domains. In this paper, we deal with this misalignment by achieving the class-conditioned transferring from a new perspective. We aim to maximize the conditional independence of feature and domain given class in the reproducing kernel Hilbert space. The optimization of the conditional independence measure can be viewed as minimizing a surrogate of a certain mutual information between feature and domain. An interpretable empirical estimation of the conditional dependence is deduced and connected with the unconditional case. Besides, we provide an upper bound on the target error by taking the class-conditional distribution into account, which provides a new theoretical insight for most class-conditioned transferring methods. In addition to unsupervised domain adaptation, we extend our method to the multi-source scenario in a natural and elegant way. Extensive experiments on four benchmarks validate the effectiveness of the proposed models in both unsupervised domain adaptation and multiple source domain adaptation.