论文标题
部分可观测时空混沌系统的无模型预测
FCNet: A Convolutional Neural Network for Arbitrary-Length Exposure Estimation
论文作者
论文摘要
数码相机捕获的照片通常会遭受曝光问题的损失。对于图像暴露增强,在图像处理社区中广泛研究了单曝光校正(SEC)和多曝光融合(MEF)的任务。但是,当前的SEC或MEF方法是在不同的动机下开发的,因此忽略了SEC和MEF之间的内部相关性,因此很难处理不当暴露的任意长度序列。此外,MEF方法通常无法估算仅包含暴露不足或暴露图像的序列的暴露。为了减轻这些问题,在本文中,我们开发了一种新颖的融合校正网络(FCNET),以解决一个任意长度(包括一个)图像序列,并具有不当暴露。这是通过通过拉普拉斯金字塔(LP)图像分解融合和纠正图像序列来实现的。在每个LP级别中,输入图像序列的低频基础成分被送入融合块中,并依次将校正块用于连续暴露估计,并通过替代暴露融合和校正实现。当前LP级别中的曝光校正图像在下一个LP级别中的输入图像序列的高频细节组件进行了更新并融合,以在下一个LP级别输出融合和校正块的基本组件。基准数据集上的实验表明,我们的FCNET对包括SEC和MEF在内的任意长度暴露估计有效。该代码在https://github.com/nkujinliang/fcnet上公开发布。
The photographs captured by digital cameras usually suffer from over or under exposure problems. For image exposure enhancement, the tasks of Single-Exposure Correction (SEC) and Multi-Exposure Fusion (MEF) are widely studied in the image processing community. However, current SEC or MEF methods are developed under different motivations and thus ignore the internal correlation between SEC and MEF, making it difficult to process arbitrary-length sequences with improper exposures. Besides, the MEF methods usually fail at estimating the exposure of a sequence containing only under-exposed or over-exposed images. To alleviate these problems, in this paper, we develop a novel Fusion-Correction Network (FCNet) to tackle an arbitrary-length (including one) image sequence with improper exposures. This is achieved by fusing and correcting an image sequence by Laplacian Pyramid (LP) image decomposition. In each LP level, the low-frequency base component of the input image sequence is fed into a Fusion block and a Correction block sequentially for consecutive exposure estimation, implemented by alternative exposure fusion and correction. The exposure-corrected image in current LP level is upsampled and fused with the high-frequency detail components of the input image sequence in the next LP level, to output the base component for the Fusion and Correction blocks in next LP level. Experiments on the benchmark dataset demonstrate that our FCNet is effective on arbitrary-length exposure estimation, including both SEC and MEF. The code is publicly released at https://github.com/NKUJinLiang/FCNet.