论文标题

单镜头自力更生的场景文本text fotter通过脱钩但协作的检测和识别

Single Shot Self-Reliant Scene Text Spotter by Decoupled yet Collaborative Detection and Recognition

论文作者

Wu, Jingjing, Lyu, Pengyuan, Lu, Guangming, Zhang, Chengquan, Pei, Wenjie

论文摘要

典型的文本检测器遵循两个阶段的斑点范式,该范式首先检测文本实例的边界,然后在检测区域内执行文本识别。尽管这种斑点范式取得了显着的进展,但一个重要的限制是,文本识别的性能在很大程度上取决于文本检测的精度,从而导致了从检测到识别的潜在误差传播。在这项工作中,我们提出了单拍的自力更生场景文本sotter v2(SRSTS V2),该场景通过将识别解除识别而在合作优化两个任务的同时,通过将识别解除识别来规避此限制。具体而言,我们的SRSTS V2样本代表了每个潜在文本实例周围的特征点,并在这些采样点的并行引导下进行文本检测和识别。因此,文本识别不再取决于检测,从而减轻了从检测到识别的错误传播。此外,在检测和识别的监督下学习了采样模块,这允许两个任务之间的协作优化和相互增强。从这种采样驱动的并发点框架中受益,我们的方法即使确切的文本界限要检测到具有挑战性,我们的方法也能够正确识别文本实例。对四个基准测试的广泛实验表明,我们的方法与最先进的发现者相比有利。

Typical text spotters follow the two-stage spotting paradigm which detects the boundary for a text instance first and then performs text recognition within the detected regions. Despite the remarkable progress of such spotting paradigm, an important limitation is that the performance of text recognition depends heavily on the precision of text detection, resulting in the potential error propagation from detection to recognition. In this work, we propose the single shot Self-Reliant Scene Text Spotter v2 (SRSTS v2), which circumvents this limitation by decoupling recognition from detection while optimizing two tasks collaboratively. Specifically, our SRSTS v2 samples representative feature points around each potential text instance, and conducts both text detection and recognition in parallel guided by these sampled points. Thus, the text recognition is no longer dependent on detection, thereby alleviating the error propagation from detection to recognition. Moreover, the sampling module is learned under the supervision from both detection and recognition, which allows for the collaborative optimization and mutual enhancement between two tasks. Benefiting from such sampling-driven concurrent spotting framework, our approach is able to recognize the text instances correctly even if the precise text boundaries are challenging to detect. Extensive experiments on four benchmarks demonstrate that our method compares favorably to state-of-the-art spotters.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源