AAAI · 2019
Scene Text Detection with Supervised Pyramid Context Network
Key takeaway
SPCNET uses supervised semantic context within a feature-pyramid instance-segmentation model to localize scene text and suppress false positives with little extra computation. arXiv abstract · v1
Abstract
Scene text detection methods based on deep learning have achieved remarkable results over the past years. However, due to the high diversity and complexity of natural scenes, previous state-of-the-art text detection methods may still produce a considerable amount of false positives, when applied to images captured in real-world environments. To tackle this issue, mainly inspired by Mask R-CNN, we propose in this paper an effective model for scene text detection, which is based on Feature Pyramid Network (FPN) and instance segmentation. We propose a supervised pyramid context network (SPCNET) to precisely locate text regions while suppressing false positives. Benefited from the guidance of semantic information and sharing FPN, SPCNET obtains significantly enhanced performance while introducing marginal extra computation. Experiments on standard datasets demonstrate that our SPCNET clearly outperforms start-of-the-art methods. Specifically, it achieves an F-measure of 92.1% on ICDAR2013, 87.2% on ICDAR2015, 74.1% on ICDAR2017 MLT and 82.9% on Total-Text.
Author abstract · arXiv abstract · v1
Publication
AAAI Conference on Artificial Intelligence (AAAI), 2019
Paper and resources
Research topics
SPCNET · Scene text detection · Supervised pyramid context · False-positive suppression · Feature Pyramid Network · Instance segmentation · Semantic guidance · OCR
Research problem and approach
Complex natural scenes can produce false text detections despite strong benchmark performance. SPCNET introduces semantic supervision over a shared feature pyramid to distinguish true text regions from visually similar background patterns. arXiv abstract · v1
Main contributions
- Develops a supervised pyramid context network inspired by instance segmentation. arXiv abstract · v1
- Shares feature-pyramid computation while using semantic guidance to reduce false positives. arXiv abstract · v1
Method comparison
| Approach | Key difference |
|---|---|
| Scene text detection in complex backgrounds | Can retain false positives caused by diverse natural-scene content. |
| SPCNET | Adds supervised semantic context over a shared feature pyramid to localize text and suppress false detections. |
Selected results
- SPCNET raises ICDAR2015 F-measure from the baseline’s 85.5% to 87.2%, with recall increasing from 83.8% to 85.8% and precision from 87.4% to 88.7%. Table 3 · ICDAR2015 text detection · arXiv v1
- In the ICDAR2017-MLT component ablation, text-context modeling raises F-measure from 74.7% to 76.8%, and re-scoring raises it to 78.5%. Recall remains 73.4% while precision increases from 76.2% to 84.2%. Table 1 · context and re-scoring ablation · arXiv v1
Cite this paper
Enze Xie, Yuhang Zang, Shuai Shao, Gang Yu, Cong Yao, Guangyao Li. Scene Text Detection with Supervised Pyramid Context Network. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 2019, pp. 9038–9045.
@article{arxiv181108605,
title = {{Scene Text Detection with Supervised Pyramid Context Network}},
author = {Enze Xie and Yuhang Zang and Shuai Shao and Gang Yu and Cong Yao and Guangyao Li},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
month = {July},
year = {2019},
volume = {33},
number = {01},
publisher = {Association for the Advancement of Artificial Intelligence (AAAI)},
pages = {9038--9045},
doi = {10.1609/aaai.v33i01.33019038},
url = {https://doi.org/10.1609/aaai.v33i01.33019038}
}