IJCV · 2023
Semi-Supervised and Long-Tailed Object Detection with CascadeMatch
Key takeaway
CascadeMatch improves semi-supervised long-tailed detection through progressive cascade thresholds, adaptive pseudo-label mining and ensemble supervision that reduces confirmation bias. arXiv abstract · v1
Abstract
This paper focuses on long-tailed object detection in the semi-supervised learning setting, which poses realistic challenges, but has rarely been studied in the literature. We propose a novel pseudo-labeling-based detector called CascadeMatch. Our detector features a cascade network architecture, which has multi-stage detection heads with progressive confidence thresholds. To avoid manually tuning the thresholds, we design a new adaptive pseudo-label mining mechanism to automatically identify suitable values from data. To mitigate confirmation bias, where a model is negatively reinforced by incorrect pseudo-labels produced by itself, each detection head is trained by the ensemble pseudo-labels of all detection heads. Experiments on two long-tailed datasets, i.e., LVIS and COCO-LT, demonstrate that CascadeMatch surpasses existing state-of-the-art semi-supervised approaches -- across a wide range of detection architectures -- in handling long-tailed object detection. For instance, CascadeMatch outperforms Unbiased Teacher by 1.9 AP Fix on LVIS when using a ResNet50-based Cascade R-CNN structure, and by 1.7 AP Fix when using Sparse R-CNN with a Transformer encoder. We also show that CascadeMatch can even handle the challenging sparsely annotated object detection problem.
Author abstract · arXiv abstract · v1
Publication
International Journal of Computer Vision (IJCV), 2023
Paper and resources
Research topics
CascadeMatch · Semi-supervised object detection · Long-tailed detection · Pseudo-labeling · Adaptive confidence thresholds · Confirmation bias · Ensemble supervision · Sparse annotations
Research problem and approach
Rare categories make reliable pseudo-label selection difficult, while incorrect labels can reinforce themselves during training. CascadeMatch uses multiple detection heads, learns confidence thresholds from data and supervises each head with their ensemble predictions. arXiv abstract · v1
Main contributions
- Introduces a cascade pseudo-labeling architecture with progressive, automatically adapted confidence thresholds. arXiv abstract · v1
- Uses ensemble pseudo-labels across detection heads and studies sparsely annotated detection. arXiv abstract · v1
Method comparison
| Approach | Key difference |
|---|---|
| Self-generated pseudo-label supervision | Can reinforce a detector's own incorrect labels and requires suitable confidence thresholds. |
| CascadeMatch | Uses progressive adaptive thresholds and supervises each detection head with ensemble pseudo-labels. |
Selected results
- With a 12-epoch schedule, CascadeMatch raises fixed AP from the supervised baseline’s 26.3 to 30.5 and rare-class fixed AP from 19.7 to 23.1, averaged over three random seeds. Soft Teacher reaches 29.2 and 21.1 in the same setting. Table 7 · LVIS v1.0, Cascade R-CNN R50-FPN · arXiv v1
- Cascade pseudo-labeling alone gives fixed AP 30.1; adaptive pseudo-label mining alone gives 28.9; using both reaches 30.5, compared with 26.3 without unlabeled data. Rare-class fixed AP reaches 23.1 with both components. Table 2 · pseudo-labeling ablation · arXiv v1
Cite this paper
Yuhang Zang, Kaiyang Zhou, Chen Huang, Chen Change Loy. Semi-Supervised and Long-Tailed Object Detection with CascadeMatch. International Journal of Computer Vision, 131(4), 2023, pp. 987–1001.
@article{arxiv230514813,
title = {{Semi-Supervised and Long-Tailed Object Detection with CascadeMatch}},
author = {Yuhang Zang and Kaiyang Zhou and Chen Huang and Chen Change Loy},
journal = {International Journal of Computer Vision},
month = {April},
year = {2023},
volume = {131},
number = {4},
publisher = {Springer Science and Business Media LLC},
pages = {987--1001},
doi = {10.1007/s11263-022-01738-x},
url = {https://doi.org/10.1007/s11263-022-01738-x}
}