AAAI · 2020
KPNet: Towards Minimal Face Detector
Key takeaway
KPNet builds a compact face detector by predicting facial keypoints first and deriving bounding boxes from them, avoiding complex anchor and detection-head designs. arXiv abstract · v1
Abstract
The small receptive field and capacity of minimal neural networks limit their performance when using them to be the backbone of detectors. In this work, we find that the appearance feature of a generic face is discriminative enough for a tiny and shallow neural network to verify from the background. And the essential barriers behind us are 1) the vague definition of the face bounding box and 2) tricky design of anchor-boxes or receptive field. Unlike most top-down methods for joint face detection and alignment, the proposed KPNet detects small facial keypoints instead of the whole face by in a bottom-up manner. It first predicts the facial landmarks from a low-resolution image via the well-designed fine-grained scale approximation and scale adaptive soft-argmax operator. Finally, the precise face bounding boxes, no matter how we define it, can be inferred from the keypoints. Without any complex head architecture or meticulous network designing, the KPNet achieves state-of-the-art accuracy on generic face detection and alignment benchmarks with only ≈1M parameters, which runs at 1000fps on GPU and is easy to perform real-time on most modern front-end chips.
Author abstract · arXiv abstract · v1
Publication
AAAI Conference on Artificial Intelligence (AAAI), 2020
Paper and resources
Research topics
KPNet · Lightweight face detection · Facial landmark detection · Bottom-up detection · Scale-adaptive soft-argmax · Compact neural networks · Face alignment · Real-time vision
Research problem and approach
Tiny detector backbones have limited receptive fields and capacity. KPNet exploits discriminative facial landmarks with fine-grained scale approximation and a scale-adaptive soft-argmax, then reconstructs face boxes in a bottom-up manner. arXiv abstract · v1
Main contributions
- Unifies face localization and alignment through keypoint-first prediction. arXiv abstract · v1
- Uses scale-aware landmark decoding to support a small, shallow network. arXiv abstract · v1
Method comparison
| Approach | Key difference |
|---|---|
| Top-down face detection and alignment | Detects face boxes with designs sensitive to box definitions, anchors and receptive fields. |
| KPNet | Predicts landmarks first with scale-aware decoding and derives bounding boxes from those keypoints. |
Selected results
- At 50 false positives, scale-adaptive soft-argmax gives 69.32% recall on FDDB rotated −90° and 69.97% at +90°, versus 50.65% and 49.9% for argmax decoding. On unrotated FDDB the corresponding recalls are 91.6% and 88.98%. Table 2 · rotation robustness, DRNet backbone · arXiv v1
- For DRNet, adding scale-adaptive soft-argmax raises FDDB recall at one false positive from 47.3% to 81.1%; recall at 50 false positives changes from 90.7% to 91.6%. The stricter operating point highlights the reduction in localization errors. Table 3 · localization-error ablation · arXiv v1
Cite this paper
Guanglu Song, Yu Liu, Yuhang Zang, Xiaogang Wang, Biao Leng, Qingsheng Yuan. KPNet: Towards Minimal Face Detector. Proceedings of the AAAI Conference on Artificial Intelligence, 34(07), 2020, pp. 12015–12022.
@article{arxiv200307543,
title = {{KPNet: Towards Minimal Face Detector}},
author = {Guanglu Song and Yu Liu and Yuhang Zang and Xiaogang Wang and Biao Leng and Qingsheng Yuan},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
month = {April},
year = {2020},
volume = {34},
number = {07},
publisher = {Association for the Advancement of Artificial Intelligence (AAAI)},
pages = {12015--12022},
doi = {10.1609/aaai.v34i07.6878},
url = {https://doi.org/10.1609/aaai.v34i07.6878}
}