Crowd counting algorithm based on face detection and skin color recognition

Authors

  • Y.N. Hao Department of Electrical Engineering, Taiyuan Institute of Technology, No.31 Xinlan Road, Taiyuan, Shanxi 030008, China
  • V.C. Tai Centre for Modelling and Simulation, Faculty of Engineering, Built Environment and Information Technology, SEGI University, 47810 Petaling Jaya, Selangor, Malaysia Phone: +60361451777; Fax.: +60361452725
  • Y.C. Tan Centre for Modelling and Simulation, Faculty of Engineering, Built Environment and Information Technology, SEGI University, 47810 Petaling Jaya, Selangor, Malaysia Phone: +60361451777; Fax.: +60361452725

DOI:

https://doi.org/10.15282/jmes.17.3.2023.1.0755

Keywords:

Crowd counting algorithm, Face detection , YCbCr color space , Skin color recognition, Image processing

Abstract

This paper introduces an innovative crowd counting algorithm using skin color information. Through stages of color space transformation, threshold segmentation, morphological processing, and region filtering, the algorithm successfully conducts crowd counting in images. The study encompasses analyses of images with diverse crowd densities, skin colors, backgrounds, and lighting intensities, revealing the algorithm's robustness to various factors. It remains unaffected by skin color and crowd size and exhibits minimal sensitivity to background and lighting intensity. Furthermore, the paper explores image feature analysis and uses MATLAB programming for simulation and initial crowd counting, considering images with different actual crowd sizes.  Despite minor issues such as the insufficient separation of faces from clothing and the influence of lighting intensity, the algorithm performs reliably in most scenarios, demonstrating high crowd counting accuracies. To bolster the accuracy and robustness of the algorithm, optimization of the separation step and control of the lighting effect on images is suggested.  The key focus of this study is the application of the Gaussian model in the YCbCr color space for face detection and examining its impact on the efficiency and accuracy of crowd counting algorithm. The research not only provides a novel approach for crowd counting in images but also offers insightful perspectives for future studies and potential improvements. Thus, the study proves to be a significant contribution to face detection and recognition technology, enhancing its application in fields like public safety, crowd management, and surveillance systems.

References

S. Sharma and V. Kumar, “Performance evaluation of 2D face recognition techniques under image processing attacks,” Modern Physics Letters B, vol. 32, no. 19, p.1850212, 2018.

J. Zeng, X. Qiu, S. Shi, “Image processing effects on the deep face recognition system,”Mathematical Biosciences and Engineering, vol. 18, no. 2, pp.1187–1200, 2021.

J. Liu and M. A. Ashraf, “Face recognition method based on GA-BP neural network algorithm,” Open Physics, vol. 16, no. 1, pp.1056–1065, 2018.

Q. Wang and G. Guo, “Benchmarking deep learning techniques for face recognition,” Journal of Visual Communication and Image Representation, vol. 65, p.102663, 2019.

J. Lu, X. Yuan, and T. Yahagi, “A method of face recognition based on fuzzy clustering and parallel neural networks,” Signal Processing, vol. 86, no. 8, pp.2026–2039, 2006.

G. Guo and N. Zhang, “A survey on deep learning-based face recognition,” Computer Vision and Image Understanding, vol. 189, p.102805, 2019.

H. Mo et al., “Background noise filtering and distribution dividing for crowd counting,” IEEE Transactions on Image Processing, vol. 29, pp.8199–8212, 2020.

W. Ge and R. T. Collins, “Marked point processes for crowd counting,” 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, USA, vol. 1-4, pp.2913–2920, 2009.

A. Hudaib and K. Kaabneh, “Hybrid model for people counting in a video stream,” 12thWSEAS International Conference on Computers, Heraklion, Greece, pp.482-486, 2008.

C. Zan, B. Liu, W. Guan, K. Zhang, and W. Liu, “Learn from object counting: Crowd counting with Meta‐learning,” IET Image Processing, vol. 15, no. 14, pp.3543–3550, 2021.

M. Stec, V. Herrmann, and B. Stabernack, “Multi-sensor-fusion system for people counting applications,” 1stInternational Conference on Societal Automation (SA), Krakow, Poland, pp.1–4, 2019.

P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA. vol. 1, pp.511-518, 2001.

S. Saxena and D. Songara, “Design of people counting system using MATLAB,” 10thInternational Conference on Contemporary Computing (IC3), Noida, pp.345-347, 2017.

E. Ledda, L. Putzu, R. Delussu, G. Fumera, and F. Roli, “On the evaluation of video-based crowd counting models,” Image Analysis and Processing –ICIAP 2022, in Lecture Notes in Computer Science, vol. 13233, pp.301–311, 2022.

H. A. Nugroho, R. D. Goratama, and E. L. Frannita, “Face recognition in four types of colour space: a performance analysis,” IOP Conference Series: Materials Science and Engineering, vol. 1088, no. 1, p.012010, 2021.

D. J. Sawicki and W. Miziolek, “Human colour skin detection in CMYK colour space,” IET Image Processing, vol. 9, no. 9, pp.751–757, 2015.

X. Yang, N. Liang, W. Zhou, and H. Lu, “A face detection method based on skin color model and improved AdaBoost algorithm,” Traitement du Signal,vol. 37, no. 6, pp.929–937, 2020.

S. Kang, B. Choi, and D. Jo, “Faces detection method based on skin color modeling,” Journal of Systems Architecture, vol. 64, pp.100–109, 2016.

M. Fachrurrozi and K. K. Afif, “Face detection using the Viola-Jones method with segmentation of skin color on face images,” Journal of Engineering Science and Technology, vol. 15, no. 4, pp.2149–2162, 2020.

R. Mohanty and M. V. Raghunadh, “A new approach to face detection based on YCgCr color model and improved AdaBoost algorithm,” International Conference on Communication and Signal Processing (ICCSP), Tamilnadu, India, vol. 1, pp.1392–1396, 2016.

M. Ryan and N. Hanafiah, “An examination of character recognition on ID card using template matching approach,” Procedia Computer Science, vol. 59, pp.520–529, 2015.

T. Chen, T. Chen, and Z. Chen, “An intelligent people-flow counting method for passing through a gate,” IEEE Conference on Robotics, Automation and Mechatronics,Bangkok, Thailand, vol. 1-2, pp.1–6, 2006.

S.-K. Ueng and C.-Y. Chang, “An improved skin color model,” International Conference on Applied System Innovation (ICASI), Okinawa, Japan, pp.1–4, 2016.

H. Foroughi, N. Ray, and H. Zhang, “Robust people counting using sparse representation and random projection,” Pattern Recognition, vol. 48, no. 10, pp.3038–3052, 2015.

A. J. Ma, P. C. Yuen, and Jian-Huang Lai, “Linear dependency modeling for classifier fusion and feature combination,” IEEE Transactions on Pattern Analysis and Machine Intelligence., vol. 35, no. 5, pp.1135–1148, 2013.

Downloads

Published

2023-09-27

How to Cite

[1]
YaNan Hao, V.C. Tai, and Y.C. Tan, “Crowd counting algorithm based on face detection and skin color recognition”, J. Mech. Eng. Sci., pp. 9542–9551, Sep. 2023.

Issue

Volume 17 No. 3 (September 2023)

Section

Article

License

Copyright (c) 2023 Universiti Malaysia Pahang Publishing

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.