Face Recognition from Video by Matching Images Using Deep Learning-Based Models

Authors

DOI:

https://doi.org/10.21015/vtcs.v12i2.1916

Abstract

This paper explores the intersection of video recognition, computer vision, and artificial intelligence, highlighting its broad applicability across various fields. The research focuses on the applications, challenges, ethical dilemmas, and outcomes of artificial intelligence, which continues to grow in significance in the 21st century. We propose a systematic approach that incorporates models for face detection, feature extraction, and recognition. Our methodology includes the accurate segmentation of 100 human faces from video frames, with each face averaging 150x150 pixels. The feature extraction process yielded 1,000 face feature vectors, with an average size of 128, representing key characteristics for recognition. By applying a cosine similarity threshold of 0.7, we filtered irrelevant data and determined whether the two images matched. Our recognition system achieved 85% accuracy, demonstrating the effectiveness of the models and techniques employed. Additionally, ethical considerations were addressed, emphasizing the importance of data privacy, informed consent, cybersecurity, and transparency. This research advances the understanding of face recognition from video data and highlights the need for further exploration in this domain.

References

Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 1701–1708.

X.-X. Li and R.-H. Liang, "A review for face recognition with occlusion: from subspace regression to deep learning," Chinese Journal of Computers, vol. 41, no. 1, pp. 177–207, 2018.

A. A. Abro, M. S. H. Talpur, and A. K. Jumani, "Natural language processing challenges and issues: A literature review," Gazi University Journal of Science, pp. 1–1, 2023.

A. J. Shepley, "Deep learning for face recognition: a critical analysis," arXiv preprint arXiv:1907.12739, 2019.

S. Kanagamalliga, R. Abishek, B. B. S. Krishna, and P. Vinayagam, "Advancements in real-time face recognition algorithms for enhanced smart video surveillance," Procedia Computer Science, vol. 230, pp. 486–492, 2023.

W. Ali, W. Tian, S. U. Din, D. Iradukunda, and A. A. Khan, "Classical and modern face recognition approaches: a complete review," Multimedia Tools and Applications, vol. 80, pp. 4825–4880, 2021.

S. Moiz, A. A. Abro, M. Ebrahim, and A. B. Abro, "Unveiling the arsenal of user data protection tools and practices," in 2024 IEEE 1st Karachi Section Humanitarian Technology Conference (KHI-HTC). IEEE, 2024, pp. 1–7.

S. Moiz, A. Majid, A. Basit, M. Ebrahim, A. A. Abro, and M. Naeem, "Security and threat detection through cloud-based Wazuh deployment," in 2024 IEEE 1st Karachi Section Humanitarian Technology Conference (KHI-HTC). IEEE, 2024, pp. 1–5.

F. J. M. Shamrat, M. Al Jubair, M. M. Billah, S. Chakraborty, M. Alauddin, and R. Ranjan, "A deep learning approach for face detection using max pooling," in 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI). IEEE, 2021, pp. 760–764.

S. Khan, S. Vohra, S. A. Siddique, A. A. Abro, and M. Ebrahim, "A computer vision-based vehicle detection system leveraging deep learning," in 2024 IEEE 1st Karachi Section Humanitarian Technology Conference (KHI-HTC). IEEE, 2024, pp. 1–7.

J. Chai, H. Zeng, A. Li, and E. W. Ngai, "Deep learning in computer vision: A critical review of emerging techniques and application scenarios," Machine Learning with Applications, vol. 6, p. 100134, 2021.

L. Tharaka, D. Vidanagama, and W. Wijayarathne, "Voice command and face motion based activated web browser for differently abled people," 2022.

A. A. Abro, "Vote-based: Ensemble approach," Sakarya University Journal of Science, vol. 25, no. 3, pp. 858–866, 2021.

A. A. Abro, E. Taşcı, and A. Ugur, "A stacking-based ensemble learning method for outlier detection," Balkan Journal of Electrical and Computer Engineering, vol. 8, no. 2, pp. 181–185, 2020.

S. M. Daniyal, A. Masood, M. Ebrahim, S. H. Adil, and K. Raza, "An improved face recognition method based on convolutional neural network," Journal of Independent Studies and Research Computing, vol. 22, no. 1, pp. 103–110, 2024.

S. M. Daniyal, M. M. Abbasi, D. Hussain, U. Amjad, A. B. Abro, and M. Naeem, "A hybrid approach for simultaneous effective automobile navigation with DE and PSO," VAWKUM Transactions on Computer Sciences, vol. 12, no. 2, pp. 01–15, 2024.

M. M. Abbasi, S. M. Daniyal, A. A. Abro, D. Hussain, U. Amjad, and N. B. Zahid, "Applying neural networks to predict ventilator demand: A study of Pakistan’s healthcare sector," VFAST Transactions on Software Engineering, vol. 12, no. 3, pp. 217–229, 2024.

M. H. Irshad, M. Ebrahim, A. A. Abro, K. Raza, and S. H. Adil, "Detecting shadows in computer vision: A MATLAB-based approach," The Asian Bulletin of Big Data Management, vol. 4, no. 1, pp. Science–4, 2024.

A. A. Abro, W. A. Sıddıque, M. S. H. Talpur, A. K. Jumani, and E. Yaşar, "A combined approach of base and meta learners for hybrid system," Turkish Journal of Engineering, vol. 7, no. 1, pp. 25–32, 2023.

J.-N. Zaech, "Vision for autonomous systems: From tracking and prediction to quantum computing," Ph.D. dissertation, ETH Zurich, 2024.

S. Mhammedi, N. Gherabi, H. El Massari, Z. Sabouri, and M. Amnai, "A highly scalable CF recommendation system using ontology and SVD-based incremental approach," Bulletin of Electrical Engineering and Informatics, vol. 12, no. 6, pp. 3768–3779, 2023.

T. T. Nguyen, M. T. Dang, A. V. Luong, A. W.-C. Liew, T. Liang, and J. McCall, "Multi-label classification via incremental clustering on an evolving data stream," Pattern Recognition, vol. 95, pp. 96–113, 2019.

A. K. Shukla, A. Shukla, and R. Singh, "Automatic attendance system based on CNN–LSTM and face recognition," International Journal of Information Technology, vol. 16, no. 3, pp. 1293–1301, 2024.

G. Srivastava and S. Bag, "Modern-day marketing concepts based on face recognition and neuro-marketing: A review and future research directions," Benchmarking: An International Journal, vol. 31, no. 2, pp. 410–438, 2024.

——, "Modern-day marketing concepts based on face recognition and neuro-marketing: A review and future research directions," Benchmarking: An International Journal, vol. 31, no. 2, pp. 410–438, 2024.

X. Zhou and T.-c. Zhu, "Survey of research on face recognition methods based on depth learning," in Journal of Physics: Conference Series, vol. 2717, no. 1. IOP Publishing, 2024, p. 012027.

S. S. Khan, D. Sengupta, A. Ghosh, and A. Chaudhuri, "MTCNN++: A CNN-based face detection algorithm inspired by MTCNN," The Visual Computer, vol. 40, no. 2, pp. 899–917, 2024.

D. Tribuana, A. L. Arda et al., "Image preprocessing approaches toward better learning performance with CNN," Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 8, no. 1, pp. 1–9, 2024.

J. Anil, L. P. Suresh, P. Muthukumar, S. K. Veni, P. Asha, and R. Prasad, "Literature survey on face recognition of occluded faces," in 2024 7th International Conference on Circuit Power and Computing Technologies (ICCPCT), vol. 1. IEEE, 2024, pp. 1930–1937.

A. Khalifa, A. A. Abdelrahman, T. Hempel, and A. Al-Hamadi, "Towards efficient and robust face recognition through attention-integrated multi-level CNN," Multimedia Tools and Applications, pp. 1–23, 2024.

Downloads

Published

2024-10-21

How to Cite

Latif, M., Ebrahim, M., Abro , A. S., Ahmed , M., Abbasi , M. D., & Tunio, I. A. (2024). Face Recognition from Video by Matching Images Using Deep Learning-Based Models. VAWKUM Transactions on Computer Sciences, 12(2), 50–64. https://doi.org/10.21015/vtcs.v12i2.1916