Traffic Light Detection: A cost effective approach

Muhammad Iftikhar, Omer Riaz, Tanvir Ali, Shahzad Mumtaz, Waqas Sharif, Humaira Arshad

Abstract


In last couple of decades, the technological advancements in image and video processing has brought great revolution in our life. Some of the key areas where these advancements have played a key role are: autonomous vehicles, drone technology, crowd monitoring, traffic monitoring, object tracking etc. Nowadays a lot of work is under process for improving capabilities of autonomous vehicles and driver assisted systems. Our focus in this paper is related to automated traffic light detection system with improved capabilities in terms of time complexity and accuracy. The time complexity is directly related to image or video quality with regard to resolution of video and the accuracy is often compromised because of identification of similar objects. The similar objects often appear in video frames when each frame of video is analyzed completely. In order to solve the problem of real time detection of traffic lights in a high-resolution video having 30 frames per second with a resolution of 1280 × 720, we propose an algorithm that systematically searches in middle 70% region of each frame. The proposed algorithm optimizes the search space by dividing middle region into 3. There are three methods for searching and registering a traffic light is proposed in this paper. The basic concept is at single instance a traffic light can exist on one of these three regions. These trategies help in reducing computation complexity tremendously. The Hough Circle Transform technique of image processing is exploited to accurately detect red and green circles of light in the traffic light. Efficacy of the proposed technique in terms of improved time and accuracy is demonstrated on a real dataset collected from Nexar (dashcam mobile solution provider), it encompasses different illumination conditions: day, evening, night, cludy weather and rain etc.


Full Text:

PDF

References


M. Diaz-Cabrera, P. Cerri and J. S. Medina, "Suspended traffic lights detection and distance estimation using color features," Intelligent Transportation Systems (ITSC), 2012 15th International IEEE, p. 1315–1320, 2012.

J. Roters, X. Jiang and K. Rothaus, "Recognition of traffic lights in live video streams on mobile devices," IEEE Transactions on Circuits and Systems for Video, p. 1497–1511, 2011.

V. Ivanchenko, J. Coughlan and H. Shen, "Real-time walk light detection with a mobile phone," Computers helping people with special needs, pp. 229-234, 2010.

K. T. Kim, "Stvc: Secure traffic-light to vehicle communication," Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), 2012 4th International Congress on. IEEE, pp. 96- 104, 2012.

H. C. N. Premachandra, T. Yendo, M. P. Tehrani, T. Yamazato, H. Okada, T. Fujii and M. Tanimoto, "High-speed-camera image processing based LED traffic light detection for road-to-vehicle visible light communication," Intelligent Vehicles Symposium (IV), 2010 IEEE, p. 793–798, 2010.

X.-P. Du, H. Xiong and X.-F. Li, "Traffic Light Recognition Based on Prior Knowledge and Optimized Threshold Segmentation," Journal of Computers, pp. 197-205, 2017.

C. Yu, C. Huang and Y. Lang, "Traffic light detection during day and night conditions by a camera," Signal Processing (ICSP), 2010 IEEE 10th International Conference on. IEEE, pp. 821-824, 2010

T.-P. Sung and H.-M. Tsai, "Real-time traffic light recognition on mobile devices with geometrybased filtering," Distributed Smart Cameras (ICDSC) 2013 Seventh International Conference on.IEEE, pp. 1-7, 2013.

D. H. Widyantoro and K. I. Saputra, "Traffic lights detection and recofnition based on colorsegnentation and circle hough transform," Data and Software Engineering (ICoDSE), 2015 International Conference on. IEEE, p. 2015, 237-240.

D. Barnes, W. Maddern and I. Posner, "Exploiting 3D semantic scene priors for online traffic lightinterpretation," Intelligent Vehicles Symposium (IV) 2015 IEEE, pp. 573-578, 2015.

M. Diaz-Cabrera and P. Cerri, "Traffic light recognition during the night based on fuzzy logic clustering," International Conference on Computer Aided Systems Theory. Springer, pp. 93-100, 2013.

Y. Zhang, J. Xue, G. Zhang, Y. Zhang and N. Zheng, "A multi-feature fusion based traffic light recognition algorithm for intelligent vehicles," Control Conference (CCC), 2014 33rd Chinese. IEEE, pp. 492-4929, 2014

J. Balcerek, A. Konieczka, T. Marciniak, A. Dąbrowski, K. Maćkowiak and K. Piniarski, "Automatic detection of traffic lights changes from red to green and car turn signals in order to improve urban traffic," Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), pp. 110-115, 2014.

Z. Wang, Z. Deng and Z. Huang, "Traffic Light Detection and Tracking Based on Euclidean Distance Transform and Local Contour Pattern," Proceedings of 2013 Chinese Intelligent Automation Conference. Springer, pp. 623-631, 2013.

C. Y. Shen, Z. Teng, L. Zhou and J. Wang, "A New Approach for Recognition and Position of Traffic Lights," in Proceedings of the International Conference on Computer Information Systems and Industrial Applications, 2015.

T. H.-P. Tran, C. C. Pham, T. P. Nguyen, T. T. Duong and J. W. Jeon, "Real-time traffic light detection using color density," in 2016, 1-4, 016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

C. Wang, T. JIn, M. Yang and B. Wang, "Robust and Real-Time Traffic Lights Recognition in Complex Urban Environments," International Journal of Computational Intelligence Systems, pp. 1383-1390, 2011.

Y. Jie, C. Xiaomin, G. Pengfei and X. Zhonglong, "A new traffic light detection and recognition algorithm for electronic travel aid," 2013 Fourth International Conference on Intelligent Control and Information Processing (ICICIP), pp. 644-648, 2013.

X. Wang, Y. Wu, P. Yang and Z. Chen, "A Method of Traffic Lights Detection Based on Visual Selective Attention," Proceedings of the First International Conference on Information Sciences, Machinery, Materials and Energy, pp. 827-830, 2015.

G. Siogkas, E. Skodras and E. Dermatas, "Traffic Lights Detection in Adverse Conditions Using Color, Symmetry and Spatiotemporal Information," Conference: International Conference on Computer Vision Theory and Applications, pp. 60-627, 2012

S. Sooksatra and T. Kondo, "Red and Yellow Traffic Lights

Detection Robust to Various Lighting Conditions," Thammasat International Journal of Science and Technology, pp. 67-78, 2015.

A. F. Said, M. K. Hazrati and F. Akhbari, "Real-time detection and classification of traffic lightsignals," Applied Imagery Pattern Recognition Workshop (AIPR), 2016 IEEE, pp. 1-5, 2016

W. Zong and Q. Chen, "Traffic Light Detection Based on Multi-feature Segmentation and Online Selecting Scheme," Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on. IEEE, pp. 204-209, 2014.

N. Wu and H. Fang, "A novel traffic light recognition method for traffic monitoring systems," Intelligent Robot Systems (ACIRS), 2017 2nd Asia-Pacific Conference on. IEEE., pp. 141-145, 2017.

B. Fan, W. Lin and X. Yang, "An efficient framework for recognizing traffic lights in night traffic images," Image and Signal Processing (CISP), 2012 5th International Congress on. IEEE, pp. 832- 835, 2012.

S. Sooksatra and T. Kondo, "Red traffic light detection using fast radial symmetry transform," Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 2014 11th International Conference on. IEEE, pp. 1-6, 2014.

N. Bhattacharayya, A. K. Singh, S. Kapil, H. Jain and A. Jain, "Traffic Light Solution for U.G.V. Using Digital Image Processing," International Journal of Soft Computing and Engineering (IJSCE), pp. 2231-2307, 2014.

V. Haltakov, J. Mayr, C. Unger and S. Ilic, "Semantic Segmentation Based Traffic Light Detection at Day and at Night," German Conference on Pattern Recognition. Springer, pp. 446-457, 2015

Z. Cai, M. Gu and Y. Li, "Real-time arrow traffic light recognition system for intelligent vehicle," Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV), 2012.

Q. Chen, Z. Shi and Z. Zou, "Robust and real-time traffic light recognition based on hierarchical vision architecture," Image and Signal Processing (CISP), 2014 7th International Congress on IEEE, pp. 114-119, 2014.

J. L. Binangkit and D. H. Widyantoro, "Increasing accuracy of traffic light color detection and recognition using machine learning," Telecommunication Systems Services and Applications (TSSA) 2016 10th International Conference on. IEEE, pp. 1-5, 2016.

Y. Zhou, Z. Chen and X. Huang, "A system-on-chip FPGA design for real-time traffic signal recognition system," Circuits and Systems (ISCAS), 2016 IEEE International Symposium on. IEEE, pp. 1778-1781, 2016.

Z. Chen and X. Huang, "Accurate and Reliable Detection of Traffic Lights Using Multiclass Learning and Multiobject Tracking," IEEE Intelligent Transportation Systems Magazine, pp. 28-42, 2016

K. Behrendt, L. Novak and R. Botros, "A deep learning approach to traffic lights: Detection, tracking, and classification," Robotics and Automation (ICRA), 2017 IEEE International Conference on. IEEE, pp. 1370-1377, 2017.

G. Mu, Z. Xinyu, L. Deyi, Z. Tianlei and A. Lifeng, "Traffic light detection and recognition for autonomous vehicles," The Journal of China Universities of Posts and Telecommunications, pp. 50- 56, 2015.

Q.-Z. YUAN, M.-C. ZHOU and M. QIU, "Traffic Lights Detection and Recognition Based on Color and Shape with SVM," DEStech Transactions on Computer Science and Engineering, 2016

S. Hosseinyalamdary and A. Yilmaz, "A Bayesian approach to traffic light detection and mapping," ISPRS Journal of Photogrammetry and Remote Sensing, pp. 184-192, 2017.

A. E. Gomez, F. A. R. Alencar, P. V. Prado, F. S. Osório and D. F. Wolf, "Traffic lights detection and state estimation using Hidden Markov Models," 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp. 750-755, 2014.

J. Campbell, H. B. Amor, M. H. Ang and G. Fainekos, "Traffic light status detection using movement patterns of vehicles," 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), pp. 283-288, 2016.

G.-G. Lee and B. K. Park, "Traffic light recognition using deep neural networks," Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, pp. 277-278, 2017.

S. Saini, S. Nikhil, K. R. Konda, H. S. Bharadwaj and N. Ganeshan, "An efficient vision-based trafficlight detection and state recognition for autonomous vehicles," 2017 IEEE Intelligent Vehicles Symposium (IV),, pp. 606-611, 2017.




DOI: http://dx.doi.org/10.21015/vtse.v9i4.836

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.