Vision-Based Vehicle Classification for Smart City
Article Sidebar
-
Vehicle Classification, Image Recognition, Vision-Based, Smart City
Abstract
Vehicle detection systems are essential for improving traffic management, enhancing safety, supporting law enforcement, facilitating toll collection, and contributing to smart city initiatives through real-time monitoring and data analysis. With the rapid growth of smart city technologies, the need for efficient, scalable, and high-accuracy vehicle detection models has become increasingly critical. This study aims to propose an advanced vehicle detection system using Convolutional Neural Networks (CNNs) in combination with the YOLOv5 model, which is known for its high-speed performance and superior accuracy in image recognition tasks. The proposed model is evaluated using a custom-trained YOLOv5s model, tested on a dataset comprising 1460 images of vehicles. These images are divided into five classes which are cars, motorcycles, trucks, ambulances, and buses. Performance evaluation metrics such as precision, recall, and mean Average Precision (mAP50-95) are used to assess the model's effectiveness. The results indicate that the YOLOv5-based model achieved impressive detection accuracy, with precision, recall, and mAP values exceeding 87%. The proposed system demonstrates its robustness in detecting and classifying various vehicle types across different conditions, including small, partially visible, and distant vehicles. The findings suggest that this model holds significant potential for real-world applications in urban traffic management and smart city infrastructure.
Full text article
References
B. Kidmose, “A review of smart vehicles in smart cities: Dangers, impacts, and the threat landscape,” Vehicular Communications, p. 100871, 2024.
D. Oladimeji, K. Gupta, N. A. Kose, K. Gundogan, L. Ge, and F. Liang, “Smart transportation: an overview of technologies and applications,” Sensors, vol. 23, no. 8, p. 3880, 2023.
B. E. Maryono, V. R. Handoko, A. Maduwinarti, and C. Gusmao, “Analysis of npm based public policy to enhance sustainability performance: A grounded theory,” Aptisi Transactions on Technopreneurship (ATT), vol. 7, no. 1, pp. 97–108, 2025.
D. K. Dewangan and S. P. Sahu, “Towards the design of vision-based intelligent vehicle system: methodologies and challenges,” Evolutionary Intelligence, vol. 16, no. 3, pp. 759–800, 2023.
A. Sabha and A. Selwal, “Towards machine vision-based video analysis in smart cities: a survey, framework, applications and open issues,” Multimedia Tools and Applications, vol. 83, no. 22, pp. 62 107–62 158, 2024.
Q. Aini, D. Manongga, U. Rahardja, I. Sembiring, and Y.-M. Li, “Understanding behavioral intention to use of air quality monitoring solutions with emphasis on technology readiness,” International Journal of Human–Computer Interaction, pp. 1–21, 2024.
A. A. Iswandi, H. R. Ngemba, S. Hendra, M. N. D. Ulhaq, A. Iswandi, H. Ngemba, S. Hendra, S. Syahrullah, and M. Noval Daffa Ulhaq, “Implementasi algoritma rc4 pada sistem informasi pelaporan dukcapil provinsi sulawesi tengah,” 2024.
J. D. Trivedi, S. D. Mandalapu, and D. H. Dave, “Vision-based real-time vehicle detection and vehicle speed measurement using morphology and binary logical operation,” Journal of Industrial Information Integration, vol. 27, p. 100280, 2022.
A. Chetouane, S. Mabrouk, I. Jemili, and M. Mosbah, “Vision-based vehicle detection for road traffic congestion classification,” Concurrency and Computation: Practice and Experience, vol. 34, no. 7, p. e5983, 2022.
R. Sivaraman, M.-H. Lin, M. I. C. Vargas, S. I. S. Al-Hawary, U. Rahardja, F. A. H. Al-Khafaji, E. V. Golubtsova, and L. Li, “Multi-objective hybrid system development: To increase the performance of diesel/photovoltaic/wind/battery system.” Mathematical Modelling of Engineering Problems, vol. 11, no. 3, 2024.
A. Rehman, T. Saba, M. Z. Khan, R. Damaˇseviˇcius, and S. A. Bahaj, “Internet-of-things-based suspicious activity recognition using multimodalities of computer vision for smart city security,” Security and communication Networks, vol. 2022, no. 1, p. 8383461, 2022.
T. G. Mondal and M. R. Jahanshahi, “Applications of computer vision-based structural health monitoring and condition assessment in future smart cities,” The rise of smart cities, pp. 193–221, 2022.
S. I. Al-Hawary, J. R. N. Alvarez, A. Ali, A. K. Tripathi, U. Rahardja, I. H. Al-Kharsan, R. M. Romero-Parra, H. A. Marhoon, V. John, and W. Hussian, “Multiobjective optimization of a hybrid electricity
generation system based on waste energy of internal combustion engine and solar system for sustainable environment,” Chemosphere, vol. 336, p. 139269, 2023.
L. Masello, G. Castignani, B. Sheehan, F. Murphy, and K. McDonnell, “On the road safety benefits of advanced driver assistance systems in different driving contexts,” Transportation research interdisciplinary perspectives, vol. 15, p. 100670, 2022.
I. G. N. A. K. Dwi, L. Bethany, O. Smith et al., “Empowering tourism communication for sustainable village development,” Startupreneur Business Digital (SABDA Journal), vol. 3, no. 2, pp. 123–130, 2024.
N. Shankaranarayan and S. S. Kamath, “Deep vision based vehicle retrieval for automated smart traffic surveillance systems,” in 2022 3rd International Conference on Computation, Automation and Knowledge Management (ICCAKM). IEEE, 2022, pp. 1–8.
U. Rahardja, A. Sari, A. H. Alsalamy, S. Askar, A. H. R. Alawadi, and B. Abdullaeva, “Tribological properties assessment of metallic glasses through a genetic algorithm-optimized machine learning model,” Metals and Materials International, vol. 30, no. 3, pp. 745–755, 2024.
M. I. Basheer Ahmed, R. Zaghdoud, M. S. Ahmed, R. Sendi, S. Alsharif, J. Alabdulkarim, B. A. Al-bin Saad, R. Alsabt, A. Rahman, and G. Krishnasamy, “A real-time computer vision based approach to detection and classification of traffic incidents,” Big data and cognitive computing, vol. 7, no. 1, p. 22, 2023.
S. Pandey, B. Meenakshi, A. Sneha, N. Charan, and G. Monesh, “Research on enhancing accuracy in vehicle detection,” in 2023 International Conference on Power, Instrumentation, Control and Computing (PICC). IEEE, 2023, pp. 1–6.
M. Zaidan, N. T. Lapatta, and L. P. Pasha, “Optimalisasi pemasaran digital adaptif untuk mendorong keberlanjutan e-commerce di era transformasi digital,” ADI Pengabdian Kepada Masyarakat, vol. 5, no. 1, pp. 7–17, 2024.
D. Fern´andez Llorca, A. Hern´andez Mart´ınez, and I. Garc´ıa Daza, “Vision-based vehicle speed estimation: A survey,” IET Intelligent Transport Systems, vol. 15, no. 8, pp. 987–1005, 2021.
P. Premaratne, I. J. Kadhim, R. Blacklidge, and M. Lee, “Comprehensive review on vehicle detection, classification and counting on highways,” Neurocomputing, vol. 556, p. 126627, 2023.
M. I. Pavel, S. Y. Tan, and A. Abdullah, “Vision-based autonomous vehicle systems based on deep learning: A systematic literature review,” Applied Sciences, vol. 12, no. 14, p. 6831, 2022.
M. N. Chan and T. Tint, “A review on advanced detection methods in vehicle traffic scenes,” in 2021 6th International Conference on Inventive Computation Technologies (ICICT). IEEE, 2021, pp. 642–649.
B. Neupane, T. Horanont, and J. Aryal, “Real-time vehicle classification and tracking using a transfer learning-improved deep learning network,” Sensors, vol. 22, no. 10, p. 3813, 2022.
R. G. Munthe, M. Abbas, R. Fernandez, and N. Ulita, “The impact of educational information systems on learning accessibility in higher education,” International Transactions on Education Technology (ITEE), vol. 3, no. 1, pp. 94–103, 2024.
V. A. Adewopo and N. Elsayed, “Smart city transportation: Deep learning ensemble approach for traffic accident detection,” IEEE Access, 2024.
A. Rashed, Y. Abdulazeem, T. A. Farrag, A. Bamaqa, M. Almaliki, M. Badawy, and M. A. Elhosseini, “Toward inclusive smart cities: Sound-based vehicle diagnostics, emergency signal recognition, and beyond,” Machines, vol. 13, no. 4, p. 258, 2025.
J. van der Merwe, S. M. Wahid, G. P. Cesna, D. A. Prabowo et al., “Improving natural resource management through ai: Quantitative analysis using smartpls,” International Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 135–142, 2024.
K. Darwhekar, A. Patil, S. Ghodke, R. Bawkar, and S. Rudrawar, “Computer vision based intelligent traffic management system,” in 2022 6th International Conference on Electronics, Communication and Aerospace Technology. IEEE, 2022, pp. 1051–1056.
D. Mavrokapnidis, N. Mohammadi, and J. Taylor, “Community dynamics in smart city digital twins: A computer vision-based approach for monitoring and forecasting collective urban hazard exposure,” in Proceedings of the Annual Hawaii International Conference on System Sciences, 2021.
I. C. Kawi and W. Pontjoharyo, “Integrating buddhist principles into management control systems: A cattari ariya saccani approach,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 2sp, pp. 146–161, 2023.
T. Kustu and A. Taskin, “Deep learning and stereo vision based detection of post-earthquake fire geolocation for smart cities within the scope of disaster management: ˙Istanbul case,” International journal of disaster risk reduction, vol. 96, p. 103906, 2023.
I. Gudmundsson and G. Falco, “Porting computer vision models to the edge for smart city applications: Enabling autonomous vision-based power line inspection at the smart grid edge for unmanned aerial vehicles (uavs).” in HICSS, 2022, pp. 1–10.
A. H. Aditiya, H. Hamdan, S. N. W. Putra, S. Visiana, and R. Thakkar, “Transforming education with genai: Case study on chatgpt, midjourney, and policy changes,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 1, pp. 20–27, 2025.
A. Aboah, “A vision-based system for traffic anomaly detection using deep learning and decision trees,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 4207–4212.
J. Mahale, D. Rout, B. Roy, and A. Khang, “Vehicle and passenger identification in public transportation to fortify smart city indices,” in Smart Cities. CRC Press, 2023, pp. 231–255.
T. Mariyanti, Y. Z. Basri, and J. Jazuli, “The basic factors driving the intention to pay zakat,” Aptisi Transactions on Management, vol. 6, no. 1, pp. 30–41, 2022.
R. Kashaf, E. P. Alegre, T. Prova, and S. Aggarwal, “Automated waste management using a customized ision-based transformer model,” in 2024 IEEE World AI IoT Congress (AIIoT). IEEE, 2024, pp. 300–
D. P. Lazirkha, J. Hom, and V. Melinda, “Quality analysis of digital business services in improving customer satisfaction,” Startupreneur Business Digital (SABDA Journal), vol. 1, no. 2, pp. 156–166, 2022.
A. Boukerche and X. Ma, “Vision-based autonomous vehicle recognition: A new challenge for deep learning-based systems,” ACM Computing Surveys (CSUR), vol. 54, no. 4, pp. 1–37, 2021.
D. Singh, A. Kumar, and R. Singh, “Multiple object tracking of autonomous vehicles for sustainable and smart cities,” in Object Tracking Technology: Trends, Challenges and Applications. Springer, 2023, pp. 201–219.
R. Aprianto, R. Haris, A. Williams, H. Agustian, and N. Aptwell, “Social influence on ai-driven air quality monitoring adoption: Smartpls analysis,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 1, pp. 28–36, 2025.
J. Azimjonov and A. ¨Ozmen, “Vision-based vehicle tracking on highway traffic using bounding-box features to extract statistical information,” Computers & Electrical Engineering, vol. 97, p. 107560, 2022.
R. Widayanti, M. H. R. Chakim, C. Lukita, U. Rahardja, and N. Lutfiani, “Improving recommender systems using hybrid techniques of collaborative filtering and content-based filtering,” Journal of Applied Data Sciences, vol. 4, no. 3, pp. 289–302, 2023.
A. Ramadhan, B. Bhima, and T. Nurtino, “Integrated energy system systems and game theory a review,” International Transactions on Artificial Intelligence, vol. 1, no. 1, pp. 84–101, 2022.
I. Maria et al., “Unlocking success: Human resource management for startupreneur,” Startupreneur Business Digital (SABDA Journal), vol. 3, no. 1, pp. 89–97, 2024.
A. Vijayakumar and S. Vairavasundaram, “Yolo-based object detection models: A review and its applications,” Multimedia Tools and Applications, vol. 83, no. 35, pp. 83 535–83 574, 2024.
Government of Malaysia, “Malaysia smart city framework (mscf),” Online; portal Malaysia, n.d. [Online]. Available: https://www.malaysia.gov.my/portal/content/30947
Ministry of Housing and Local Government Malaysia (KPKT), “Smart city framework for malaysia: Executive summary,” 2021. [Online]. Available: https://www.kpkt.gov.my/kpkt/resources/user 1/GALERI/PDF PENERBITAN/FRAMEWORK/FRAMEWORK SMART CITY EXECUTIVE SUMMARY.pdf
G. Fatima and S. Saeed, “A novel weighted ensemble method to overcome the impact of under-fitting and over-fitting on the classification accuracy of the imbalanced data sets,” Pakistan Journal of Statistics and Operation Research, pp. 483–496, 2021.
E. Casas, L. Ramos, E. Bendek, and F. Rivas-Echeverr´ıa, “Assessing the effectiveness of yolo architectures for smoke and wildfire detection,” IEEe Access, vol. 11, pp. 96 554–96 583, 2023.
S. Setiawan, K. A. Tiara, M. Rustine, D. Hilman, K. Joy, and I. A. Jumbri, “Experiential value and novelty cultivating brand love and behavioral intentions in technopreneurship,” Aptisi Transactions on Technopreneurship (ATT), vol. 7, no. 1, pp. 144–157, 2025.
Authors
Copyright (c) 2025 Ahsiah Ismail, Amelia Ritahani Ismail, Nur Azri Shaharuddin, Muhammad Afiq Ara, Asmarani Ahmad Puzi, Suryanti Awang, Roziana Ramli
This work is licensed under a Creative Commons Attribution 4.0 International License.
This journal permits and encourages authors to post items submitted to the journal on personal websites while providing bibliographic details that credit its publication in this journal.
Authors are permitted to post their work online in institutional/disciplinary repositories or on their own websites. Pre-print versions posted online should include a citation and link to the final published version in Journal of Librarianship and Scholarly Communication as soon as the issue is available; post-print versions (including the final publisher's PDF) should include a citation and link to the journal's website.