Entrepreneurial Applications of Augmented Reality in Product Placement on Shelves
Article Sidebar
-
Augmented Reality, Product Placement, Guidance System, Handheld Devices, Wearable Devices
Abstract
A Planogram automation system has been developed to maximize the effectiveness of product arrangements on store shelves. However, its design could not be used at its full potential because of human errors that frequently occur when employees attempt to place products according to a predetermined planogram. These errors reduce both accuracy and efficiency in the implementation process. Previous research addressed this challenge by proposing solutions in the form of automatic planogram compliance supervisors that utilize object detection technology to detect deviations. In contrast, this work proposed another approach to minimize human errors, namely by developing a real-time guidance system for product placement on the shelves using an Augmented Reality (AR) platform. Two different AR devices were implemented, consisting of a handheld Samsung Galaxy Tab S7 and a Video See Through (VST), Head Mounted Display (HMD) using Meta Quest 3, and their performance was compared to the conventional paper-based method. The system was evaluated through a user study involving 11 participants who had prior experience in product placement but no experience with HMD devices. Results showed that paper instruction achieved the best completion time in task performance, while no significant differences were found in error performance. HMD and paper instruction demonstrated similar outcomes on cognitive load, whereas handheld AR showed the worst performance and physical demand. Based on these results and post-task feedback, it can be concluded that although paper instruction remained the most favored method, the HMD demonstrated the greatest potential for future product placement guidance systems.
Full text article
References
[1] J. B. Alves, B. Marques, C. Ferreira, P. Dias, and B. S. Santos, “Comparing augmented reality visualization methods for assembly procedures,” Virtual Reality, pp. 1–14, 2022.
[2] T. Pujiati, H. Setiyowati, B. Rawat, N. P. L. Santoso, and M. G. Ilham, “Exploring the role of artificial intelligence in enhancing environmental health: Utaut2 analysis,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 1, pp. 37–46, 2025.
[3] V. Bondarenko, M. Attawna, G. T. Nguyen, and F. H. Fitzek, “Motion sickness comparison of 2 xr approaches: camera+ screen or hologram on transparent lens (meta quest 3 or microsoft hololens 2),” in 2024 International Electronics Symposium (IES). IEEE, 2024, pp. 728–733.
[4] M. H. R. Chakim, U. Rahardja, E. D. Astuti, E. Erika, and C. T. Hua, “The social empowerment role of the penta helix entrepreneurship ecosystem in driving the national economy,” ADI Pengabdian Kepada Masyarakat, vol. 6, no. 1, pp. 1–13, 2025.
[5] I. Sasono and M. Aman, “Framework of master data management in banking using consolidation and jaro winkler algorithm,” International Journal of Cyber and IT Service Management (IJCITSM), vol. 5, no. 2, pp. 186–197, 2025.
[6] M. Drouot, N. Le Bigot, E. Bricard, J.-L. De Bougrenet, and V. Nourrit, “Augmented reality on industrial assembly line: Impact on effectiveness and mental workload,” Applied Ergonomics, vol. 103, p. 103793, 2022.
[7] S. Lestari, S. Watini, and D. E. Rose, “Impact of self-efficacy and work discipline on employee performance in sociopreneur initiatives,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 2, pp. 270–284, 2024.
[8] V. Havard, D. Baudry, B. Jeanne, A. Louis, and X. Savatier, “A use case study comparing augmented reality (ar) and electronic document-based maintenance instructions considering tasks complexity and operator competency level,” Virtual Reality, pp. 1–16, 2021.
[9] V. Agarwal, S. Verma, A. Bist, U. Rahardja, and P. K. Goel, “Natural language processing (nlp) for policy recommendations in carbon management,” in Advanced Systems for Monitoring Carbon Sequestration. IGI Global Scientific Publishing, 2025, pp. 357–374.
[10] M. Stoica, “The role of technological innovationin merchandising,” Three Seas Economic Journal, no. 4, pp. 19–27, 2023.
[11] A. I. Zulkarnain, N. A. Achsani, M. Siregar, and I. S. Beik, “Enhancing accountability in hajj fund governance through regulatory impact analysis and value chain model,” International Journal of Cyber and IT Service Management (IJCITSM), vol. 5, no. 2, pp. 198–213, 2025.
[12] T. Kitsukawa, M. Takahashi, A. Moro, Y. Harada, H. Nishikawa, M. Noguchi, A. Hamaya, and K. Umeda, “A recognition system of ar markers attached to carts in a factory,” in 2022 IEEE/SICE International Symposium on System Integration (SII). IEEE, 2022, pp. 608–613.
[13] N. Leins, J. Gonnermann-M¨uller, and M. Teichmann, “Comparing head-mounted and handheld augmented reality for guided assembly,” Journal on Multimodal User Interfaces, vol. 18, no. 4, pp. 313–328, 2024.
[14] M. Asri, M. Hardini, D. Apriliasari, U. Rahardja et al., “Influence of technology adoption and internet security on satisfaction and investment decision quality,” in 2024 Ninth International Conference on Informatics and Computing (ICIC). IEEE, 2024, pp. 1–6.
[15] B. R. Maran, L. Giridharan, and R. Krishnaveni, “Augmented reality-based indoor navigation using unity engine,” in 2023 International Conference on Sustainable Computing and Smart Systems (ICSCSS). IEEE, 2023, pp. 1696–1700.
[16] L. Xue, “Designing effective augmented reality platforms to enhance the consumer shopping experiences,” Ph.D. dissertation, Loughborough University, 2022.
[17] A. H. Aditiya, H. Hamdan, S. N. W. Putra, S. Visiana, and R. Thakkar, “Transforming education with genai: Case study on chatgpt, midjourney, and policy changes,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 1, pp. 20–27, 2025.
[18] L. Marinelli, F. Fiano, G. L. Gregori, and L. M. Daniele, “Food purchasing behaviour at automatic vending machines: the role of planograms and shopping time,” British Food Journal, vol. 123, no. 5, pp. 1821–1836, 2021.
[19] M. Saqlain, S. Rubab, M. M. Khan, N. Ali, and S. Ali, “Hybrid approach for shelf monitoring and planogram compliance (hyb-smpc) in retails using deep learning and computer vision,” Mathematical Problems in Engineering, vol. 2022, no. 1, p. 4916818, 2022.
[20] Y. Song, J. Qin, L. Dong, and Y. Zhao, “Design of mobile augmented reality system based on slam,” in 2021 International Conference on Culture-oriented Science & Technology (ICCST). IEEE, 2021, pp. 43–46.
[21] O. Jayanagara and D. S. S. Wuisan, “An overview of concepts, applications, difficulties, unresolved issues in fog computing and machine learning,” International Transactions on Artificial Intelligence, vol. 1, no. 2, pp. 213–229, 2023.
[22] S. A. Umezurike, O. V. Akinrinoye, O. T. Kufile, A. Y. Onifade, B. O. Otokiti, and O. G. Ejike, “Augmented reality shopping experiences: A review of retail immersion technologies and outcomes,” International Journal of Management and Organizational Research, vol. 3, no. 2, pp. 83–94, 2024.
[23] Y. Yan, X. Bai, W. He, S. Wang, X. Zhang, P. Wang, L. Liu, and Q. Yu, “A novel adaptive visualization method based on user intention in ar manual assembly,” The International Journal of Advanced Manufacturing Technology, vol. 129, no. 9, pp. 4705–4730, 2023.
[24] B. E. Sibarani, C. Anggreani, B. Artasya, and D. A. P. Harahap, “Unraveling the impact of self-efficacy, computer anxiety, trait anxiety, and cognitive distortions on learning mind your own business: The student perspective,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 1, pp. 29–40, 2024.
[25] A. Felix, D. Y. Bernanda, A. S. Kembau, F. Effendy, and R. Nathaniel, “Application-based elementary schools interactive education platform analysis and design,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 6, no. 2, pp. 114–128, 2025.
[26] M. E. Y¨ucel and C. ¨Unsalan, “Planogram compliance control via object detection, sequence alignment, and focused iterative search,” Multimedia Tools and Applications, vol. 83, no. 8, pp. 24 815–24 839, 2024.
[27] S. R. Billewar, K. Jadhav, V. Sriram, D. A. Arun, S. Mohd Abdul, K. Gulati, and D. N. K. K. Bhasin, “The rise of 3d e-commerce: the online shopping gets real with virtual reality and augmented reality during covid-19,” World Journal of Engineering, vol. 19, no. 2, pp. 244–253, 2022.
[28] B. Rawat, N. Mehra, A. S. Bist, M. Yusup, and Y. P. A. Sanjaya, “Quantum computing and ai: Impacts & possibilities,” ADI Journal on Recent Innovation, vol. 3, no. 2, pp. 202–207, 2022.
[29] D. Gathmyr, U. Suhud, H. Herlitah, H. Hamidah, R. T. H. Safariningsih, and J. Wilson, “Technological advancements in perceived organizational support enhancing healthcare systems towards sustainable development goals,” Aptisi Transactions on Technopreneurship (ATT), vol. 7, no. 2, pp. 516–526, 2025.
[30] T. Zigart and S. Schlund, “Ready for industrial use? a user study of spatial augmented reality in industrial assembly,” in 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 2022, pp. 60–65.
[31] M. Rakhmansyah, M. S. Hadi, S. R. P. Junaedi, F. A. Ramahdan, and S. N. W. Putra, “Integrating blockchain and ai in business operations to enhance transparency and efficiency within decentralized ecosystems,” ADI Journal on Recent Innovation, vol. 6, no. 2, pp. 157–167, 2025.
[32] B. Berman and D. Pollack, “Strategies for the successful implementation of augmented reality,” Business Horizons, vol. 64, no. 5, pp. 621–630, 2021.
[33] T. Emrich, The Next Dimension: How to Use Augmented Reality for Business Growth in the Era of Spatial Computing. John Wiley & Sons, 2024.
[34] D. S. S. Wuisan, R. A. Sunardjo, Q. Aini, N. A. Yusuf, and U. Rahardja, “Integrating artificial intelligence in human resource management: A smartpls approach for entrepreneurial success,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 3, pp. 334–345, 2023.
[35] M. Ruocco, P. Saeghe, F. Kerber, J. Gugenheimer, M. McGill, and M. Khamis, “From redirected navigation to forced attention: Uncovering manipulative and deceptive designs in augmented reality through retail shopping,” in 2024 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2024, pp. 720–729.
[36] K. Y¨ucel and C. ¨Unsalan, “Automatic planogram compliance checking using deep learning-based object detection,” Journal of Real-Time Image Processing, vol. 21, no. 3, pp. 541–556, 2024.
[37] D. Leone, M. C. Pietronudo, and L. Dezi, “Improving business models through augmented reality applications: evidence from history, theory, and practice,” International Journal of Quality and Innovation, vol. 6, no. 1, pp. 28–42, 2022.
[38] S. Garrido-Jurado, J. Garrido, D. Jurado-Rodr´ıguez, F. V´azquez, and R. Mu˜noz-Salinas, “Reflection-aware generation and identification of square marker dictionaries,” Sensors, vol. 22, no. 21, p. 8548, 2022.
[39] D. Jurado-Rodr´ıguez, R. Mu˜noz-Salinas, S. Garrido-Jurado, and R. Medina-Carnicer, “Planar fiducial markers: a comparative study,” Virtual Reality, 2023.
[40] J. B. Alves, P. Silva, and A. Duarte, “Evaluating interaction techniques in augmented reality environments for training scenarios,” in Proceedings of the 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2022, pp. 450–459.
[41] J. Leins, P. Schneider, and M. Fuchs, “Handheld augmented reality for industrial training: A usability study,” Journal of Industrial Information Integration, vol. 35, p. 101730, 2024.
[42] T. Maran, C. Bogdan, and M. Klein, “Augmented reality in retail: Enhancing consumer product interaction,” Computers in Human Behavior, vol. 138, p. 107515, 2023.
[43] M. Zigart and S. Schlund, “Exploring user interfaces for mobile augmented reality in logistics,” in Proceedings of the 2022 ACM Conference on Human Factors in Computing Systems (CHI ’22), 2022, pp. 1–12.
[44] Z. S. Kabir and K. Kang, “An interaction–engagement–intention model: How artificial intelligence and augmented reality transform the user–platform interaction paradigm,” Electronics, vol. 14, no. 12, p. 2499, 2025.
[45] M. Deshpande, B. Likhita, and N. Bhat, “A personalized supermarket product recommendation system using augmented reality,” ECS Transactions, vol. 107, no. 1, p. 915, 2022.
[46] N. Ramadhona, A. A. Putri, and D. S. S. Wuisan, “Students’ opinions of the use of quipper school as an online learning platform for teaching english,” International Transactions on Education Technology (ITEE), vol. 1, no. 1, pp. 35–41, 2022.
[47] M. Datta and R. Raman, “Ai and ml in retail: Iot sensors and augmented reality for competitive strategies using iot and linear regression,” in 2024 International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE). IEEE, 2024, pp. 1–5.
[48] R. Haris, S. Duygulu, A. Hafidah, R. Syakur, B. Djatmiko, A. Maryam, and A. Indrawati, “Enhancing ecopreneurship competency through bidan elok e-learning based on local wisdom,” Aptisi Transactions on Technopreneurship (ATT), vol. 7, no. 2, pp. 424–440, 2025.
[49] J. Liu, I. Huang, A. Anand, P.-H. Chang, and Y. Huang, “Digital twin in retail: An ai-driven multi-modal approach for real-time product recognition and 3d store reconstruction,” in 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 2024, pp. 368–373.
[50] R. Zimmermann, D. Mora, D. Cirqueira, M. Helfert, M. Bezbradica, D. Werth, W. J. Weitzl, R. Riedl, and A. Auinger, “Enhancing brick-and-mortar store shopping experience with an augmented reality shopping assistant application using personalized recommendations and explainable artificial intelligence,” Journal of Research in Interactive Marketing, vol. 17, no. 2, pp. 273–298, 2023.
[51] G. Chodak, “Augmented reality in e-commerce,” in The Future of E-commerce: Innovations and Devel- opments. Springer, 2024, pp. 147–167.
[52] R. Widayanti, M. H. R. Chakim, C. Lukita, U. Rahardja, and N. Lutfiani, “Improving recommender systems using hybrid techniques of collaborative filtering and content-based filtering,” Journal of Applied Data Sciences, vol. 4, no. 3, pp. 289–302, 2023.
[53] A. Rizky, R. W. Nugroho, W. Sejati, O. Sy et al., “Optimizing blockchain digital signature security in driving innovation and sustainable infrastructure,” Blockchain Frontier Technology, vol. 4, no. 2, pp. 183–192, 2025.
[54] M. D. Devanesan and R. Venkatesh, “Impact of in-store retail technologies on enhancing retail footfall among physical retail formats in india,” Academy of Marketing Studies Journal, vol. 25, no. 6, pp. 1–13, 2021.
[55] R. Aprianto, R. Haris, A. Williams, H. Agustian, and N. Aptwell, “Social influence on ai-driven air quality monitoring adoption: Smartpls analysis,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 1, pp. 28–36, 2025.
[56] A. Stuart, Exploratory Data Analysis in the Behavioral Sciences. New York: Routledge, 2022.
[57] B. G. Tabachnick and L. S. Fidell, Using Multivariate Statistics, 8th ed. Boston: Pearson, 2023.
[58] J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson, Multivariate Data Analysis, 9th ed. Boston: Cengage Learning, 2024.
Authors
Copyright (c) 2026 Nadhif Haikal Farhansyah, Hadziq Fabroyir
This work is licensed under a Creative Commons Attribution 4.0 International License.
This journal permits and encourages authors to post items submitted to the journal on personal websites while providing bibliographic details that credit its publication in this journal.
Authors are permitted to post their work online in institutional/disciplinary repositories or on their own websites. Pre-print versions posted online should include a citation and link to the final published version in Journal of Librarianship and Scholarly Communication as soon as the issue is available; post-print versions (including the final publisher's PDF) should include a citation and link to the journal's website.