Enable Natural User Interactions in Handheld Mobile Augmented Reality through Image Computing скачать в хорошем качестве

Enable Natural User Interactions in Handheld Mobile Augmented Reality through Image Computing

Enable Natural User Interactions in Handheld Mobile Augmented Reality through Image Computing Qinyang Wu (The Hong Kong Polytechnic University); Chen Li (The Hong Kong Polytechnic University) ACM SUI 2024: ACM Symposium on Spatial User Interaction Abstract Augmented Reality (AR) has transformed user interaction with the digital world by merging virtual elements with the physical environment. Although various AR interaction methods have been studied, most research has primarily focused on evaluating interactions within controlled experimental settings, lacking validation in practical application scenarios. This project aims to bridge this gap by using Unity to develop a handheld mobile AR application that simulates the pottery-making process on Android devices. Two versions of the application were developed: a conventional touch-based version and a mid-air natural interaction version based on hand detection and tracking. We conducted a user study of 40 participants adopting the mixed methods design. By comparing the data from the touch-based interaction group (N=20) to the mid-air natural interaction group (N=20), the study found that the usability of the touch-based version was better, while the immersive experience of the mid-air version was acknowledged by the participants. Future work should focus on addressing areas for improvement in the mid-air interaction, which could include incorporating better distance indications and feedback on pottery deformation, further narrowing the divide between virtual and real-world interactions. DOI: 10.1145/3677386.3688902 Pre-recorded for the ACM Symposium on Spatial User Interaction, October 7-8, 2024.