Research

This research investigates different types of in situ visual feedback to facilitate user learning and the reproduction of hand poses in virtual reality. By integrating real-time visual cues directly onto the user’s hand in situ, this study enables users to identify errors promptly and make immediate adjustments by simply looking at their hands, thereby minimizing context switches to see the results.

The study explores the potential of bare-handed gestural interaction of the four in situ feedback mechanisms developed in this research. Two comprehensive studies were conducted with a total of 32 participants to evaluate the impact of varying feedback approaches on users’ learning progress and proficiency in executing hand gestures. The findings indicate a significant enhancement in participant satisfaction, as well as improved accuracy and recall in reproducing gestures through the utilization of the developed in situ visual feedback.

While this study does not have a specific end goal at present, the demonstrated effectiveness and potential of in situ visual feedback mechanisms in this research suggest promising possibilities for future practical applications.