Augmented Reality Interaction Techniques in Education

Abstract

The goal of this thesis is to implement a 2D marker-based finger (thumb and index together) interaction with midair 3D virtual objects. Moreover, we provide the user a visual feedback upon successful selection of the 3D virtual object. The proposed system supports the three basic canonical manipulations; translation, scaling and rotation. In order to evaluate our system, we conducted a set of case studies to test our proposed approach. In addition, a touch-based case study was conducted to compare the results of our proposed approach and that of the touch-based. Our results were based on the performance (completion) time per each task per each participant in addition to a subjective questionnaire that was answered by the participants after finishing the case studies. Our results showed that although touch-based proved to be easier and faster, the proposed midair finger gesture approach proved to be more fun and engaging. Finally, we introduce an implementation of an educational application for kids for shapes sorting in their correct places. The methodology on which the application is built is an intangible technique were the user (kid) attaches colored stickers (markers) to his/her fingertips and interact with the virtual objects appearing on the mobile device screen.