Technology and Music Education ▸ Home

Piano learning application with feedback provided by an AR virtual character

Type: conference paper

Authors: Carlos A Torres Fernandez, Pujana Paliyawan, Chu Chun Yin, Ruck Thawonmas

Abstract
This paper proposes a mobile application that uses Augmented Reality to enhance the experience of learning to play keyboard instruments. The proposed application uses Google Cardboard to let users visualize a virtual character and instructions. The character gives the user real-time visual feedback according to their music playing performance as evaluated by the system. This application lets users choose among pre-defined songs that can be learned and practiced by using a simplified notation that eliminates the barrier of using actual musical notation. Having in mind the psychological benefits of music learning, we aim to present a fun and easy way to learn music and keep the users’ motivation during the process.

URL: http://ieeexplore.ieee.org/document/7800380/

Associated tags
metadata ▸ material ▸ Piano Learning (attr.)
metadata ▸ contribution ▸ Presentation
metadata ▸ year ▸ 2016
technological dimension ▸ applications ▸ VR, AR
technological dimension ▸ input technologies ▸ Mouse, keyboard
technological dimension ▸ input technologies ▸ MIDI
technological dimension ▸ input technologies ▸ Mobiles
technological dimension ▸ system outputs ▸ Visual
musical dimension ▸ activities ▸ Performing
pedagogical dimension ▸ learning theories ▸ Cognitivism
pedagogical dimension ▸ users ▸ Not defined
pedagogical dimension ▸ venues ▸ Lab