Technology and Music Education ▸ Home

3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support

Type: conference paper

Authors: Kia C. Ng, Tillman Weyde, Oliver Larkin, Kerstin Neubarth, Thijs Koerselman, Bee Ong

Abstract
Multimodal interfaces can open up new possibilities for music education, where the traditional model of teaching is based predominantly on verbal feedback. This paper explores the development and use of multimodal interfaces in novel tools to support music practice training. The design of multimodal interfaces for music education presents a challenge in several respects. One is the integration of multimodal technology into the music learning process. The other is the technological development, where we present a solution that aims to support string practice training with visual and auditory feedback. Building on the traditional function of a physical mirror as a teaching aid, we describe the concept and development of an “augmented mirror” using 3D motion capture technology.

URL: http://portal.acm.org/citation.cfm?doid=1322192.1322252

Associated tags
metadata ▸ material ▸ 3D Augmented Mirror
metadata ▸ contribution ▸ Presentation
metadata ▸ year ▸ 2007
technological dimension ▸ applications ▸ Desktop
technological dimension ▸ input technologies ▸ Camera
technological dimension ▸ system outputs ▸ Audio
technological dimension ▸ system outputs ▸ Visual
musical dimension ▸ activities ▸ Performing
pedagogical dimension ▸ learning theories ▸ Cognitivism
pedagogical dimension ▸ users ▸ Not defined
pedagogical dimension ▸ venues ▸ Lab