Hostname: page-component-74656f9884-8r8nv Total loading time: 0 Render date: 2026-11-09T09:00:37.958Z Has data issue: false hasContentIssue false

Sensing and mapping for interactive performance

Published online by Cambridge University Press:  24 January 2003

Kia Ng
Affiliation:
Interdisciplinary Centre for Scientific Research in Music (ICSRiM), School of Computing & School of Music, University of Leeds, Leeds LS2 9JT, UK E-mail: mvm@kcng.org URL: www.kcng.org/mvm
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

This paper describes a trans-domain mapping (TDM) framework for translating meaningful activities from one creative domain onto another. The multi-disciplinary framework is designed to facilitate an intuitive and non-intrusive interactive multimedia performance interface that offers the users or performers real-time control of multimedia events using their physical movements. It is intended to be a highly dynamic real-time performance tool, sensing and tracking activities and changes, in order to provide interactive multimedia performances.

From a straightforward definition of the TDM framework, this paper reports several implementations and multi-disciplinary collaborative projects using the proposed framework, including a motion and colour-sensitive system, a sensor-based system for triggering musical events, and a distributed multimedia server for audio mapping of a real-time face tracker, and discusses different aspects of mapping strategies in their context.

Plausible future directions, developments and exploration with the proposed framework, including stage augmentation, virtual and augmented reality, which involve sensing and mapping of physical and non-physical changes onto multimedia control events, are discussed.

Information

Type
Research Article
Copyright
© 2002 Cambridge University Press