I published my first article in an academic journal in 2004, while working on my Ph.D. dissertation in media studies. The article was entitled ‘I Can See Tomorrow in Your Dance: A Study of Dance Dance Revolution and Music Video Games’.Footnote 1 I was interested in how ‘DDR’ fan culture revealed some of the cultural and technological possibilities that emerged when music and dance became the means of interaction with digital games. When whole bodies, not just fingers, became involved, gameplay could become a public performance, as when DDR fans learnt the game patterns backwards so that they could turn round and face the crowd rather than watch the screen. I knew that my article was only scratching the surface of this rich area, and that there was much more to be said about the intersection of games, music and bodies. As often happens in postgraduate study, my plan of research veered off in another direction, and I did not continue this line of investigation.
Fast forward to today, and I am happy to report that the ‘tomorrow’ which I had perceived so dimly ten years ago is materializing today. That is to say, music video games are getting plenty of scholarly attention, and a recent set of books is poised to demarcate an academic terrain that borders music, games, play and media as its own dynamic area of study. In this review article, I will examine how these authors define the field of ‘ludomusicology’, consider some of the methods they employ and discuss some of the field's preferred objects of study, recurring themes and problematics.
Ludomusicology is clearly an interdisciplinary endeavour, and it intervenes in the institutional history of its adjacent disciplines in productive ways. As ‘game studies’ became established in the humanities, an early divide manifested itself between scholars who understood video games mainly in terms of theories of play (ludology) and those whose approach was based more on film studies and focused on narrative (narratology). Around the same time, sound studies was emerging as a vital field – albeit one with an uncertain relationship to musicology and music theory. The recent set of texts on music video games suggests that ludomusicology might manage nimbly to sidestep both of these intellectual divides: music allows for a way to think about games apart from models of cinematic narrative; and digital games provide a site for getting a media-centric sound studies and musicology talking to each other.
The term ‘ludomusicology’ makes an implicit assertion that there is a significant link between playing games and playing music. Michiel Kamp and his colleagues define ludomusicology as the study of ‘the relationship between music and play’ and declare that it is motivated by ‘a special relationship between playing video games and engaging with their music’.Footnote 2 Michael L. Austin writes that music is ‘a playful thing’,Footnote 3 and he is one of several authors who refer to Johan Huizinga's observation that both playing games and playing a musical instrument tend to require the ‘nimble and orderly movement of the fingers’.Footnote 4 For Roger Moseley, music constitutes ‘a set of cognitive, technological, and social resources for playing in and with the world through the medium of sound’.Footnote 5 Moseley prompts us to notice a similarity between ‘speedruns of digital games’ and a tradition of performing Chopin's Waltz in D♭ in under a minute. He also argues that scholars interested in play should turn to music because it expands their ‘understanding of the material history and cultural significance of ludic phenomena’ and, conversely, because an interest in play brings new ‘concepts, affects, and modes of behavior’ to the attention of musicologists.Footnote 6
There is broad agreement, then, that the crossroads of music and games has great potential, but the specific object of study in this project can be hard to pin down. Moseley's work suggests that the area of study is potentially quite broad, and could include a wide range of musical practices, games and competitions. Most of the scholarship under examination here, however, narrows the scope to music video games. The question then becomes: what constitutes a ‘music video game’? Scholars of the film musical faced a similar genre problem. In his influential book on the Hollywood musical, Rick Altman applies his well-known ‘semantic/syntactic’ model of film genre: a semantic definition stresses the iconography of generic ‘building blocks’ such as the mixture of song with realistic dialogue; and a syntactic definition privileges narrative structures such as the ‘dual-focus’ on the romantic couple.Footnote 7
We find similar moves being made to define a ‘music video game’. Austin takes a syntactic approach when he argues that music video games are those in which ‘the formal elements’ are ‘musical in nature’, or when ‘the most meaningful interaction with the game is musical’.Footnote 8 Austin refers to subgenres of the music video game such as rhythm-matching and music-making games, which he demarcates by their form of interactivity. Among these subgenres is a more semantically defined set of games that allude to or represent ‘musicians, music making, or the music industry’.Footnote 9 Tim Summers seems to fall into the syntactic category when he writes that music video games are those that place a ‘musical play dynamic front and center’, but also takes what Altman might call a ‘pragmatic’ approach to genre definition when he includes games that ‘have often been referred to as “music games”’.Footnote 10
The looseness of these definitions is perhaps productive, since these volumes include fascinating essays on games that do not necessarily put music ‘front and center’: for example, survival-horror games, racing games and historical epics.Footnote 11 Just as film scholars might examine the dynamics of sound design and musical scoring in any number of genres, but still give special attention to musicals or music videos, so the centre of gravity in the study of ludomusicology seems to be the rhythm games characterized by the dynamic that Karen Collins calls ‘kinesonic synchresis’, by means of which sounds are fused to the player's actions.Footnote 12 Just as Hollywood musicals have their own set of narrative and stylistic tropes, so these music and dance games have their own kinds of peripheral controllers and can feature a different relationship with on-screen avatars. Kiri Miller points out that in some dance games players do not control the motions of on-screen characters; instead, screen dancers serve as models for the player's own performance. Furthermore, games evaluate players on the basis of their bodily skills in the ‘real world’, not in the virtual one.Footnote 13
But video games are not Hollywood musicals, and several authors describe the challenges of studying games as discrete texts. For Summers, video games are ‘slippery texts’, owing to the fact that there might be various versions of the same game which are played on different systems or platforms.Footnote 14 Other authors refer to the ‘paratextual fluidity’ of games, since music has a role to play not only during, but also before gameplay (as in company logos, title music and menus), during cut-scenes and at the moment of the avatar's death.Footnote 15 Focusing on game music also allows scholars to consider fan remixes of game soundtracks and musical apps like Björk's Biophilia. The slipperiness of game texts requires a host of methods. Summers's book provides a useful overview, which includes musicological and ethnomusicological study, the examination of game code, analysis of YouTube videos of gameplay, and ‘analytical play’ in which the researcher plays a game in order to discern the rules that govern musical output.Footnote 16
Apart from matters of genre, text and method, the reader notices several themes that recur across this literature. One has to do with the question of immersion. In studies of play, immersion is understood as the creation of a social frame or ‘magic circle’, in which a game's rules create a special experience of time and space and a ‘special set of meanings for the players of the game’.Footnote 17 In sound studies, the concept of immersion has been part of a debate about the nature of auditory perception, as in Don Ihde's phenomenological discussion of the ‘auditory field’ or Walter Ong's claims that the listener is the centre of an enveloping auditory world: ‘You can immerse yourself in hearing, in sound. There is no way to immerse yourself similarly in sight.’Footnote 18 Jonathan Sterne has taught us to be suspicious of claims such as these, which seem to posit ‘transhistorical explanations of sound's nature’.Footnote 19 Nonetheless, the idea that sound is a privileged vehicle for sensory immersion is also present in work on film sound. Film theorist Michel Chion writes about the space created by sound as the ‘superfield’, and explains that it fills the room beyond the ‘physical boundaries of the screen’.Footnote 20
While studies of play and film sound spur an interest in immersion, many of the authors in this sampling of ludomusicological scholarship are keen to avoid what they call the ‘immersive fallacy’: that is, the idea that ‘the pleasure of a media experience lies in its ability to sensually transport the participant into an illusory, simulated reality’.Footnote 21 The anxiety about immersion among game scholars may have something to do with a desire to counter accusations that gamers mistake the gameworld for reality – a common theme in debates about video-game violence.Footnote 22 Several authors in the ludomusicology literature explore new ways of thinking about immersion in music games. Isabella van Elferen distinguishes between sensory, challenge-based and imaginative forms of immersion to stress the different but overlapping routes that players might take to a sense of involvement.Footnote 23 In an essay on Rocksmith, a game in which players use real guitars and basses, Daniel O'Meara shows the degree to which ‘magic circles’ may be created or not depending on the game's intended audience or, in this case, its function as a teaching tool.Footnote 24
In the context of this emphasis on immersion, Miller provides a fresh perspective by shifting our attention to the concept of ‘intimacy’. In her work on dance games, she shows how learning choreography from a machine involves ‘developing an intimate relationship with interactive surveillance technologies’.Footnote 25 For Miller, intimate media are those ‘that choreograph the gradual accrual of intimacy over time’ through a practice that unfolds through ‘dynamics of recognition and reciprocity as well as control and consent’.Footnote 26 Miller's work demonstrates that the study of music and dance games might refine the discussion of immersion, and also spur new lines of investigation into gameplay's embodiment of repetition, skill and surveillance.
Miller's book also enacts some of the useful ways in which ludomusicology intersects with adjacent fields. She shows how games can be approached as an ethnomusicological enterprise that sheds light on the experience of music in everyday life. In her study of dance-based games, we read that ‘playing games, playing music, and playing a role onstage are all forms of collaborative performance, framed by rules and repertoires, structured through repetition’.Footnote 27 Players talk about how gameplay allows them to hear music differently as they learn to listen ‘like a dancer’ or ‘like a musician’. Players learn a repertoire of dance, not just from the game code, but from the professional choreographers who work with game designers, and thus serve as ‘culture-bearers, representatives of particular dance repertoires and communities who are engaged in a kind of heritage work’.Footnote 28 Miller's ethnographic approach might be compared to more musicological work such as Moseley's book and Elizabeth Medina-Gray's essay on the relation between interactive games and modes of indeterminacy in twentieth-century avant-garde music.Footnote 29
Ethnomusicology and musicology are important disciplinary pillars of the ludomusicological enterprise, but I would like to see more cross-talk with media studies and sound studies. For example, how might music video games be incorporated into the history of recorded sound? Miller's work on Guitar Hero and Rock Band shows how games are part of a history of ‘schizophonic performance’ that includes lip-syncing, air guitar and karaoke. In other words, music games are a way of consuming records, whereby listeners ‘put the performance back into recorded music, reanimating it with their physical engagement and adrenaline. Players become live performers of prerecorded songs.’Footnote 30 More work might be done at the intersection of game history and the history of popular music: for example, on the playful or competitive nature of popular dance crazes; on pre-digital games that put music or musicians ‘front and center’; or on connections between the coin-operated jukebox business and music-themed entertainment machines. William Knoblauch's excellent essay on the game Simon points to connections between the game's design and the disco boom of the 1970s.Footnote 31 Are there other connections between genres of popular music and genres of games? On the industry side, what role did the introduction of home game consoles play in the record industry's slump during the late 1970s and early 1980s?
There are also intermedial connections to be explored between games and radio. Several scholars work on the role of diegetic radio broadcasts within the sound design of games, but they do not engage with the history or aesthetics of radio itself. There could also be a more robust dialogue between ludomusicology and the study of film sound. Several essays in these collections refer to sound–image relationships that have long been discussed in film, such as ‘mismatches’ of ‘easy listening’ music with violent gameplay.Footnote 32 Likewise, Summers's discussion of ‘texturing’ – a term he uses to describe how game music references other media texts or cultural touchstones – could be expanded via work on the marketing of the film soundtrack, the aesthetics of the ‘compilation’ score or the labour of music supervisors in the film and television industry.Footnote 33 Further research might explore the place of music and games in the broader logic of transmedia franchises, building upon William Cheng's discussion of The Lord of the Rings Online game.Footnote 34 Finally, Moseley's book shows the potential of future work at the intersection of ludomusicology and ‘media archaeology’ through his examination of the history of the keyboard.Footnote 35 Such an approach opens onto history, as well as onto current work, such as Mark Butler's examination of the musical interfaces used by musicians in genres like EDM (Electronic Dance Music).Footnote 36
In conclusion, I have every reason to believe that ludomusicology will have many more tomorrows, and that there exists an expanding set of resources, methods and models that scholars in this emerging field have at their nimble fingertips today.
