Hostname: page-component-74656f9884-skzmx Total loading time: 0 Render date: 2026-11-05T07:22:17.323Z Has data issue: false hasContentIssue false

The Tensed Computer Improviser and the workmanship of risk: Small-dataset machine learning and real-time interactive musical improvisation

Published online by Cambridge University Press:  15 October 2026

Taylor Brook*
Affiliation:
Music, The University of British Columbia Faculty of Arts , Canada
Rights & Permissions [Opens in a new window]

Abstract

Generative artificial intelligence (AI) has entered music overwhelmingly by way of large industrial models trained on vast corpora, in which the outcome is fixed in advance by an apparatus that the musician neither controls nor understands. This article argues that the essential machine-learning operations of dataset assembly, feature extraction and model fitting can instead be utilised transparently as part of an artist’s creative practice. Looking to David Pye’s concepts of workmanship of certainty and workmanship of risk, this article examines the design of the Tensed Computer Improviser (TCI), an open-source machine improviser built in Max with the Fluid Corpus Manipulation (FluCoMa) toolkit, which trains models from a small audio corpus of the user’s own choosing, with no pretrained component and no external training stage. Situating the TCI within a genealogy of machine improvisation using small data, the article analyses its design through the vocabulary of craft where the corpus curation and training are integrated into the creative act and the characteristic errors of small data are welcomed as tool-marks.

Information

Type
Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press
Figure 0

Figure 1. Signal-flow diagram of the TCI. Build and analysis section: the corpus is reduced to a mono buffer, segmented in parallel into onset slices and grains of fixed duration, and measured along five descriptor families, yielding ten analyses that fit the model bank. Model bank section: for each analysis, a standardised–UMAP–grid pipeline produces 2D corpus maps, k-means yields cluster labels, a k-d tree provides a nearest-neighbour index and a variable-order Markov chain (maximum order three) is built upon the cluster labels and inter-onset durations. Performance section: live input is tracked with the five descriptors and queried against the k-d tree, whose matches and labels drive a layer of behaviours (see Figure 4); the segments they select are sounded by a 128-voice polyphonic sampler across a variable loudspeaker array, when the analysis is streamed over OSC to external processes such as live visuals as desired.

Figure 1

Figure 2. The TCI’s main interface as it appears on launch, before a corpus has been analysed. The preparation of the models is laid out as a numbered sequence in the lower panel: STEP 1 (import audio corpus), STEP 2 (adjust settings), STEP 3 (onset detection) and STEP 4 (analysis). Until those steps are run, the descriptor maps remain as empty cells, the waveform display is empty and the TCI will produce no sound.

Figure 2

Figure 3. The TCI interface after a corpus has been imported and analysed. Each analysis is shown as a 2D corpus map aligning with the five descriptor families (MFCC, chroma, spectral, melbands and pitch) across the two segmentations (grains, top row; slices, bottom row). The points of the corpus maps are spread by the high minimum-distance UMAP setting and normalised to fit the plotters; the colours of the points represent the results of the unsupervised k-means clustering; the performer may click on a point on any map and hears the slice or grain of audio it represents. The corpus waveform and its slice boundaries appear at lower right, with the onset count reported beneath (here 1,918). Corpus shown: loadbang’s recording of the author’s Tarantism (loadbang 2021).

Figure 3

Figure 4. The behaviour panel. The TCI’s behaviours are grouped first by segmentation (SLICES, top; GRAINS, below) and then into RHYTHMIC, TEXTURAL, DOUBLING and GENERATIVE columns, with a separate set of one-shot gestures (the bouncing-ball and slowing-down figures and a glitch drone) and the global effect parameters (dynamics, feedback delay, reverse delay) on the right. Behaviours change automatically during operation in reaction to the audio input. Additionally, behaviours can be turned on, monitored or blocked manually by the user. The article slightly regroups these modules analytically by how they respond to the live input as reactive/rhythmic/generative (Table 1).

Figure 4

Table 1. Behaviour modules, grouped analytically by how they respond to the live input (Figure 4)Table 1 long description.

Supplementary material: File

Brook supplementary material

Brook supplementary material
Download Brook supplementary material(File)
File 71.3 MB