Multidimensional perceptual scaling of musical timbres

TLDR

The study aimed to evaluate perceptual relationships among 16 computer‑generated instrument tones. The authors synthesized equalized tones and applied multidimensional scaling and hierarchical clustering in Experiment 1, followed by a label‑learning task in Experiment 2. A three‑dimensional scaling solution matched the clustering analysis and reflected spectral energy distribution, transient synchronicity, and high‑frequency attack energy, while a learning task revealed that one instrument‑family exception led to increased label confusion.

Abstract

Two experiments were performed to evaluate the perceptual relationships between 16 music instrument tones. The stimuli were computer synthesized based upon an analysis of actual instrument tones, and they were perceptually equalized for loudness, pitch, and duration. Experiment 1 evaluated the tones with respect to perceptual similarities, and the results were treated with multidimensional scaling techniques and hierarchic clustering analysis. A three-dimensional scaling solution, well matching the clustering analysis, was found to be interpretable in terms of (1) the spectral energy distribution; (2) the presence of synchronicity in the transients of the higher harmonics, along with the closely related amount of spectral fluctuation within the the tone through time; and (3) the presence of low-amplitude, high-frequency energy in the initial attack segment; an alternate interpretation of the latter two dimensions viewed the cylindrical distribution of clusters of stimulus points about the spectral energy distribution, grouping on the basis of musical instrument family (with two exceptions). Experiment 2 was a learning task of a set of labels for the 16 tones. Confusions were examined in light of the similarity structure for the tones from experiment 1, and one of the family-grouping exceptions was found to be reflected in the difficulty of learning the labels.