Music V
The 1960s saw the birth of the wild idea of making computers sing. At Bell Labs, Max Mathews observed oscilloscopes tracing the curves of the human voice and thought that after all, if speech could be converted into numbers, why couldn’t the reverse be done? In 1963, he published an article in Science that would raise eyebrows: “The Digital Computer as a Musical Instrument”. The idea seemed absurd. Computers calculate, they don’t make music.
Yet the principle Mathews developed could be explained in a few lines. The computer generates a sequence of numbers which, transformed into electrical pulses and smoothed out, produce sounds. Nothing simpler in theory. In practice, it’s another story. To obtain something decent, you need at least 30,000 samples per second if you want to cover audible frequencies up to 15,000 Hz. The catch is that Bell Labs’ IBM 7090 only calculates 5,000 numbers per second for even moderately complex sounds. Mathews then found a workaround by first storing everything on magnetic tape, then playing it back at the right speed. This workaround worked perfectly, but it was only a beginning, because the real innovation came with MUSIC, and MUSIC V, a programming language entirely dedicated to sound creation.
The power of the innovation lay in the separation between instrument construction and their use. Mathews invented “unit generators”, small program blocks that each did one specific thing like oscillating, generating noise, adding signals. By combining them, you create “instrument units”, true virtual instruments. This modularity predated by several years the Moog and Buchla synthesizers that wouldn’t see the light of day until after 1964.
The composer therefore worked in two stages. First, they built their instruments by assembling these generators like mounting an electronic circuit. Then they wrote their score as lists of numbers: start time, duration, pitch, amplitude... Each note was a line of figures. This numerical approach had to win over musicians first, but it offered unprecedented precision on every sound parameter.
Jean-Claude Risset, who joined Mathews’ team at Bell Labs between 1964 and 1969, pushed the system to its limits. He analyzed trumpet sounds under an acoustic microscope and discovered that their distinctive timbre came from subtle correlations: the louder the note, the more high harmonics it contained. Armed with this observation, he programmed virtual trumpets that reproduced this behavior. The result fooled listeners. But he didn’t stop at imitation and explored the unprecedented possibilities offered by digital synthesis. He created sounds impossible in the physical world, like his famous “infinite glissando” that seemed to rise eternally while returning on itself, thus exploring the limits of auditory perception through the computer.
The research conducted with MUSIC V transformed the understanding of sound. It showed the importance of attack transients in timbre recognition, the role of random micro-variations in perceived richness. The computer was an acoustics laboratory where each parameter could be isolated, modified, and its effect on perception observed. However, MUSIC V suffered from crippling limitations. Real-time playing was impossible, you had to wait for the computer to finish its calculations before hearing the result. Programming with lists of numbers put off musicians accustomed to musical staves, and sound quality depended on a fine understanding of acoustics that few possessed. These obstacles didn’t prevent certain composers from adopting the tool between 1964 and 1969, using the catalog of synthesized sounds published by Jean-Claude Risset as a reference. MUSIC V demonstrated that a computer could become a full-fledged artistic creation instrument, not just a calculating machine.
MUSIC V’s modular architecture directly inspired analog and digital synthesizers. Its separation between instrument definition and musical control foreshadowed the MIDI standard of the 1980s. It established programming principles – modularity, abstraction, separation of concerns – that went far beyond the sound domain.
MUSIC V transformed the conception of computing by showing that the machine was also a means of expression rather than a simple automaton. Mathews’ intuition finds its culmination today in every modern audio application that carries within it a bit of MUSIC V’s DNA, that first digital cry uttered in the carpeted corridors of Bell Labs.