Part of Temporal Constructs Appendix, which contains details behind the research: dates, quotations, descriptions of instruments, and sources.

General definition

An artistic practice in which moving image is composed according to musical principles, or in which sound and image are composed as one work. Its lineage runs from colour organs through the abstract films of Oskar Fischinger, Mary Ellen Bute and the Whitney brothers to real-time audiovisual performance.

Relation to the practice

Brougher and others (2005) is the held survey of the tradition and of the instruments within it. The term used here names the practice that survey documents.

-still from an abstract film of the Whitney brothers, motion and colour composed as material in their own right-

The MIDI era produced instruments in which the same control logic could address both sound and light, such as the light synthesisers driven alongside MIDI instruments. Trip-A-Tron is the one this professional doctorate works with. The doctorate explores what becomes compositionally possible when one control language governs sound and image together, including mapping compositional languages onto visual ones. This is the subject of the fifth subsidiary question, treated as exploratory, and a mapping of this kind is planned in RETRIEVAL.

Precedents for visual music

Two precedents matter here for significance. Whitney’s abstract films established motion and colour as compositional material in their own right, decades before a personal computer could carry them. VAMPIRE, with which Laurie Spiegel composed sound and image together at Bell Labs, shows the same question being asked in the same years elsewhere. Bell Labs was an industrial research laboratory with no link to the game-development line that produced the light synthesiser.

Two literatures

The two literatures this entry sits between do not cite each other. Art and film historians write about visual music, from the colour organs through Fischinger and Bute to the Whitneys. Their account is usually about image, with sound as its accompaniment. Computer scientists write about co-creative systems, and the 2025 review of 62 of them names visual arts, design and writing as its applications, with music absent (Singh and others 2025). Neither literature has much to say about the instruments of the MIDI era in which one control language governed sound and light together. Those instruments are the object studied here.

That gap is why the fifth subsidiary question is exploratory. The account cannot borrow a method for reading an instrument that composes sound and image at once. The field that studies co-creative systems has not studied those instruments, and the field that studies visual music has not studied their control languages.

Unforeseen

Here the unforeseen situations, sometimes difficult, sometimes unexpectedly interesting, will be described as the project runs. Many of these unforeseen situations have already occurred and have been recorded. They will be added in the time to come.