John Whitney - Digital Harmony
Book: Digital Harmony: On the Complementarity of Music and Visual Art (1980), John Whitney (Link to PDF)
Color - pitch relationships
Kandinsky (synaesthesia; painted what he heard)
The exploration of the relationship between pitch and color has inspired a lot of audiovisual artists today.
Isaac Newton made a graph trying to relate color and pitch, and realized that the math didn’t work out – it was an entirely different waveform space. There’s no relationship between how the eye responds to waveforms and how the ear responds to sound.
Beau Lotto argued that there was a relationship between color and pitch.
Data collected in an experiment including 250 participants revealed that there was no relationship.
One correlation found: between brightness (luminance) of an image and frequency of a sound.
Lower frequency = lower luminance
Higher frequency = higher luminance
No relationship between pitches and any other static discrete visual elements in that way.
If we’re going to do an audiovisual composition - it’s not a piano (ie. here’s a note, here’s an image).
Frequency ‘relationships’/ratios are relevant.
How the nature of periodocity impacted on our audiovisual experience.
--> Explored through visual motion pattern.
Used as a parallel to the sonic harmonic series
Take a shape, extend it to a line of shapes, rotate each one by a factor of its distance from the center.
--> Harmonic relationships in visual motion pattern.
Polar patterns exhibit similar behaviour
Instead of Cartesian Coordinates we use Polar Coordinates (amplitude and phase), a different way of thinking about the same space.
Used to explore more complex ‘multidimensional harmonics’; the patterns are far more complex.
SYMMETRY and HARMONY; complementary to sound & music. A visual process which is similar to the sound process.
Whitney was never able to directly link visual harmonics with sonic harmonics.
Made an Audiovisual Synthesizer – a visual synthesizer that uses the concept of harmonics in order to build a set of painting algorithms.
Creating something that “sounds like it looks” – is it doing the same thing?
Abstraction – the meaning of abstraction – is there a meaning?
Complex dynamics within an image
Texture as a tactile aspect of music
Texture in terms of periodicity - how things operate over time.
Both sound & image are treated in the same way and at the same time
The primary material is the audiovisual texture itself. Neither exists without the other. No form difference between the two.
http://www.theergocollective.com/?p=919