ScreenPlay (2019) is a computer instrument that uses light as its only input. Made with Max/MSP and utilizing pixel-tracking technology, the participant is able to "play" the screen like an instrument with nothing more than their movements and a computer with a webcam and speaker.
Some areas of the screen respond to vertical movements, others respond to horizontal ones. When activated with movement, each direction emits a unique color and sound. The velocity of the user's movements also dictate the sound's frequency and amplitude.
Turning the relationship between movement and music on its head, ScreenPlay prompts participants to move their bodies in order to create new music.
ScreenPlay demonstration.