Gestures
Gestures was performed for the first time on Jan 18th at the Knitting Factory. It will also be released as a surround sound DVD and DVD ROM.
The general Idea:
The work will have words and image
as well as music. It work will be available for the home participant
to reinterpret by using the mouse as a ëgesturedí input to the computer.
One will be able to perform the work through a kind of gestured conducting.
There will be two versions of the work; one will be
a fixed version, which I will have performed, and the other an open-ended
computer application (program) that will let each home participant do his/her
own version.
How it works:
I call the new computer application
or program, ëGesturesí. There are three modes:
1. You gesture with the mouse by
holding the mouse down and moving it. The computer knows literally
everything about the gesture you are making. It can tell the average
speed of the movement, the average smoothness/ or ëjerkinessí or ëbentnessí
of the movement, the length of the gesture, etc. You signal the computer
that you are finished with the gesture by releasing the mouse. The computer
ëplaysí music related to your gesture.
2. Without depressing the mouse, you can now move the mouse freely over the surface of special image witch encompasses the entire screen. As you do this you alter the sound and the parts of the music, which is playing. You continue this as long as you wish, or, by depressing the mouse and gesturing again, bring in other parts of the music related to the new gestures. If you choose to sit back and listen, the computer automatically takes you to a third mode.
3. When the computer detects that you are no longer active, it uses the music you have gestured as a background to readings of texts (being created for the work), which are related to the music you have ëgesturedí. And, as soon as you move the mouse, the exploration of the music continues and/or a new gesture can be created.
Performing Gestures:
I am in the process of creating
four performances pieces out of the home, interactive work. Each is based
on one of the four stories by Melody Sumner Carnahan. In the original
Gestures, the stories are imbedded in the fabric of the experience and
only come to the foreground when the user is not active. In the performance
version, each story has a place where it comes to the foreground.
However, the original stories are quite long, so, in the performance version
they are condensed to allow the music to ëspeakí much of the story in its
own way. The first of the four is finished and will be performed
tonight. It is entitled, Gestures: It Begins with Colors.
How it works
There are 20 musical choices in
the work. These would, in the home version, be accessed by gestures.
In the performance version these choices are made by Key closures on the
computer keyboard. There are 4 types of music, each with 4 variations.
These are laid out on the keyboard with the first five keys of each of
the four rows of keys. The key closure of any key chooses a screen
environment of 15 sounds. There are 10 sounds around the edges of
the screen: four corners, two top, two bottom and one on each side.
There are 5 sounds in the main body of the screen: top, bottom, left, right
and center. By sliding the mouse across the screen I get a cross
fade between any combination of the 15 sounds. For instance, the
mouse in the center top of the main part of the screen will give me a mix
of the top sound along with the left and right sound; the mouse in the
upper left corner of the main screen will give the left and top sound,
the mouse in the middle left will give me the left sound only, etc.
The movement of the mouse is a kind of gestured conducting of the music
while the music to be performed is made by key closures which is more of
a composerís kind of choice making.
The screen of the computer is projected
onto the screen behind me and at the front of the audience. This way the
audience will see the computer screen as I see it. The main cursor
[a feather or quill like object] is the actual trajectory of my mouse movement.
When I move the cursor to the edges, the main screen folds over and an
under screen is seen. This under-screen corresponds to the images
[by Steven Subotnick] seen when the home user is inactive. It has
its own cursor, which is searching for images. This cursor is seen
as a secondary cursor running simultaneously with my mouse movements.
The quality of that Gesture gives
me the materials (vocabulary of sounds and images) for that performance.
I then perform the work using the mouse to move from sound to sound and,
by clicking on particular keys of the computer keyboard, advance the computer
through the vocabulary of sounds within the domain of the original Gesture.
Credits for the new DVD-ROM work, 'Gestures'
Special animated graphics, by Steven Subotnick.
Texts by Melody Sumner Carnahan
Texts read by Joan La Barbara.