daisyrust.com

PhD Website Announcement » read article

After some time off blogging, I am back with an announcement of a major piece of ongoing work in the form of a PhD!

PhD Website

Link: http://www.daisyrust.com/phd/

PhD Title

Expressivity and the Digital Puppet:
Mechanical, Digital and Virtual Objects
in Games, Art and Performance

PhD Summary: The aims of the investigation

The current PhD study explores the interface between traditional puppetry and emerging computer technologies, through historical, theoretical enquiry, case studies and practical experiments. The thesis will evaluate and test with users (puppeteers, audiences, animators and programmers) the expressive qualities of innovative interactive systems.

In this context ‘innovative’ means both emerging, new, technology or established technologies that are being re-defined by their communities of use and are finding new applications within the performing arts, particularly puppetry performance.

(1) I aim to explore the related contexts of digital puppetry, real-time animation, mimetic and non-mimetic kinetic objects, automata, ‘cybernetic sculpture’, performance systems and the technological interfaces to such phenomena.

(2) I aim to create evaluate and create puppet/object theatre performances/installations that use original software and hardware systems that are designed to explore ‘performance expressivity’, with reference to relevant historical, art, entertainment and technological precedents.

(3) I wish to theorise and form a taxonomy of ‘expressivity’ in relationship to digital domains and puppetry. By ‘expressivity’, I refer to different domains of action including: voice, face, body, hands and gesture.

Digital Puppetry Project Using Quartz Composer » read article

I have recently completed the first prototype of a major digital puppetry project that relies heavily on Quartz Composer in an arena of live performance familiar to vj-ers, visual artists and visualists. I have a set of predefined visuals (‘scenes’) and effects and a complex mechanism that lets me composite my real-time singing mouth onto an a character that I (or someone else) can manipulate with a nintendo wii remote. Moving eyes are pre-recorded and in future versions, I indend for the eye movements to be controllable by the wii. The source code for the character control can be found elsewhere on this blog.

I do not intend to post the full patch as it is very dependent on other media, the wii controller and the Behringer midi controller, but you can view the root of the composition in the image below. I have split some of the more useful elements up and will be sharing them in other posts. I attempted (and will develop further) the idea of having a separate ‘buses’ for scenes, effects and transitions – a little like the way (I think) quartonian (and other vj-ing tools) work.

Image (1.8mb large): Screenshot of Root of Performance Composition

The project used some of the following ideas:

• instant chroma-keying and garbage matting of a performers blue face and the compositing of a hybrid character with live mouth and controllable pre-recorded eyes into multiple scenes
• midi control
• nintendo wii remote control of a virtual character (this meant I had to write a custom cocoa application to host the open source darwiinremote.framework ‘)
• Quasi 3D (or 2-and-a-half-D) effects derived from 2D frames – I’ll post some movies of this.
• Depth of focus and pulling focus effects
• Dynamic real-time titles

Some Images and Commentary

A fuller walkthrough of the final images with a commentary can be found here:

Screenshots and Scene-by-Scene Descriptions Link: http://www.daisyrust.com/quartzcomposer/moocher/

Image (above): Prototype of the Garbage Matte and Chroma-Keying Patch

Download Link: garbage_matte_bluescreen_demo_002.qtz.zip

This demo patch makes uses of Sam Kass’s excellent core image kernels available here:

Link: http://www.samkass.com/blog/

Images (above): Behringer BCF2000 MIDI controller controls scene sequencing and properties of various screen objects and parameters in real time

Image: Real-time Mouth / Recorded (controllable) Eyes Composited into an Image in Real-Time

Full credit and copyright acknowledgment to the Fleischer Brothers Estate for frame grabs and stylistic inspiration.

writing: “finding the wooden voice” » read article

i published an essay (jan 2001) on world puppetry and performer training. research was drawn from research and participation at the henson international puppetry festival, new york (2000) and a symposium at the victoria & albert theatre museum, london (2000).

download and read: towards the wooden voice (unedited) – download pdf
download and read: towards the wooden voice (edited) – download pdf

“It is logical to assert that voice is a primary tool for the puppeteer when bestowing the impression of life on dead things”

“Giving voice to objects, along with movement, is a principle tool of the animator when intimating the ‘presence’ of a soul.”

“As soon as a puppet speaks, it is cultured, it has a past – it is not only living, it has lived”

“No matter how much some performers, scholars and trainers dislike puppets speaking, puppets and objects will be given and will find their voices.”