Virtual Puppetry
Dec 14 2009

10th International conference of art, technology and consciousness: Consciousness Reframed, Munich, Germany, 11/19-21

 

 Semi just arrived at Munich and had drinks with Planetary Collegium friends: Jeniffer and Max in this photo

German beer with lots of meats!!

With Jennifer and Max

 

 

with Roy Ascott and Enrica. It was great to see Roy again..

with Roy Ascott and Enrica 

 

 Panel discussion

Panel discussion

 

 

Derrick de Kerkhove’s speech is always passionate..

Derrick de Kerkhove speaks

 

Roy’s presentation

Conference-Roy

 

Conference presentation pdf file: 

Ryuconference-pdf 

 


Dec 8 2009

Presentation at Symposium FUTURE NOW, Tenerife, Spain, on Sep23-27.

dsc00007

dsc00016

dsc00020

dsc00024

 

 

My presentation was about the conceptual background of my virtual puppetry “Parting on Z”, talking about paradoxical aspect of human experience. It went successful, receiving great responses, and continuing discussions from presenters.

In my panel, there were other panelists:

  •  Jon Ippolito
    Researcher, University of Maine. Former curator, Guggenheim, New York
  •  Amanda McDonald Crowley
    Director Eyebeam. New York
  •  Ela Kagel
    Project curator of the Transmediale Festival. Berlin
  •  Joline Blais
    Co-founder Sill Water. USA, Author of the book “The edge of art”
  •  Gunalan Nadarajan
    Art Theorist / Curator. USA / Singapore
dsc00015

Jon Ippolito & Joline Blais

 

 

 

 

 

 

 

 

 

This symposium invited about 30 people from the world, mostly director of organizations. See the list of presenters here.

http://www.espacioenter.com/FUTURE_NOW_speakers.htm

 For full program,

http://www.espacioenter.com/programa.htm

For museum (symposium place: Espaciocenter ),

http://www.teatenerife.es/

 

 

dsc00029


Aug 5 2009

Video documentation of Parting on Z ready!

PARTING ON Z: Virtual Interactive Puppetry + Pansori

 

 

See VIDEO DOCUMENTATION of PERFORMANCE

 

See VIDEO DOCUMENTATION of REHEARSAL

 

See IMAGES & PHOTOS

 

See Information of PARTING ON Z


Jul 17 2009

Video documentation: Parting on Z

More videos will come soon.


Jun 25 2009

Rehearsal photos: Parting on Z

 

  

 

A Pansori master, Junghee Oh, is standing on Wiifit, wearing a wireless microphone.

A Pansori master, Junghee Oh, is standing on Wiifit, wearing a wireless microphone.

 

She faces the virtual puppet and watch her/him most of the time. She also interacts with the drummer sitting beside.

She faces the virtual puppet and watch her/him most of the time. She also interacts with the drummer sitting beside.

 

The Drummer, Donghoon Kim, was interacting with Pansori master(puppeteer), speaking "Chuimsae." Chuimsae are dynamic interactive actions presented in pansori, taken by the drummer or the audience to encourage the storyteller’s performance, with playful sounds such as “Ul-ssi-gu!” or “Ul-ssu!”

The Drummer, Donghoon Kim, was interacting with Pansori master(puppeteer), speaking "Chuimsae." Chuimsae are dynamic interactive actions presented in pansori, taken by the drummer or the audience to encourage the storyteller’s performance, with playful sounds such as “Ul-ssi-gu!” or “Ul-ssu!”

 
 
One of three virtual puppets, responding with the puppeteer's voice and body balance. Her name is Chun-Hyang. Virtual puppet faces the puppeteer from a long distance, speaking back her story in real time mimicry and mirroring her body in swaying motions.

One of three virtual puppets, responding with the puppeteer's voice and body balance. Her name is Chun-Hyang. Virtual puppet faces the puppeteer from a long distance, speaking back her story in real time mimicry and mirroring her body in swaying motions.

 
 
The puppeteer's face is being tracked and captured from video camera, in real time. (used as live videomap of a virtual puppet face)

The puppeteer's face is being tracked and captured from video camera, in real time. (used as live videomap of a virtual puppet face)

 
One of computers receives live video signal of puppeteer's face, and send it to another computer running virtual puppets.

One of computers receives live video signal of puppeteer's face, and send it to another computer running virtual puppets.

   

Live video map, tracking the puppeteer's face

Live video map, tracking the puppeteer's face

 
Virtual puppet, mapped with puppeteer's face

Virtual puppet, mapped with puppeteer's face

 

 

More pictures and videos will come soon. Please stay tuned!!

 

 

 


Jun 25 2009

E-invite, Booklet, Floor plan: PARTING on Z

partingz_final
booklet_base
floorplan-for-partingonz


Mar 24 2009

Virtual Puppet performance at Chelsea Art Museum, New York

 

 

 

 

PARTING on Z

 

 Virtual Puppet

Parting on Z: Virtual Interactive Puppetry + Pansori
Wednesday, May 27, 7 pm  

Chelsea Art Museum
556 West 22nd Street (at 11th Ave), NYC

Media artist and VCU professor Semi Ryu presents her virtual puppet performance, “Parting on Z”, at The Project Room for New Media, Chelsea Art Museum on May 27. Parting on Z is real-time virtual interactive puppetry that responds to the puppeteer’s voice, walking balance, and fan movements, integrated with the traditional Korean oral storytelling known as Pansori. This live performance explores the paradoxical relationship between virtual puppet and puppeteer via the distance between avatar and user—symbolic lovers facing each other, continuously exchanging dialogues of love and farewell.

Tickets: $15 general admission, $10 students and seniors, free for CAM Members; tickets are only available for purchase at the door, on the day of the performance.
Chelsea Art Museum welcomes approximately 100,000 visitors each year from around the world. 212.255.0719, www.chelseaartmuseum.org

 

FULL DESCRIPTION

 “Parting on Z” is a virtual puppet performance to be held at The Project Room for New Media, Chelsea Art Museum, New York, on May 27 2009.  Parting on Z connects virtual puppetry with the traditional Korean oral storytelling performance known as pansori (판소리) to explore complicated relationships between the virtual puppet, puppeteer, drummer, and the audience, shaped by multiple layers of chuimsae.

Chuimsae are dynamic interactive actions presented in pansori, taken by the drummer or the audience to encourage the storyteller’s performance, with playful sounds such as
“Ul-ssi-gu!” or “Ul-ssu!”  Parting on Z extends the idea of Chuimsae in real-time interactive virtual puppetry that responds to the puppeteer’s voice (microphone), balance (Wiifit) and use of fan (iPod).  Parting on Z invites the pansori master (storyteller) to be a puppeteer interacting with the virtual puppet on a large projection in real time.  As her binary reflection, the virtual puppet will face the puppeteer from a distance, speaking back her story as real time echoes and mirroring her body in swinging motions.  The audience will be physically and spiritually located between spiraling interactive dialogues of virtual puppet and the puppeteer.

Holding a traditional fan, the pansori master will tell and sing a story, using ancient Korean dialect just as in traditional pansori performances.  In Parting on Z, however, the traditional fan will also be used to navigate virtual space, selecting items to activate virtual puppet actions and 3D tag clouds—semantic maps of oral storytelling lively told in performance.  Activating puppet actions associated with items, she will be able to choreograph visual narratives that will inspire the audience and herself in a live situation.  Traditionally, the role of the fan in pansori appears symbolic, just as objects in Korean shamanic rituals help the shaman to acquire her altered-state of consciousness.  Puppet motion narratives, activated by the fan, will inspire her storytelling, not just represent it.  They will work as visual clues for the viewer to generate their own story, as well as a semantic map of tag clouds.   In exploring the Meta layer of communication, Parting on Z provides tag clouds instead of Korean-English translations of the original dialogues.  A tag (Meta data) is a non-hierarchical keyword or term assigned to a piece of information.  Tags will be chosen informally and personally, and shaped with corresponding weights.  Considering oral storytelling as a transformative narrative continuously imagined, evolved, and generated by listeners, tag clouds will allow audiences to navigate through and compose their own storytelling.

The story chosen for this performance is the farewell scene from Chun-Hyang-Ga (춘향가), the classic Korean love story that demonstrates the extreme emotional state of constraints called han (한).  Han is a paradoxical state of consciousness that combines the extreme state of grief caused by physical or mental constraints with a great hope and strong desire for overcoming the situation.  It is a fundamental driving source of transformative rituals in Korean shamanism.  Parting on Z explores han in the paradoxical relationship between virtual puppet and puppeteer via the distance between avatar and user—symbolic lovers facing each other, continuously exchanging dialogues of love and farewell.  Dramatizing the farewell scene, the virtual puppet as cyberbody is designed to slowly walk back along the Z-axis, mirroring the puppeteer’s walking steps, thus creating more and more distance from her actual body.  The drummer’s chuimsae will be able to make the virtual puppet return back to the original position; his speech, accompanied by drumming beats, “Ul-ssi-gu!” or “Ul-Ssu!”, serve as dynamic interactive forces to blow energy and cheer the puppeteer.

 

PARTICIPANTS

Art Direction + Virtual Space: Semi Ryu (VCU Kinetic Imaging)
Interactive system: Stefano Faralli (Multimedia lab, Univ. of Rome, Italy)
Performers: Jung-Hee Oh(Pansori Master), Dong-Hoon Kim(Drummer)
Text generation: Ali Miharbi (VCU Kinetic Imaging)
Video Documentation: Anne Schermerhorn (VCU Photography/Film)
Postcard Design: Eric Wolinsky (VCU Graphic Design)

 

Duration of performance

20-30 minutes

 


Jan 11 2009

Presented paper at Digital Art Forum, Art Center Nabi, Seoul

img_0230-1
img_0249
img_0263-1


Jan 11 2009

Organized KI graduate show in Seoul

Leaflet

INSECURE (PDF)

http://esterknows.com/2008/11/21/ki-graduate-students-and-faculty-in-seoul-korea/


Jan 3 2009

New Year Greetings

Happy New Year!