Jonah Salz

A CG projection method of supporting to stage live performances

Recently many live performances use projected visual images and videos. Our goal is to provide a supporting system for the creative use of CG animation for live performances. This paper describes a method of supporting live stage performances by projecting computer-created visual images. We developed a system to project images in a theatre, and then staged performances with both living actors and virtual CG animations. The system can project images in various types of theatres, and can adapt to the trial and error of rehearsals, not constricted to pre-set programs in actual performances. This paper describes our experience with one of our performances featuring collaborative scenes of actual actors with virtual actors created by CG with human motion-data. Moreover we created transitions representing paradise and various levels of hell. After the performances, we received comments from director and spectators that the projection of CG animations was a fascinating and powerful method for combining live performances and CG.

Choreography composition and live performance on a Noh stage

We have been developing a simulation system for dance using a 3D motion archive. Our goal is to provide a supporting system for the creative use of motion data for live performances. We used motion data and this system on a Noh stage, which is normally used by the classic Japanese masked musical drama. The performance was a new Noh based on Shakespeares Macbeth. One challenge in this performance was to create collaborative scenes of real and virtual actors. We displayed virtual actors on a projection screen. We deployed two real actors and one virtual actor as three witches in the Macbeth story. Another challenge was real-time composition of dance on stage. We controlled one of the virtual actors to dance according to the real actors on the stage. In this paper, we describe the method of choreography composition and our experience using the system in a Noh theater.

A virtual performance system and its application on a Noh stage

We have developed a virtual performance system that projects visual images and controls them in a theater easily. This system manages videos and 3D models, and users can control the projected image in real-time. We used the system on a Noh stage. We displayed virtual actors and had them act with the real actors. As a result of evaluations by the audience, we verified that using virtual actors acting with real actors can provide effective stage presentations.

Enhancement of Stage Performances by Projecting CG Animation and Control of Images with Sensors

We have been producing live stage performances using computer graphics (CG) and interactive techniques. We developed a system to support and enhance live performances. This system projects CG onstage alongside real actors and allows users to control the projected images in real time. Collaborative scenes between real actors and virtual actors created by CG are possible. The system has multi-functions and is flexible, hence, it can be used for purposes other than performances. The system helps directors and actors in the creation of performances, as well as during rehearsals. Moreover, the system is portable and easy to set up in various types of theaters. The system can use sensor devices to determine physical expressions of actors or spectators. These perceived states can be used to affect projected images, which can provide a richer presentation. This paper describes the structure of the system and its effects in live performances that we attempted.

Enhancement of stage performances with projected CG and Noh motions

Our goal is to provide a support system for creating rich and flexible presentations in live performances using motion data. We created a live stage performance and a projection system which is for enhancing the performance with videos and CG animations. We choreographed and captured Noh motions, and created animation of CG characters to project. The CG characters were deployed in a responsive manner during a dance performance and integrated with live actors. In this paper, we describe the CG creation using Noh motion data, and our experience using the projection system and the CG in the live stage performance.