I recently (proudly) worked on the fraMESHift project.
Here you can see the project booklet: FraMESHift-Booklet.
“An investigation of the human/technology relationship that reminds us to ask the question of who is actually in control. This interactive, experimental dance theatre work explores the human/machine relationship, introducing two symbolic main characters, human and robot, who must learn to communicate and co-exist in overlapping worlds”
Here is the teaser:
The following video is taken from the RAI news (Italian national television broadcaster):
The performance is a complex distributed system ran by about 9 computers (mixed PCs and Macs). I’ve developed the real-time control of the virtual robot. A performer controls the 3D robot projection in real-time, on stage, through the use of a Kinect and two Wiimotes. We used Processing and the SimpleOpenNI library to control the kinect. The robot behaviour has been programmed in Java, using the Enthusiasm platform for 3D rendering. All inter-communication is based on OSC.