The December 2006 performance definitely gave new meaning to collaborative dancing and creative choreography. Through this performance we have learned new lessons that lead us to new symbiotic relationships between creative dance design and new TI technology elements.
TI Technology Lessons Learned: The 3D real-time vision algorithms need further improvement as we discussed in Section 3 and showed in Figure 3. The dancers had considerable visual “holes” and their movements were slower than real-time since the TI system is currently not able to reconstruct 3D frames at higher speed than 10 3D frames per second. The network protocols need further improvements with respect to bandwidth and content adaptation, strong support for better extracting and understanding of semantic information about dancer location, and importance of presented views to the audience, resulting from the 3D vision algorithms, dancers and audience.
Collaborative Dance Lessons Learned: Through this experiment, we have answered the first set of questions discussed above. Movement in virtual spaces makes sense for artists. Due to their improvisation skills, they cope very well with the various imperfections of the TI technology, such as delays, bandwidth constraints, and visual holes. Actually, they use it for their artistic advantage and create very visually pleasing dance segments. However, the experiments also show that dancing in cyberspace is very different than in physical space. For example, with the sense of virtual touch feedback, if one raises a hand in the cyber environment to touch a virtual object or person and there is no physical object to touch, different reactions in dancers are produced. It has become very clear that a new type of choreography must be created when considering dancing in TI environments. But it is precisely this new type of creative interaction with the technology that makes it so exciting for dancers and choreographers. The art form of dance choreography that inherently values the different ways in which individuals move and relate to one another is a good fit with TI technology, which inherently values the entire body of an individual streaming into cyberspace.
The possibility to arrange bodies/individuals in infinite new ways in relationship to each other and virtual objects, as well as the ability to create entirely new meanings and contexts through this creative coordination, has the potential to have a huge impact on the field of choreography and on many other fields that prioritize the study of the body.
3D TI environments are becoming more viable and more affordable. As we have shown, it is possible to build TI environments out of COTS components and engage them in geographically distributed interaction and communication. Furthermore, with the maturity and advancement of TI technology, we are experiencing a very natural symbiosis between collaborative dancing and TI technology as it was shown in our experiment between UCB and UIUC in December 2006. This symbiosis creates feedback in both ways. The TI technology becomes richer in terms of its digital options to allow dancers to explore more and more physically impossible situations in the virtual spaces and hence create very new choreography designs.
2 Baker, H.H. et al., “Computing and Performance Issues in Coliseum, An Immersive Videoconferencing System,” ACM Multimedia, Berkeley, CA, November 4-6, 2003, pp. 470-479.
3 Ott, D. E., Mayer-Patel, K. “Transport-level Protocol Coordination in Distributed Multimedia Applications,” ACM Multimedia, Doctoral Symposium, Berkeley, CA, November 4-6, 2003, pp. 644-645.
4 Raskar, R. et al., “The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays,” ACM SIGGRAPHD, 1998.
5 Futures Laboratory. Accessgrid v2.2, software available online, June 2004.
6 Perkins, C. S., Gharai, L. “UltraGrid: A High Definition Collaboratory v. 0.3.0,” August 2004. www.east.isi.edu/projects/UltraGrid
7 Mulligan, J., Daniilidis, K. “Real-time trinocular stereo for tele-immersion,” International Conference on Image Processing, pp. 959-962, 2001.
8 Svoboda, T. et al, “Convenient Multi-camera Self-Calibration for Virtual Environments,” Presence: Teleoperators and Virtual Environments, Vol 14, No. 4, August 2005, MIT Press.
9 cairo.cs.uiuc.edu/teleimmersion/