DISS 780 - Annotated Bibliography: Virtual Reality on the Internet

Chapter I

Introduction

The annotated bibliography that follows is submitted to satisfy the requirements of DISS 780 Assignment 12 and as the first step in the completion of the preliminary proposal paper for DISS 880 titled Virtual Reality on the Internet. The following introduction describes the problem to be investigated and goal to be achieved. The introduction also provides an analysis of the relevance and significance of the research.

Problem Statement and Goal

Virtual reality (VR) applications on the Internet are used to create the illusion of reality. They are often used for entertainment, training, medicine, manufacturing, virtual communities, and e-commerce. As VR applications become more common on the Internet, users are presented with the problem of understanding how and to what extent these applications are currently being used. The references annotated in this paper are the result of an investigation into this problem. The goal of the investigation was to find answers to the following related questions:

How widespread is the use of VR technology on the Internet?
What VR applications currently exist on the Internet?
How successful are current VR applications?
What design challenges do they present?
Are they effective and usable?

In addition, the research focused on the implementation, positive and negative effects, and trends of the use of VR on the Internet.

Relevance

This research is relevant to the study of multimedia systems because of the increasing use of VR applications and the enhanced experience that VR provides viewers of multimedia productions delivered over the Internet. The research is significant because a better understanding of the current state of VR applications will benefit users as they apply the technology to areas with which they are familiar.

Summary

In summary, the section above introduced the problem to be investigated, the goal to be achieved, and the relevance and significance of the research. In the next chapter, this paper provides annotated citations of reference material related to the problem and goal under study.

Chapter II

Annotated Citations

The annotated citations that follow are listed in alphabetical order by author. Each citation consists of a reference in bold type followed by an annotation. The annotation briefly describes the work along with its relationship to the problem and goal being researched.

Broll, W. (1997, March1-5). Distributed virtual reality for everyone - A framework for networked VR on the Internet. Paper presented at the IEEE Virtual Reality Annual International Symposium (VRAIS '97), Albuquerque, New Mexico.

The author, Wolfgang Broll, is a researcher at the German National Research Centre for Information Technology in Sankt Augustin, Germany. The paper described a communication infrastructure able to support distributed virtual environments over the Internet. In addition, the author demonstrated mechanisms to support user cooperation and the composition of large meta-worlds.

General problems addressed in the research were keeping shared world's consistent, scalable network protocols able to support a large number of users, and the composition of large-scale subdivided worlds. Future research proposed in the paper included the ability to support consistency and interactivity between users with low bandwidth connections. The paper adds to the research topic by introducing network architectures capable of supporting multi-user virtual environments on the Internet.

Cibelli, M., Costagliola, G., Polese, G., & Tortora, G. (1999, September 27-29). A virtual reality environment for Web browsing. Paper presented at the IEEE International Conference on Image Analysis and Processing.

The authors, researchers at the University of Salerno, Italy, presented a method to map 2D Internet space in virtual worlds using predefined metaphors. The primary difference between their proposed system and current VR-Web-Browsers was its ability to map both site content and structure into the VR metaphor. Web elements are first mapped within a virtual world metaphor, and then a VR-Builder creates VRML sources based upon the virtual representation.

The VR-Spider prototype described in the paper was developed using Java and VRML. The scope of the prototype was to assist naive Internet users in exploring Web sites through the use of friendly metaphors. In the future, the authors intend to further this research with the integration of MPEG 7 technology into the prototype. In addition, the VR-Spider will be enhanced to account for interactions between avatars in a virtual world. The authors add to the research topic by describing existing Internet VR technologies and by proposing new ones.

De Abreu, A., Rodriguez, O., & Mateo, A. (1999, July 14-16). Analysis and design of virtual reality applications in the Web: a case of study. Paper presented at the IEEE International Conference on Information Visualization, 1999.

The authors, faculty at the University of Central Venezuela, investigated the problem of designing a simple house using a VRML-based 3D design tool called EVA (Editor Virtual Architecture). Other tools employed during the study were Navigator 4.5 and VRML plug-in Cosmo Player 2.1.

Overall, the paper was unclear and not well written (a poor translation may be the reason). The paper adds to the research topic by demonstrating the ability of off-the-shelf VRML software to accomplish simple viewing tasks.

Emmen, A. (1999, April 12-13). Establishing a virtual medical worlds community. Paper presented at the International Conference on Information Technology Applications in Biomedicine, 1999.

The paper described the newly created European "Virtual Medical Worlds Community: (VMWC). The group is focused on advancing the use of advanced technology in telemedical applications. In addition, the group will stimulate the exchange of information and expertise in areas that include VR technologies in the medical sector.

The Web-based medical community described in the paper provides access to a variety of on-line journals and aims to accelerate European technical developments in medical VR. The paper adds to the research topic by demonstrating the growing awareness of the potential of VR technologies in the field of medicine.

Junlan, Z., Kiat, Y., & Sung, L. (1999, February). Architecture for a Web-base distributed virtual reality system. Paper presented at the IEEE Internet Workshop, 1999.

The authors of the paper are researchers at the School of Applied Science, Nanyang Technological Institute, Singapore. In the paper, they describe the architecture for a Web-based distributed virtual reality system (DVRS). The system is based on a high-level architecture called "RunTime Infrastructure" that was developed for distributed interactive simulations. Images were displayed using a standard Web browser and VRML plug-in. However, the system did not support real-time video or audio.

The research found that in order to ensure the orderly delivery of packets to all users of the system a registry server was needed. This special server's sole purpose was to manage and maintain the state of the virtual environment. The authors plan to extend the research in the future with a project to incorporate multimedia in the virtual environment. The paper adds to the research topic by illustrating different techniques to manage a distributed virtual reality system.

Ko, D., Sumi, Y., Choi, Y., & Mase, K. (1999, October 12-15). Personalized virtual exhibition tour (PVET): An experiment for Internet collaboration. Paper presented at the IEEE International Conference on Systems, Man, and Cybernetics, 1999.

The authors are researchers at ETRI Multimedia Technology in Taijon, South Korea. The paper described the PVET (Personalized Virtual Exhibition Tour) application developed by the authors to serve as a test bed to extend personal collaboration over the Internet. PVET is a Java applet that executes virtual exhibitions.

To support collaboration between users, PVET provided agents that contained utterances. Users were able to recognize the interests of others and add to their own thoughts. The authors plan to add multi-user supports to enhance synchronous collaboration. The paper adds to the research topic by demonstrating the use of virtual tours as a means of Internet collaboration.

Lawton, M. (1999, March-April). Advancing 3D through VRML on the Web. IEEE Computer Graphics and Applications, 19(2), 4-5.

Mark Lawton, the author, is Creative Director at Construct Internet Design. In the paper, Lawton described a number of VRML-based projects recently completed for clients that included Platinum technologies and CNN Interactive. The application developed for Platinum was a 3D network visualization that allowed nontechnical users easily navigate through and diagnose problems with a network. The CCN project used a large 3D polygonal object mapped with a high-resolution image of a hurricane.

One roadblock encountered by the author during the course of each of these projects was the lack of one standard VRML browser. Key to the success of future VRML applications is this standard. The author adds to the research topic with real life examples (along with the technical hurdles) of VRML applications on the Internet.

Li, T., Lien, J., Chiu, S., & Yu, T. (1999, May 26-29). Automatically generating virtual guided tours. Paper presented at the IEEE Conference on Computer Animation, 1999.

The authors, faculty of the Computer Science Department of the National Chengchi University, Taiwan, investigated the problem of navigating 3D landscapes with 2D user input devices (e.g. a mouse). The paper proposed an alternative navigation metaphor in which users specify locations of interest on a 2D-layout map and the system automatically generates an animated guided tour in 3D.

The system was implemented using Java and a common VRML browser interface. Also employed were auto-navigation techniques in which several efficient path-planning algorithms were used. The incorporation of Cinematographical idioms is planned for future research. The paper adds to the research topic by illustrating and effective technique to improve the usability of browser-based virtual reality applications.

Matsuba, S., & Roehl, B. (1999, March-April). "Bottom, thou art translated": The making of VRML Dream. IEEE Computer Graphics and Applications, 19(2), 45-51.

The authors are the founding partners of the VRML Dream Company. In the paper, they described the development of the VRML Dream project (a live performance of Shakespeare's A Midsummer Night's Dream). VRML Dream was the first live, streaming, VRML entertainment project with a running time of greater than two minutes. The project proved that streaming both motion and voice data over standard Internet connections was possible.

In addition, the paper described the server and client technologies required to produce the real-time 3D animation over the Internet. Future project plans involve improvements to audio quality and enhanced interfaces for controlling avatars with motion capture equipment. The paper adds to the research project by demonstrating the viability of broadcasting 3D entertainment over the Internet.

Moore, C., McClurg, D., Soreide, N., Hermann, A., Lascara, C., & Wheless, G. (1999, September 13-16). Exploring 3-dimensional oceanographic data sets on the Web using virtual reality. Paper presented at the IEEE Conference - Riding the Crest into the 21st Century - Oceans '99 MTS.

The authors are faculty of the University of Washington in Seattle, Washington and Old Dominion University in Norfolk, Virginia. In the paper, they presented the results of efforts to make environmental data (i.e. oceanographic) available as interactive 3D worlds via the Internet. Included were 3D visualizations of El Niho and La Nifia as monitored in the tropical Pacific Ocean.

In addition, output animations from hydrothermal plumes from sea floor volcanic eruptions were included in the project. In the future, the authors planned to develop toolkits to allow scientists to easily create VRML objects and worlds. The paper adds to the research topic by demonstrating the effectiveness of VR applications when applied to Oceanographic research.

Muller, A., Leissler, M., Hemmje, M., & Neuhold, E. (1999, June 7-11). Towards the virtual Internet gallery. Paper presented at the IEEE International Conference on Multimedia Computing and Systems, 1999.

The authors, researchers at TU Darmstadt in Germany, introduced an electronic service for artists and art galleries to exhibit their artwork on the Internet. The service called The Virtual Internet Gallery (TVIG) utilized a database to enhance search functionality and performed 3D visualizations of search results.

The paper demonstrated how technologies such as VRML and Java could be employed to enhance the quality of art exhibitions via an electronic system. Suggested topics for future research included the integration of video and audio or the addition of virtual shelves on which VRML models could be exhibited. The paper adds to the research topic by demonstrating another unique application of VR technology.

Nielsen, J. (1999). Designing Web Usability. Indianapolis: New Riders Publishing.

Jacob Nielsen, the author, is a leading authority on Web usability. He spends much of his time lecturing and writing on usability issues. His Website is located at www.useit.com. The book provided a comprehensive overview of the problems to be solved when designing a Web site. Also, the book is the first of two books that Nielsen will be publishing on the subject of Web usability.

In the chapter on content design, Nielsen discussed the proper use of 3D graphics in Web designs. Examples of good and bad designs were presented. Included in those deemed appropriate were instances in which the user was required to visualize physical objects that needed to be understood in solid form. In addition, abstract data sets (with exactly three attributes) were good candidates for 3D visualization. Nielsen adds to the research topic by describing the design challenges that VR applications present to Web usability.

Otmane, S., Mallem, M., Kheddar, A., & Chavand, F. (2000, April 16-20). Active virtual guides as an apparatus for augmented reality based telemanipulation system on the Internet. Paper presented at the IEEE 33rd Annual Simulation Symposium, 2000.

The authors, instructors at the University of Evry Val-d'Essonne in Evry, France, proposed the construction of a teleoperation system they named ARITI (Augmented Reality Interface for Telerobotic application via the Internet). ARITI was different from existing teleoperation architectures because of its use of active virtual guides to assist human operators (HO) with the completion of simple tasks with enhanced speed, precision, and safety. Techniques employed by the system included VR and augmented reality (AR) together with Internet-based programming.

The use of AR techniques allowed operators to superimpose virtual and real models on the same video feedback. Test results from the study showed that the use of a virtual guide together with other interface features were of great help to operators. Using virtual guides, operators were able to achieve better accuracy, performance, and safety. Future work proposed by the authors was the extension of the proposed system to mobile robotic teleoperations. The paper adds to the research topic by providing an example of how robots can be effectively manipulated using an Internet-based VR application.

Regan, T. (1998, February 16-20). Taking living worlds into people's living rooms. Paper presented at the Third Symposium on Virtual Reality Modeling Language, Monterey, California.

The author, Dr. Tim Regan, is a researcher at BT Labs. The paper presented the results of two experiments conducted at BT Labs into Inhabited TV. The experiments used Shared VRML Worlds delivered to user's PCs via the Internet.

The study concluded that Shared VRML Worlds provided an excellent medium for experimentation on Inhabited TV. Reasons for this included the availability of a variety of authoring tools and the VRML capabilities of the available Internet browsers. The paper adds to the research topic be demonstrating the unique application of VRML technology to Inhabited TV programming.

Rosenblum, L. (2000, January-February). Virtual and augmented reality 2020. IEEE Computer Graphics and Applications, 20(1), 38-39.

The author is a researcher at the Naval Research Laboratory, USA. The paper looks ahead to the year 2020 to predict the progress that will be made in the field of virtual reality in the next two decades. Examples include very portable graphics computing that will provide VR and AR anywhere and anytime.

In addition, generation-after-next intelligent agent architectures will provide automated user-specific search tools. The paper adds to the research topic by suggesting one possible course that VR applications will take in the future.

Russ, K., & Wetherelt, A. (1999, March-April). Large-scale mine visualization using VRML. IEEE Computer Graphics and Applications, 19(2), 39-44.

The authors, researchers at the University of Exeter in the United Kingdom, demonstrated the use of VRML technology to visualize existing 2D and 3D mine plans and sections via the Internet. 3D VRML models were constructed using existing electronic digital data, paper plans, and miscellaneous reports.

Advantages gained from the use of VRML included increased rendering speed, ease of creating geometry, and Internet capability. Future enhancements include increased speed of image generation and the addition of surface buildings and general mine furniture to the model. The paper adds to the research topic by illustrating the process involved in converting existing digital and non-digital data into a working VRML model.

Safaric, R., Jezernik, K., Calkin, D., & Parkin, R. (1999, July 12-16). Telerobot control via Internet. Paper presented at the IEEE International Symposium on Industrial Electronics, 1999.

The authors are faculty of the Electrical Engineering and Computer Science School of Maribor University in Slovenia. Their paper described the design issues encountered when remote access to a laboratory robotic system is provided to users via the Internet. As part of the project, simulation tools for robotic hardware were developed using VRML 97 and Java.

The result was a desktop virtual reality environment that allowed the visualization and manipulation of robotic hardware within an associated workspace. In addition, the distributed control methodology developed as part of the project eliminated unpredictable network loading problems. The paper contributes to the research topic by demonstrating one method of distributed remote control of automation systems over the Internet.

Santillo, L., Murino, T., & Paduano, G. (1999, October 18-21). Remote controlled virtual reality construction. Paper presented at the IEEE International Conference on Emerging Technologies and Factory Automation, 1999.

The authors, faculty at Naples University in Naples, Italy, introduced a new virtual reality method that permitted remote users to obtain a visual representation of a product request via the Internet. The method was essentially a "virtual catalogue" designed for selling compound products (e.g. furniture).

The method allowed users to interact with virtual scenery. Available tasks included the movement of an object, addition of an object, removal of an object, and change of the observation point. The advantage of the proposed model was the improved communication it provided between a company and its customers. The paper adds to the research topic by demonstrating the ability of VR applications to positively affect e-commerce transactions.

Sato, F., Minamihata, K., Fukuoka, H., & Mizono, T. (1999, September 21-24). A reliable multicast framework for distributed virtual reality environment. Paper presented at the IEEE International Workshops on Parallel Processing, 1999.

The authors, faculty of the school of information at Shizuoka University in Hamamatsu, Japan, proposed a new reliable multicast protocol to support many to many virtual reality environments. The protocol also provided message ordering and reliability. Unique to the protocol was its fast retransmission management and efficient retransmission buffer management based upon a local Mutual Aide Region (MAR).

Source sites using the protocol are not responsible for the receipts of all sites. This is because retransmission management is distributed into regions. Evaluation of the protocol demonstrated efficient message arrival times, and retransmission buffer sizes. Proposed future research included improvement of the restriction of message ordering and the widespread implementation of the protocol. The authors add to the research topic by demonstrating a workable solution to one of the design challenges of deploying VR technology on the Internet.

Schulz, M., Reuding, T., & Ertl, T. (1998, November-December). Analyzing engineering simulations in a virtual environment. IEEE Computer Graphics and Applications, 18(6), 46-52.

The authors, faculty at the University of Erlangen in Germany, presented the results of their ongoing research in the development of a virtual environment for car-body engineering applications. The technology proved to be an effective tool to communicate prototype designs between engineers over the Internet. The main advantage of the virtual environment was the intuitive navigation and interaction with the different finite element measurements employed in the car-body development process.

In addition, the ability to generate VRML files allowed the use of low-cost workstation and the Internet. Another key feature of the system was the ability to load simulation files into the virtual environment directly without any preprocessing. In the future, the authors plan to extend the project to include texture mapping and the use of iconic techniques. The paper adds to the research topic by demonstrating the effectiveness of VR techniques in enhancing engineering collaboration on the Internet.

Shi, J., Smith, T., Granieri, J., & Badler, N. (1999, March 13-17). Smart avatars in JackMOO. Paper presented at the IEEE Conference on Virtual Reality, 1999.

The authors are researchers at the Center for Human Modeling and Simulation, Pennsylvania University, Philadelphia, Pennsylvania. The paper describes the authors' prototype system called JackMOO. The system combines Jack, a virtual human, and LambdaMOO, a multi-user, network-accessible, interactive server. The combined JackMOO provided avatars with an increased range of human actions.

In addition, the avatars were able to express their actions in the form of imperative sentences. Future efforts of the project team will include the additional requirements to support multiple human participants. The paper adds to the research topic by showing the benefits of smart avatars when utilized in a distributed virtual training environment.

Sorid, D. (2000, July). The virtual surgeon. IEEE Spectrum, 37.

The author is contributing editor of IEEE Spectrum magazine. The article details the growing use of VR trainers in the medical profession. These computer-based simulators are used to hone the operating skills of surgeons before an operation. In addition to pinpointing areas of weakness, VR trainers prepare doctors psychologically for surgical tasks.

Studies have shown that the technology is at least as good as standard training methods. In the future, advances in medical graphics may soon allow ordinary medical scans of a patient's anatomy to be enhanced into 3D virtual views. This paper adds to the research topic by summarizing current surgical VR applications.

Terashima, N., Tiffin, J., & Rajasingham, L. (1999, June 7-11). Experiment of virtual space distance education system using the objects of cultural heritage. Paper presented at the IEEE International Conference on Multimedia Computing and Systems, 1999.

The authors, faculty of Waseda University in Tokyo, Japan and Victoria University of Wellington, Australia, proposed a virtual space distance education program called HyperClass. The HyperClass environment allowed teachers and students to use avatars to conduct classes and do cooperative work in a virtual classroom. In addition, the prototype of the HyperClass system developed during the project utilized 3D objects of Japanese heritage.

During the experimental phase of the project, students handled the Japanese artifacts using VR hand gestures. These tasks were facilitated by stereoscopic views of the objects from various perspectives. The paper adds to the research topic by demonstrating how avatars can be employed to increase the effectiveness of virtual distance education applications over the Internet.

Todesco, G., & Araujo, R. (2000, April 10-13). MPEG-4 support to multiuser virtual environments. Paper presented at the IEEE 20th International Conference on Distributed Computing Systems, 2000.

The authors, faculty of the Computer Science Department of the Sao Carlos Federal University in Sao Carlos, Brazil, addressed the current technical limitations of distributed VR systems in integrating multimedia content. In addition, the paper proposed a tool called SVRT-MM (Shared Virtual Reality Tool Integrated with Multimedia), which extends MPEG-4 to support multiuser applications.

The paper was intended to contribute to the development of a MPEG-4 standard that fully supports multiuser 3D environments. Future work will include the evaluation of the SVRT-MM tool in regards to end-to-end latency. The paper adds to the research topic by addressing the need for enhanced standards to increase the effectiveness and usability of VR applications.

Vermeulen, H., Niekerk, T., Huang, J., & Hattingh, D. (1999, September-October). VRML to monitor and control an industrial robot via the Internet. Africon, 1999 IEEE, 1, 561-564.

The authors, researchers at the Manufacturing Technology Research Center in Port Elizabeth, South Africa, described the methodology they followed to model an industrial robot manipulator in VRML. During the project, a VRML model of a robot manipulator was constructed to replicate a commercially available ABB material-handling robot. The VRML model was able to control and monitor the manipulator via the Internet. The advantage gained by such a system was the ability of production operators to remotely visualize the robotic system within the factory environment.

The study reported in the paper demonstrated that VRML and the Internet were powerful tools for extending robot control to include remote 3D monitoring and control. The authors proposed that other researchers extend the project to include intelligent control of complete robotic cells. The paper adds to the research topic by demonstrating an effective and usable manufacturing system employing VR technology.