3D Interaction Devices

(From Erko Aaberg)

Description and explanation of your chosen technology

(Following text could be an addition to what has already been posted by Domenico under the same heading.)

3D Interaction devices

The 3D Interaction in Virtual or Augmented Reality environments also requires more sophisticated user interfaces (input and output devices) than standard desktop computers provide. Here is a broad list of the main types of devices for use in 3D environments, with some examples.

(Lee and Simon have already provided good examples of some of the most recently developed 3D interaction devices).

3D Output devices

• 3D Display - One or more viewers can see the 3D image produced by a single 3D monitor. Comparison of available devices: http://www.stereo3d.com/displays.htm.

• Head-mounted 3D display - Worn on the head as goggles that have a small display optic in front of both eyes to create a stereoscopic image. A YouTube example: http://www.youtube.com/watch?v=zTkL3k4j71M.

• 3D glasses - Most commonly one of the following:
• LCD shutter glasses - Are synchronised with a display monitor. The left and right glasses one at a time become dark or transparent, while the display correspondingly switches between images to be seen by the left or right eye. http://www.berezin.com/3D/ShutterFAQ.htm.
• Polarised glasses - Two projectors project a different image on the same screen. The polarised lenses of the goggles then separate different image for the left and right eye. This technology is being widely used in the IMAX 3D movies.

3D Input devices

• 3D mouse - Allows users to move more easily in a 3D space. One example: http://www.3dconnexion.com/3dmouse/overview.php.

• Data glove – Inputs data about the location and position of the users hand and fingers. By providing force feedback, some data gloves also work as output devices. An example of a data glove: http://www.immersion.com/3d/products/photo-gallery.php.
  This product captures the movement of the whole body: http://www.writemedia.co.uk/shapewrap.asp.

• Eye trackers – Measure eye position and movements as an input for moving in 3D space.
  

• Motion trackers with camera – Track the motion of a part or the whole human body or some external devices without intrusive devices (using only a camera). The following equipment allows moving an avatar in Second Life just with body movements (includes a video): http://dvice.com/archives/2008/04/second_life_cre.php.

• Treadmills – Simulate moving in 3D environment using different vehicles, like bicycles. A new research allows physical walking in 3D space: http://www.sciencedaily.com/releases/2008/04/080412174455.htm.

As the technologies become more immersive, especially in augmented and mixed realities, the input and output devices may become more unified into a single device. One example is the data glove mentioned above. Different simulators can include a set of different input or output devices.

Neural stimulation could be even a step forward from currently imaginable 3D user interfaces, possibly providing total immersive cognition and control over some external system. This has been thoroughly discussed in science fiction like The Matrix Trilogy movies.

Neural stimulation can be used both for input and output devices. Currently more usable devices have been invented for input functionality. The Direct Neural Interface or Brain-Computer Interface can be used to control any device just by using thoughts. This kind of interface can be either invasive (brain implants) or non-invasive (electrode headset). With a brain implant, scientists have come very close to transmitting speech into computers: http://newsvote.bbc.co.uk/2/hi/health/7094526.stm. A headset for use in computer games has recently been developed by Emotive Systems: http://uk.gear.ign.com/articles/772/772295p1.html. There are still many difficulties to overcome before such technologies will be widely available, those include the correct interpretation of the neural signals and right positioning of the electrodes or implants.

Neural output could be used to restore vision for blind people (http://ieet.org/index.php/IEET/more/1633/), but also for direct vision without monitors. Domenico has already referenced in his post a similar study about using Virtual Reality to help people with visual impairment (http://www.dcs.gla.ac.uk/%7Estephen/visualisation/).

As neural stimulation creates a direct channel between human and computer, it is definitely possible to reverse the direction of commands, making humans act based on computer input. Research has been done about controlling human movement: http://www.forbes.com/personaltech/2005/08/04/technology-remote-control-humans_cx_lh_0804remotehuman.html.