TECHNOLOGY AREAS: Human Systems

ACQUISITION PROGRAM: PMTRASYS Deployable Virtual Training Environment (DVTE)

OBJECTIVE: To develop a low-cost tracking system for individuals in virtual and augmented reality training environments.

DESCRIPTION: Virtual Reality (VR) and Augmented Reality (AR) systems are rapidly evolving (Muller, Schmorrow, and Buscemi 2008). To date, the joystick, gamepad, and keyboard/mouse have been most commonly employed control interfaces for inputting locomotion and firing information into many virtual worlds. While suitable for desktop gaming, this technique has the potential to provide negative training for many tasks. It has also been noted to provide a less compelling immersive experience compared to more direct forms of interaction (Usoh et al, 1999). The need exists to move beyond basic desktop/laptop virtual environments for many military training environments. More advanced VR and AR need to accurately and inexpensively track the position of the individual and his weapon. The individual�s head, limbs, and weapons must be tracked in real time so that a virtual representation of the individual can be rendered. Such technologies exist today (inertial, optical, and magnetic tracking), but are not low-cost and/or are not robust enough to be deployed and operated by the average (non-technical) user. Many of these systems are not able to capture facial expressions and individual finger movements, which is also desirable for advanced training applications. The goals of this topic should be accomplished with minimal equipment being added to the individual being tracked. The system must be very robust, since the training environments provide the individual with significant movement and shock. The system should be able to track multiple users operating in a shared space without loss of accuracy or individual identification.

Desirable Features:
Tracking: Head & weapon with
Accuracy: Orientation - 0.05 degree or better, Location - 2.5mm or better
Latency: 10 ms or less
Sampling Frequency: 120 Hz or faster
Maximum Weight (including batteries): 6oz or less on head and rifle
Also track major body segments and weapons. Tracking of facial expressions and individual finger movements would enhance the strength of the proposal.
Primarily for use indoors, but systems capable of outdoor use would make for a stronger proposal.
Provides full room coverage
Provides seamless transition between rooms
Track at least eight people per room
Low cost on a per room basis
Portable and easy to set up

PHASE I: Develop a concept for a highly accurate and low cost tracking system for the individual.

PHASE II: Prototype the tracking system in a laboratory environment. Demonstrate that the accuracy, latency, and robustness are sufficient for training applications.

PHASE III: Produce the tracking system at low-cost and in volume.

PRIVATE SECTOR COMMERCIAL POTENTIAL/DUAL-USE APPLICATIONS: Successful development has the potential to revolutionize the training and gaming industries. This technology could form the next generation of the highly successful Nintendo Wii controller.

REFERENCES:
1. Peter Muller, Dylan Schmorrow, and Thomas Buscemi. The Infantry Immersion Trainer: Today�s Holodeck, Marine Corps Gazette, September 2008, p. 14-18.

2. Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, Frederick P. Brooks, Jr. Walking > Walking-in-Place > Flying, in Virtual Environments. SIGGRAPH Conference, 1999, Los Angeles, CA USA.

3. Peter Muller, Joseph V. Cohn, and Denise Nicholson. Immersing Humans in Virtual Environments: Where�s the Holodeck?, Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2004, Paper No. 1773.

KEYWORDS: Training; Tracking; Virtual Reality; Augmented Reality; Simulation; Low-cost