N121-061 TITLE: Physics Based Multi-Touch Movement Interface Creation for 3D Modeling and Simulation

TECHNOLOGY AREAS: Information Systems

ACQUISITION PROGRAM: NAVSEA 07TL, Submarine Training System; R&D training; Non-ACAT Program

OBJECTIVE: Develop physics based multi-touch for 3D Modeling and Simulation to advance training beyond basic Commercial Off The Shelf (COTS) multi-touch hand movement operations.

DESCRIPTION: The growing advancement of training on multi-touch Liquid Crystal Displays (LCD)/Light Emitting Diode (LED) is limited to very basic Commercial Off The Shelf (COTS) multi-touch hand movements. The multi-touch hand movements are currently limited to panning, zooming (maximum two finger input), rotate (maximum two finger input), and flick. The ultimate goal is to develop a more advanced physics based multi-touch software capability including measurement of pressure to manipulate complex 3D objects (i.e. removing a push pin or operating a torque wrench), and for navigation within a 3D environment. The end state for this development is to create a software repository of complex multi-touch pressure sensitive hand movements for current and future use in multi-touch training applications. Examples of some of the multi-touch hand movements that would be developed include a gripping (hold an object in place), lasso (select/group several objects), check (mark item complete). A complete library of multi-touch pressure sensitive hand movements will be provided in Phase II. The main technical challenge in the development of multi-touch multi-movement is multi-threaded event processing (distinguishing unlimited simultaneous hand movements). The software for multi-touch hand movement development should be reusable across other software development platforms.

PHASE I: Define and develop a new and creative multi-touch pressure sensitive movement interface approach/concept which allows for complex input including up to six degrees of freedom. This approach will broaden multi-touch interface development beyond panning, zooming, rotate and flick. An example would be a hand movement for operating a torque wrench. The multi-touch movement could be to use three or more inputs on the torque wrench, and based on the pressure applied to the side of the handle of the wrench (combined with the direction of motion), would result in movement of the torque wrench. Demonstrate the feasibility to simultaneously recognize distinct positions of input touches combined with a motion and pressure as a unique input.

PHASE II: Develop, test, and evaluate the new multi-touch multi-hand movement software on multi-touch pressure sensitive hardware (prototype). Demonstrate sample multi-touch pressure sensitive hand movement (defined by the Program Office). Creatively demonstrate how several users can manipulate the defined multi-touch pressure sensitive movements simultaneously, with more complex interactivity than currently available. Develop a process and demonstrate the ability to easily adapt this software code to other software coding languages.

PHASE III: Upon completion of Phase I and II this new technology will be transitioned to commercial developers and government research and development facilities responsible for design and building of future modeling and simulation devices. Specifically, transition and test these movements into the Weapons Launch Console Team Trainer (WLCTT). The awardee will integrate and support testing of the the multi-touch movement software into the WLCTT. Additionally, the company will demonstrate that the developed multi-touch movement will interface/operate on the Program Office specified objects in a 3D space. Provide new specification to use multi-touch movement in future simulation training such as team and/or maintenance training specifically the Virginia torpedo room on the Weapons Launch Console Team Trainer (WLCTT). The Program Office will assist the company in meeting goals/requirements of the Navy.

PRIVATE SECTOR COMMERCIAL POTENTIAL/DUAL-USE APPLICATIONS: This technology has tremendous applicability and value to the gaming, personal computing, and training industry. Multi-touch displays and their associated hand movements are the emerging technology that will soon replace single touch input screens. The physics algorithms used to aid in the development of this technology are used in the development of many Xbox, Wii, and PS3 games.

REFERENCES:
1) "7 Things you need to know about Multi-Touch interfaces."
http://net.educause.edu/ir/library/pdf/ELI7037.pdf

2) "Windows Touch: Developer Resources."
http://code.msdn.microsoft.com/WindowsTouch

3) Eden, Joel. "Designing for Multi-Touch, Multi-User and Gesture-Based Systems."
http://www.drdobbs.com/architecture-and-design/216402697

4) "Game Physics Simulation."
http://bulletphysics.org/wordpress/

KEYWORDS: multi-touch; hand movement; training; interactive training software; modeling and simulation; physics for gesture devices;

** TOPIC AUTHOR (TPOC) **

DoD Notice:   Between November 9 and December 11, 2011, you may talk directly with the Topic Authors to ask technical questions about the topics. Their contact information is listed above. For reasons of competitive fairness, direct communication between proposers and topic authors is not allowed starting December 12, 2011, when DoD begins accepting proposals for this solicitation.

However, proposers may still submit written questions about solicitation topics through the DoD's SBIR/STTR Interactive Topic Information System (SITIS), in which the questioner and respondent remain anonymous and all questions and answers are posted electronically for general viewing until the solicitation closes. All proposers are advised to monitor SITIS (12.1 Q&A) during the solicitation period for questions and answers, and other significant information, relevant to the SBIR 12.1 topic under which they are proposing.

If you have general questions about DoD SBIR program, please contact the DoD SBIR Help Desk at (866) 724-7457 or email weblink.