Email this Article Email   

CHIPS Articles: Using Virtual Reality, Artificial Limbs to 'CONVEY' the Power of STEM

Using Virtual Reality, Artificial Limbs to 'CONVEY' the Power of STEM
By Warren Duffie Jr., Office of Naval Research Public Affairs - September 6, 2017
ARLINGTON, Va. (NNS) -- Addressing a crowd of middle- and high-school students, the former U.S. Army Soldier discussed how he lost his arm and leg to combat-related injuries-describing the challenges of using prosthetic limbs to brush his teeth or enjoy recreation like swimming.

The warfighter then turned the conversation over to his young daughter, who said, "One thing my dad never has trouble with is hugging me." To prove her point, father and daughter gave each other a powerful squeeze.

This poignant moment underscored the human element of a series of science, technology, engineering and math (STEM) workshops recently held by the Johns Hopkins Applied Physics Laboratory (APL)-America's largest university-affiliated research center-at Walter Reed National Military Medical Center in Bethesda, Maryland. The workshops targeted students whose parents are current or former military personnel, and highlighted the science behind prosthetic limbs.

Coordinated by the Johns Hopkins APL, with support from the Office of Naval Research (ONR), the interactive workshops were part of a new initiative titled CONVEY-Connecting STEM Outreach Now Using VIE Education for Youth. (VIE stands for Virtual Integration Environment.)

Johns Hopkins APL created CONVEY through its STEM program to educate children about prosthetic limbs-using virtual- and augmented-reality technology-and spark an interest in future STEM careers.

"An important priority of the Navy and Marine Corps is cultivating the next generation of scientists and engineers," said Dr. Peter Squire, a program officer in ONR's Expeditionary Maneuver Warfare and Combating Terrorism Department. "CONVEY represents an excellent opportunity to demonstrate how science impacts and benefits amputees using prosthetics, and to create a personal connection between science and technology and people."

CONVEY combines specialized software developed by Johns Hopkins APL with commercially available technology-like the Oculus Rift virtual-reality headset and Microsoft HoloLens augmented-reality headset-to teach children about biology, anatomy and engineering.

Virtual reality is a wholly computer-generated environment in which users immerse themselves. Augmented reality, by contrast, superimposes virtual objects onto a real environment-like the yellow first-down lines added to television broadcasts of football games.

During the recent workshops, middle and high school participants used the Oculus Rift to manipulate virtual prosthetic limbs, play computer-generated games like darts and ping pong, and move objects around. They wore the HoloLens headset to study 3-D representations of the human brain, nervous system and muscle groups. Students also learned how new, cutting-edge prosthetics incorporate advanced microcircuits to restore the use of limbs and allow amputees greater control and utility.

"Our objective is to use the virtual training platform to enhance each child's understanding of how STEM concepts and products are being used to enable personal independence, mobility and human interaction for their loved ones," said Dwight Carr, who manages the Johns Hopkins APL STEM program. "It's an engaging and interactive way to expand the use of the technology, while helping both the service members and their families."

ONR is committed to identifying and attracting young STEM talent-and provides programs for K-12 students designed to build excitement about careers in science and engineering. Carr hopes to host more military-focused workshops in the future, as well as incorporate CONVEY within Johns Hopkins APL's own STEM outreach in and around Baltimore and Washington, D.C.

View a video about CONVEY.

Warren Duffie Jr. is a contractor for ONR Corporate Strategic Communications.

For more information, visit,, or

For more news from Office of Naval Research, visit

Related CHIPS Articles
Related DON CIO News

CHIPS is an official U.S. Navy website sponsored by the Department of the Navy (DON) Chief Information Officer, the Department of Defense Enterprise Software Initiative (ESI) and the DON's ESI Software Product Manager Team at Space and Naval Warfare Systems Center Pacific.

Online ISSN 2154-1779; Print ISSN 1047-9988
Hyperlink Disclaimer