An official website of the United States government Here's how you know

Army researchers developing Augmented Reality software for field care

By Ms. Mallory Roussel (USARIEM)June 24, 2019

Army researchers developing Augmented Reality software for field care
Scientists from the U.S. Army Research Institute of Environmental Medicine are partnering with medics from the Farrelly Health Clinic, Fort Riley, Kansas, and the Texas Army National Guard to develop Augmented Reality surgical visualization software,... (Photo Credit: U.S. Army) VIEW ORIGINAL

NATICK, Mass. (June 24, 2019) -- X-ray vision might be a thing of fiction, but with the use of Augmented Reality, or AR, technology, it could come closer to reality and even save warfighters' lives.

U.S. Army medics who stabilize severely injured warfighters on the frontlines know there is nothing more critical than providing those warfighters the safest, most efficient treatment possible, especially during the "golden hour," or the first 60 minutes when the odds of survival are greatest. However, in Multi-Domain Operations when a medic could be hundreds of miles away from a surgical tent and could have fewer evacuation resources, how could they examine and treat injured warfighters without the help of a computerized tomography, or CT, scan or other X-ray equipment?

The U.S. Army Research Institute of Environmental Medicine, along with its partner laboratories in the U.S. Army Medical Research and Development Command, researches to understand the biomedical aspects of humans and their interactions with technology and the environment. One of the goals of this modernization effort is to leverage technology that will allow medical personnel to provide prolonged care in remote and challenging environments.

In an effort to maximize the Army medic's potential and bring an alternative for medical imaging to the battlefield, USARIEM scientists are partnering with medics from the Farrelly Health Clinic, Fort Riley, Kansas, and the Texas Army National Guard to develop AR surgical visualization software that would allow medics to look at a patient's internal anatomy, as if they had X-ray vision.

"Much like a CT scan in a hospital, medics could use this AR surgical visualization software on the battlefield to properly map out an injured warfighter's internal anatomy, particularly when a warfighter is deeply wounded," said Dr. Gary Zientara, the project manager and a USARIEM mathematical modeler. "This visualization tool could help medics evaluate injured warfighters more effectively and efficiently, helping them to provide warfighters safe, optimal treatment."

The medics providing their expertise, Cpt. Brandon Carius from Farrelly and Maj. Andrew Fisher from the National Guard, added that military medic training centers could also use the software as an educational tool to help new medics learn how to perform medical procedures.

"Currently, many medics' understanding of the workings of the human body are synthesized through texts, instruction and possibly cadaver labs," Carius said. "While these -- and the limited availability of clinical experience -- may provide substantial insight for learning, it may be difficult to maintain consistent exposure on all body systems to ensure medical proficiency.

"This technology would be invaluable to the ongoing education of military medics and medical providers at all levels. It would increase the availability of fully-sized human models that could be scaled and formatted to tailor medical instruction for specific body systems and pathologic concerns."

Zientara added that the AR surgical visualization software would be able to display a warfighter's medical imaging information on an AR device with the use of full-body, complete anatomy avatars.

USARIEM has spent the past few years developing software that would create individualized avatars of warfighters for various military uses. Additionally, The Defense Health Agency awarded three Small Business Innovation Research, or SBIR, Phase I contracts this year to support this effort, titled "Augmented Reality Surgical Visualization Tool for Combat Casualty Care," to three small businesses that specialize in engineering and developing AR technologies. The three companies include Augmntr Inc. from Nevada City, California; Computational Fluid Dynamics Research Corp. from Huntsville, Alabama; and Nakamir from Palo Alto, California.

The SBIR program is a highly competitive program that encourages domestic small businesses to engage in federal research and research and development concepts that have the potential for commercialization.

With the use of virtual X-ray images, the software could be used to produce avatars that would best model an individual's body composition and internal anatomy, regardless of gender, shape or size.

"The AR surgical visualization software would overlay an individualized, 3-D avatar of the warfighter's internal anatomy on the warfighter's body," Zientara said. "When wearing AR goggles, for example, this medical information would be projected on the lens. The intention is to aid the medic in visualizing blood vessels and anatomy deep below the body's surface while also keeping an eye on the patient."

According to Zientara, a warfighter's avatar could be computed from a simple body scan, if acquired during basic training, in combination with a gender-specific, standard anatomy model. However, a warfighter's avatar could also be updated with information from a dual-energy X-ray absorptiometry, or DXA, scan, which would increase the medical fidelity of a person's avatar. He added that each warfighter could easily carry their avatar information on their person with either a fingernail-sized micro-SD chip or another storage device.

"Care for wounded warfighters in austere and remote settings makes medical knowledge, skills and efficiency of the military medic paramount, especially when there are limited medical resources," Zientara said. "AR surgical visualization software is one example that demonstrates how we are working to maximize human potential and ensure maximal resources and state-of-the-art medical technology are available on the battlefield."

Related Links:

USARIEM Facebook

USARIEM Website