New technology recognizes faces in the dark, far away

By Thomas Brading, Army News ServiceFebruary 11, 2020

New technology recognizes faces in the dark, far away
1 / 2 Show Caption + Hide Caption – A sniper with 1st Battalion, 27th Infantry Regiment "Wolfhounds", 2nd Infantry Brigade Combat Team, 25th Infantry Division scans for targets during a night iteration of a fire support coordination exercise Nov. 17, 2019 at Pohakuloa Training Area on ... (Photo Credit: U.S. Army) VIEW ORIGINAL
New technology recognizes faces in the dark, far away
2 / 2 Show Caption + Hide Caption – A heat signature from a thermal image is used to test facial recognition technology, Feb. 5, 2020, at the U.S. Army Research Laboratory in Adelphi, Md. The technology will be adapted into handheld equipment for Soldiers to automatically identify indi... (Photo Credit: U.S. Army) VIEW ORIGINAL

ADELPHI, Md. -- For many, normal facial recognition -- used in the daylight -- has become a facet of everyday life. Whether it's for identity verification to unlock a smart phone, or trivial social media camera filters -- it seems the technology is everywhere.

However, at the U.S. Combat Capabilities Development Command Army Research Laboratory just outside of Washington, D.C., scientists are on the forefront of bringing facial recognition technology into the future, capable of identifying figures in the dark, as experimental tests kick off.

The cutting-edge technology uses artificial intelligence, machine learning techniques, and state-of-the-art infrared cameras to identify facial patterns by using the heat signatures from living skin tissue any time of day, said Dr. Sean Hu, U.S. Army Research Laboratory Intelligent Perception Branch team lead.

Infrared light is an invisible, heat-sensitive energy that can be felt when warmth is emitted from objects.

At ARL, the Army's corporate research laboratory, Hu -- and a team of scientists who work collaboratively with industry and academia as well as other DOD organizations -- have developed the initial algorithm to tie data into integrated software and hardware platforms that will eventually get into the hands of Soldiers.

The new technology, although nearly five years in the making, uses thermal imaging to detect the electromagnetic waves needed to distinguish heat signatures. Then, artificial intelligence is applied to the blurry thermal images to increase the quality of the image to render a photo-realistic composite and map key features of the face. AI is then used to compare the image with an existing data bank of mug shots.

By fusing night vision with facial recognition, Hu said, troops in low lighting or even pitch-black environments at standoff distances of a few hundred meters can automatically pinpoint potential persons of interest -- heavy cosmetics use, off-angle poses, amount of light, etc.

"The technology provides a way for humans to visually compare visible and thermal facial imagery through thermal-to-visible face synthesis," Hu said.

Once an infrared image is taken, the thermal technology will automatically cross-reference it against existing biometric face gallery databases and watch lists containing visible face imagery, he said, adding this will help Soldiers make quicker, safer and more intelligent decisions on the battlefield.

Right now, the algorithm used to couple the thermal imagery to the image databases are roughly 90% accurate on a controlled test dataset, Hu said, but further research into the applications will improve those numbers.

Facial recognition technology and thermal imagery are nothing new for the Army, but combining them is revolutionary.

Infrared is commonly found on Soldiers' body-worn cameras, and in aerial and ground vehicles, Hu said. Conventional facial recognition software -- typically in well-lit conditions using normal cameras -- is used on the battlefield.

"Under nighttime and low-light conditions, there isn't enough light to capture facial imagery without using artificial lighting, such as a flash or spotlight, without compromising a Soldier's safety or giving up their location to potential enemies," he said.

Force protection and surveillance applications motivate this research, he said, "We're trying to help Soldiers identify individuals of interest to aid both tactical and strategic operations."

As for now, ARL and its partners plan to continue maturing the algorithms and developing prototypes for experimental and then field testing in operationally relevant environments within the next two years.

Related Links:

Army to field new night vision goggles

Army.mil: CCDC Army Research Laboratory

Army News Service

1st Infantry Division first to field new night vision equipment

Soldiers test new IVAS technology, capabilities with hand-on exercises

Related Links:

Army to field new night vision goggles

Army.mil: CCDC Army Research Laboratory

Army News Service

1st Infantry Division first to field new night vision equipment

Soldiers test new IVAS technology, capabilities with hand-on exercises

ARNEWS Archive

STAND-TO! 2019 Army Modernization Strategy

Follow Thomas Brading on Twitter