New method accelerates AI decision-making

By U.S. Army DEVCOM Army Research Laboratory Public AffairsSeptember 2, 2021

A new solution compresses and offloads critical data from battlefield machines more efficiently, enabling faster AI processing and decision-making on the battlefield.
A new solution compresses and offloads critical data from battlefield machines more efficiently, enabling faster AI processing and decision-making on the battlefield. (Photo Credit: U.S. Army / Shutterstock) VIEW ORIGINAL

ADELPHI, Md. — A new solution compresses and offloads critical data from battlefield machines more efficiently, enabling faster AI processing and decision-making on the battlefield.

Researchers from the U.S. Army Combat Capabilities Development Command, known as DEVCOM, Army Research Laboratory and university partners from the Internet of Battlefield Things Collaborative Research Alliance, or IoBT CRA, developed a new solution to provide battlefield applications with pressing machine intelligence, even when the local environment is not able to facilitate AI processing.

This new solution offloads data from the battlefield to remote processing engines by enabling a much higher degree of compression of the data than previously possible, researchers said.

“The computational requirements of AI in the battlefield are burdensome for many low-capacity devices,” said Dr. Tarek Abdelzaher, a professor at the University of Illinois Urbana-Champaign and the academic lead of the lab’s IoBT CRA. “Offloading data from the field to a more computationally capable machine is a potential solution to facilitate more efficient processing.”
Using the original_frame.png, the encoder/decoder from the Deep Compressive Offloading approach was used to process the image and reconstruct it to produce a compressed version of the image. Notice that some information is not captured in the compressed image, e.g., the orange cone in the original frame does not appear to have the orange color in the compressed frame. The point though is that the information needed to maintain detection performance is preserved and other information is thrown out to reduce the image size. The compressed/reconstructed image is 48.5kB compared to the 2.5MB for the original, which is only 2% of the original size.
Using the original_frame.png, the encoder/decoder from the Deep Compressive Offloading approach was used to process the image and reconstruct it to produce a compressed version of the image. Notice that some information is not captured in the compressed image, e.g., the orange cone in the original frame does not appear to have the orange color in the compressed frame. The point though is that the information needed to maintain detection performance is preserved and other information is thrown out to reduce the image size. The compressed/reconstructed image is 48.5kB compared to the 2.5MB for the original, which is only 2% of the original size. (Photo Credit: U.S. Army) VIEW ORIGINAL
Using the reconstructed image (reconstructed_frame_using_deep-compressive-offloading.jpg) we can run a YOLOv5 model (that is uncompressed) to get detection results. This image shows that the model (trained on uncompressed images) is still able to detect the vehicles and people in the image even though is a significantly compressed version of the image.
Using the reconstructed image (reconstructed_frame_using_deep-compressive-offloading.jpg) we can run a YOLOv5 model (that is uncompressed) to get detection results. This image shows that the model (trained on uncompressed images) is still able to detect the vehicles and people in the image even though is a significantly compressed version of the image. (Photo Credit: U.S. Army) VIEW ORIGINAL
Using the reconstructed image (reconstructed_frame_using_deep-compressive-offloading.jpg) we can run a compressed YOLOv5 model (after running the DeepIoT compression algorithm) to get detection results. The image shows that nearly all of the vehicles and people are detected using the compressed model - it misses the partially occluded vehicle on the right.
Using the reconstructed image (reconstructed_frame_using_deep-compressive-offloading.jpg) we can run a compressed YOLOv5 model (after running the DeepIoT compression algorithm) to get detection results. The image shows that nearly all of the vehicles and people are detected using the compressed model - it misses the partially occluded vehicle on the right. (Photo Credit: U.S. Army) VIEW ORIGINAL
What does this all mean? Researchers can compress the imagery and still get good results with a normal detection model. They can compress the imagery and the model and still get good results.
What does this all mean? Researchers can compress the imagery and still get good results with a normal detection model. They can compress the imagery and the model and still get good results. (Photo Credit: U.S. Army) VIEW ORIGINAL

Transferring data between field devices like Army-relevant sensors, such as cameras, LiDARs, radars, IR sensors and a remote server can take significant amounts of time, Abdelzaher said. Compressing the data puts less burden on the battlefield system, allowing it to send the data to the processing machine elsewhere more efficiently — even across low-bandwidth, contested links.

This improved processing speed significantly reduces the delay between initial sensing and subsequent decision-making, enabling commanders to immediately act on data in an intelligent manner.

Researchers recently tested the compression solution by offloading an image from one device at the lab’s Multi-Purpose Sensing Area at White Sands Missile Range and an IoBT CRA server in Massachusetts. Testing of this solution showed that compression was four times more effective than an image’s compression capability, which is the current image compression standard, researchers said.

Researchers achieved this ultra-high compression capability by considering future use needs; only those data features that the AI will need to use later for accurate processing are preserved during compression. This enables the machine to achieve a much higher compression ratio than existing compression techniques that do not consider future use — all without a significant loss of accuracy.

“For example, in an application where the goal is to recognize different types of vehicles in an image, what cues are used by the AI to distinguish the different types of vehicles?” Abdelzaher asked. “Those cues should be preserved by compression when data is sent from the field. Other irrelevant information can be compressed away to improve compression abilities.”

This solution can revolutionize AI for Army applications and increase autonomy in mission execution by bringing AI virtually to the point of need in the field through faster offloading and remote processing.

“In a world where autonomy and machine intelligence play increasingly bigger roles in future conflicts, efficient solutions for moving complex sensor data to the right processing engines will become critical,” said Dr. Maggie Wigness, Army researcher and deputy collaborative alliance manager of the IoBT CRA. “Compressive offloading, and other sensing and processing research being conducted in the IoBT CRA, are essential to the Army in effectively preparing for the future battlefield.”

The researchers published their work, Deep Compressive Offloading: Speeding Up Neural Network Inference by Trading Edge Computation for Network Latency, in Sensys 2020, the top research publication venue in networked sensing, and they received a best paper award.

Visit the laboratory's Media Center to discover more Army science and technology stories

(Photo Credit: U.S. Army) VIEW ORIGINAL

As the Army’s foundational research laboratory, ARL is operationalizing science to achieve transformational overmatch. Through collaboration across the command’s core technical competencies, DEVCOM leads in the discovery, development and delivery of the technology-based capabilities required to make Soldiers more successful at winning the nation’s wars and come home safely. DEVCOM Army Research Laboratory is an element of the U.S. Army Combat Capabilities Development Command. DEVCOM is a major subordinate command of the Army Futures Command.

(Photo Credit: U.S. Army) VIEW ORIGINAL