Email this Article Email   

CHIPS Articles: NPS Team Turns to Machine Learning to Predict Social Unrest

NPS Team Turns to Machine Learning to Predict Social Unrest
By Story by Matthew Schehl, Naval Postgraduate School - January 18, 2019
The balloon of cyber warfare has gone up, and the Naval Postgraduate School (NPS) remains at the forefront of developing vital technologies to win the fight in this very gray domain.

The Defense Intelligence Innovation Office (DI2O) recently awarded NPS’ Coalition for Open-Source Defense Analysis (CODA) lab a nine-month, $500,000 grant to proceed with development of a creative way to rapidly detect hostile information campaigns and emerging radicalization or violence anywhere in the world.

The CODA project – “Artificial Neural Networks for Automated Detection of Hostile Information Campaigns” (ANN-ADHIC) – employs machine learning to glean data from literally billions of online social media and mass media sources from more than 200 countries and 100 languages. Detecting even the subtlest changes in linguistic patterns, the platform can predict and map out new threats in real-time, explained T. Camber Warren, the NPS Defense Analysis (DA) assistant professor who co-founded the project.

“What if we train a neural network to learn what kinds of discourse are associated with radicalization and violence?” asked Warren. “Then, even in a corner of a country that we didn’t know we were supposed to be concerned about, if the discourse shifts – becomes more radicalized, more fearful, or more angry – this neural network could send up a red flag and tell us there’s something happening there.”

The potential applications for this technology are wide-ranging, from global strategic monitoring of hostile activity to vastly improved situational awareness of the human terrain at a tactical level.

The world is engaged in a new era of hybrid conflict, and ANN-ADHIC offers the U.S. military a competitive advantage as opponents increasingly weaponize social media to disrupt discourse and galvanize entire populations towards hostility.

The gravity of such disinformation campaigns hit home beyond Russia’s dedicated effort to sway public opinion during the 2016 presidential election. It has been seen time and time again over the last decade: savvy media campaigns by the Islamic State, Boko Haram’s radicalization efforts in Nigeria, and China’s influence campaigns throughout the world.

“States are the principal actors on the global stage, but non-state actors also threaten the security environment with increasingly sophisticated capabilities,” warns the 2018 National Defense Strategy, which explicitly identifies cyberspace as a warfighting domain. “Terrorists, trans-national criminal organizations, cyber hackers and other malicious non-state actors have transformed global affairs with increased capabilities of mass disruption.”

Providing operationally-relevant solutions to lean into such challenges is what NPS does best.

In 2014, Information Sciences lecturer Buddy Barreto was chatting in the hallway with a colleague about new ways to use their servers to provide “big data” support to the DA department, when Warren’s research interests came up.

“He said, ‘Hey, you need to go talk to this guy Camber [Warren] because he’s doing some pretty cool stuff and he’s got some data and he doesn’t have any place to put it’,” Barreto recalled. “I did, and the next thing you know we’ve got a new RAM box on this.

“That’s how all relationships start at NPS!” he laughed.

Barreto and Warren immediately set to work on the project which would eventually evolve into ANN-ADHIC. The CODA lab grew from a single server to well over 70 machines of various architectures to handle the copious quantity of data streaming in.

“We realized that we actually had a lot of shared interests and ideas that first day,” Warren said. “We started to realize it wasn’t just about putting some Twitter data on a server; there was potentially so much more that we could do.”

Warren and Barreto fine-tuned this capability over the next four years, analyzing massive incoming data streams through software they developed to sense changing patterns through advanced machine learning architectures – the ‘artificial neural networks’ of ANN-ADHIC.

The data is all open source large media feeds, ranging from Twitter to fan pages on Facebook, online news, and blog sites, meaning it is publicly available and “scrapeable” for key information such as geolocation. ANN-ADHIC observes this data to create a dynamic analysis of changes over time in how people talk with each other, including the subtle differences in new kinds of slang and shifts in discourse.

“For example, it can learn that this letter often follows this letter, this word follows this word, the people in a given town are more likely to use the word for ‘fear’ than the people in that town, who are more likely to use the word for ‘hope,’” Warren explained. “We can now train machine learning models to sense what kinds of patterns are associated with violence and forms of political radicalization.”

The sheer volume of data is sourced from virtually every corner of the globe. The profusion of social media has extended even to rural areas in Africa and Asia once assumed to lay beyond the analytic gaze.

“Even if they’re not high-tech smartphones, almost any cell phone can send messages, which means you can tweet,” Warren said. “You have cell phone towers and smartphones even in low developed areas like Yemen, Iraq, and Nigeria, where there’s enough information coming out to get a [statistically viable] sense of the population.”

For a test case, Warren and Barreto applied ANN-ADHIC to successive radicalization campaigns by Boko Haram in northeastern Nigeria targeting the ethnic minority Hausa population. Using initial efforts by the jihadist militant organization as a baseline, the team was able to accurately predict social unrest and violence as the campaign unfolded.

“We were able to show that in social media you could see increasing references to these in-group and out-group names as a result of the polarization that was occurring through this radicalization, and we could map that out over space and time to predict where we’re going to subsequently see violence,” Warren recounted. “These political campaigns necessarily precede the kinetic campaigns: you have to get people ginned up in certain ways to get them fighting the way you want.”

With analytical success looking at Boko Haram, Warren and Barreto aim to generalize this capability to a global reach. What makes ANN-ADHIC so advanced is that it uses artificial neural networks to figure out what statistical correlations to look for in changing linguistic patterns.

That potentially becomes a game-changing way of approaching indications and warnings for all kinds of irregular warfare.

“We want it to be able to tell us, ‘Hey, there’s something weird happening over in this corner of the country; all of a sudden, discourse has shifted,’” Barreto said. “It could be a new group that we have no previous knowledge of that is revealed by the noise.”

Additionally, ANN-ADHIC offers a valuable second-order effect: it can provide metrics to validate the effectiveness of our own information operations. In Afghanistan, for example, much blood and treasure have been poured into providing positive messaging to promote Afghan loyalty and unity.

“Are they working? Are they not? Are they actually turning people against us or towards us? We don’t know,” Warren said. “But with these sorts of tools, we’re aiming to build some of the first systematic measures of effectiveness for these information operations.”

The DI2O funding will enable the CODA lab to move forward from a notional, tested concept to a specific tool put in the hands of operators in the field for testing.

“We’re building fundamentally new science,” Warren said. “We’ve developed new approaches to these computer learning problems which are able to solve these problems better, and once we’ve scientifically demonstrated this in a verifiable way that works, the next round will be to build this up to the next level where we can be producing these things in a way that they can actually be put in the hands of the force en masse.”

Only at NPS would something like this be possible, he continued.

“The school provides a unique combination of cutting-edge scientific expertise and real-world practitioner knowledge, folks coming back from the field who’ve experienced these problems first-hand,” Warren said. “NPS is one of the only places where you can bring those two communities together and build things that are not only cutting-edge data science but operationally relevant.”

NPS Defense Analysis assistant professor Camber Warren, left, and Information Sciences lecturer Buddy Barreto, right, have been awarded a grant by the Defense Intelligence Innovation Office (DI2O) to advance their Artificial Neural Networks for Automated Detection of Hostile Information Campaigns project, an effort made possible by the university’s Coalition for Open-Source Defense Analysis lab.
NPS Defense Analysis assistant professor Camber Warren, left, and Information Sciences lecturer Buddy Barreto, right, have been awarded a grant by the Defense Intelligence Innovation Office (DI2O) to advance their Artificial Neural Networks for Automated Detection of Hostile Information Campaigns project, an effort made possible by the university’s Coalition for Open-Source Defense Analysis lab.
Related CHIPS Articles
Related DON CIO News
Related DON CIO Policy

CHIPS is an official U.S. Navy website sponsored by the Department of the Navy (DON) Chief Information Officer, the Department of Defense Enterprise Software Initiative (ESI) and the DON's ESI Software Product Manager Team at Space and Naval Warfare Systems Center Pacific.

Online ISSN 2154-1779; Print ISSN 1047-9988
Hyperlink Disclaimer