Quotation Hall, Margeret, Logan, Michael, Ligon, Gina, Derrick, Doug. 2019. Do Machines Replicate Humans? Toward a Unified Understanding of Radicalizing Content on the Open Social Web. Policy & Internet. 12 109-138.




The advent of the Internet inadvertently augmented the functioning and success of violent extremist organizations. Terrorist organizations like the Islamic State in Iraq and Syria (ISIS) use the Internet to project their message to a global audience. The majority of research and practice on web-based terrorist propaganda uses human coders to classify content, raising serious concerns such as burnout, mental stress, and reliability of the coded data. More recently, technology platforms and researchers have started to examine the online content using automated classification procedures. However, there are questions about the robustness of automated procedures, given insufficient research comparing and contextualizing the difference between human and machine coding. This article compares output of three text analytics packages with that of human coders on a sample of one hundred nonindexed web pages associated with ISIS. We find that prevalent topics (e.g., holy war) are accurately detected by the three packages whereas nuanced concepts (Lone Wolf attacks) are generally missed. Our findings suggest that naïve approaches of standard applications do not approximate human understanding, and therefore consumption, of radicalizing content. Before radicalizing content can be automatically detected, we need a closer approximation to human understanding.


Press 'enter' for creating the tag

Publication's profile

Status of publication Published
Affiliation WU
Type of publication Journal article
Journal Policy & Internet
Citation Index SSCI
Language English
Title Do Machines Replicate Humans? Toward a Unified Understanding of Radicalizing Content on the Open Social Web
Volume 12
Year 2019
Page from 109
Page to 138
URL https://api.wiley.com/onlinelibrary/tdm/v1/articles/10.1002%2Fpoi3.223
DOI http://dx.doi.org/10.1002/poi3.223
Open Access N


Hall, Margeret (Details)
Derrick, Doug (University of Nebraska at Omaha, United States/USA)
Ligon, Gina (University of Nebraska at Omaha, United States/USA)
Logan, Michael (University of Nebraska at Omaha, United States/USA)
Institute for Cognition & Behavior IN (Details)
Research areas (ÖSTAT Classification 'Statistik Austria')
1127 Information science (Details)
Google Scholar: Search