Text Analytics

Many interpretations in the humanities rest on close reading of selected passages and have never been tested against whole corpora. Text analytics offers a way to test them. Text analytics represents a way of approaching cross-disciplinary research questions with a scientific or data-driven method. In some erotetic environments, the application of text analytics leads literally to use of the scientific method: constructing a hypothesis, testing with an experiment, analyzing the resulting data, and on to further efforts at disconfirmation. In other environments, the research process is less supervised and more exploratory, but is no less driven by data. 

Some long-held interpretations of classic texts will not survive such tests, and others will be strengthened. For example, many sinologists hold that the Early Chinese mind is 'holistic' and not 'dualist,' dualism being a Western category inapplicable to East Asia. Ted Slingerland and Maciek Chudek used text analytics with human coders to gather data that challenge this interpretation (Cognitive Science, 2011). 

In an attempt to better understand the methods and limitations of text analytics research, my work in this area has ranged over a few different issues and languages. Justin Lynn, Ben Purzycki, and I converted some interpretations of the science fiction genre by literary scholars into testable hypotheses. We built a database of texts (controlling for year of publication, author gender, etc.) across science fiction, fantasy, and mystery, then we compiled those texts with Linguistic Inquiry and Word Count, Jamie Pennebaker's brilliant software tool. 

Kristoffer Nielbo and I, along with Carson Logan, Uffe Bergeton, and Ted Slingerland, applied several resources toward answering research questions about a large database of historical Chinese texts. These questions include: Does the representation of the self in millions of characters across historical Chinese literature have markers that indicate affinities with results found in contemporary cross-cultural psychology showing that East Asian selves are more integrated with immediate family and communities than are other selves? Does historical China have the sort of supernatural agencies that the work of Ara Norenzayan and Azim Shariff would recognize as the high gods of cognitive science of religion, namely gods concerned with human morality, who have the power to punish, and who are able to monitor human behavior? We pursued these questions using topic modeling methods to identify and track through time latent associations between target characters. We have also developed another method that draws from corpus linguistics, which we call association modeling. Association modeling allowed us to calculate and compare pinpoint associations between not only target terms but also specific uses of target terms.