Programmed method: developing a toolset for capturing and analyzing tweets

TLDR

The authors argue that the data and methods used in computational systems have epistemological repercussions for research and that the tool’s design is motivated by a desire to keep computational work open to diverse epistemic sensibilities. The paper introduces the Digital Methods Initiative Twitter Capture and Analysis Toolset and aims to situate its development within methodological debates in the social sciences and humanities, opening a critical discussion on how tool design affects knowledge production. The authors review existing Twitter data capture methods, then introduce an open‑source, flexible toolset that embraces methodological diversity and epistemological plurality, inspired by interdisciplinary scholarly exchanges. The study concludes that design choices and methodological reasoning should align, yielding a tool that offers robust, reproducible data capture, analytical transparency, and supports diverse sampling and analytical paradigms across micro, meso, and macro levels.

Abstract

Purpose – The purpose of this paper is to introduce Digital Methods Initiative Twitter Capture and Analysis Toolset, a toolset for capturing and analyzing Twitter data. Instead of just presenting a technical paper detailing the system, however, the authors argue that the type of data used for, as well as the methods encoded in, computational systems have epistemological repercussions for research. The authors thus aim at situating the development of the toolset in relation to methodological debates in the social sciences and humanities. Design/methodology/approach – The authors review the possibilities and limitations of existing approaches to capture and analyze Twitter data in order to address the various ways in which computational systems frame research. The authors then introduce the open-source toolset and put forward an approach that embraces methodological diversity and epistemological plurality. Findings – The authors find that design decisions and more general methodological reasoning can and should go hand in hand when building tools for computational social science or digital humanities. Practical implications – Besides methodological transparency, the software provides robust and reproducible data capture and analysis, and interlinks with existing analytical software. Epistemic plurality is emphasized by taking into account how Twitter structures information, by allowing for a number of different sampling techniques, by enabling a variety of analytical approaches or paradigms, and by facilitating work at the micro, meso, and macro levels. Originality/value – The paper opens up critical debate by connecting tool design to fundamental interrogations of methodology and its repercussions for the production of knowledge. The design of the software is inspired by exchanges and debates with scholars from a variety of disciplines and the attempt to propose a flexible and extensible tool that accommodates a wide array of methodological approaches is directly motivated by the desire to keep computational work open for various epistemic sensibilities.