The paper presents my first findings and reflections on how ordinary people may opportunistically and unpredictably respond to Internet censorship and tracking. I try to capture this process with the concept of ‘hacking multitude'. Working on a case study of the Turkish government's block of the social media platform Twitter, I argue that during systemic data choke-points, a multitude of users might acquire a certain degree of reflexivity over ubiquitous software of advanced techno-capitalism. Resisting naïve parallels between urban streets and (...) virtual global streets, the article draws on Fuller's ‘media ecologies' to make sense of complex and dynamic interactions between processes and materialities, strategies of communication and mundane practices. Such a dense space is mostly invisible to network and traffic analysis, although it comes alive under the magnifying lens of digital ethnography. As the Turkish government tried to stop protesters on both the urban and the Twitter spheres, alternative material configurations and new hybrid formations and practices emerged. I try to bring this process alive following the traces – that is, a combination of digital data and materialities – of a social space between the protest for Twitter access, the ‘digital coup' and the interactions that this situation determined. In the final section, I briefly explore two research trajectories which can further develop my initial formulation of a ‘hacking multitude'. I argue that a generalisation of hacking/multitude is problematic for the political, cultural or economic processes more directly associated with Big Data. (shrink)

In 2009, with the enactment of the Lisbon Treaty, the Charter of Fundamental Rights of the European Union entered into force. Under Article 8 of the Charter, for the first time, a stand-alone fundamental right to data protection was declared. The creation of this right, standing as a distinct right to the right to privacy, is undoubtedly significant, and it is unique to the European legal order, being absent from other international human rights instruments. This commentary examines the parameters of (...) this new right to data protection, asking what are the principles underpinning the right. It argues that the right reflects some key values inherent in the European legal order, namely: privacy, transparency, autonomy and nondiscrimination. It also analyses some of the challenges in implementing this right in an era of ubiquitous veillance practices and Big Data. (shrink)

Debates about terrorism and technology often focus on the potential uses of technology by non-state terrorist actors and by states as forms of counterterrorism. Yet, little has been written about how technology shapes how we think about terrorism. In this chapter I argue that technology, and the language we use to talk about technology, constrains and shapes our understanding of the nature, scope, and impact of terrorism, particularly in relation to state terrorism. After exploring the ways in which technology shapes (...) moral thinking, I use two case studies to demonstrate how technology simultaneously hides and enables terroristic forms of state violence: police control technologies and Unmanned Aerial Vehicles (UAVs), or drones. In both these cases, I argue that features of these technologies, combined with a narrative of precision and efficiency, serves to mask the terroristic nature of the violence that these practices inflict and reinforces the moral exclusion of those against whom these technologies are deployed. In conclusion, I propose that identifying acts of terrorism requires a focus on the impact of technologies of violence (whether they are “high tech” or not) on those most affected, regardless of whether users of these technologies conceive of their actions as terroristic. (shrink)

In this article, we critically scrutinize the principle of proportionality when used in the context of security and government surveillance. We argue that McMahan’s distinction from just warfare between narrow proportionality and wide proportionality can generally apply to the context of surveillance. We argue that narrow proportionality applies more or less directly to cases in which the surveilled is liable and that the wide proportionality principle applies to cases characterized by ‘collateral intrusion’. We argue, however, that a more demanding criterion (...) than the lesser-evil justification that wide proportionality frequently entails is necessary in cases characterized by intentional intrusion upon non-liable individuals. The distinction between foreseeing and intending intrusion into the lives of individuals who are not liable has not previously been specifically addressed in discussions concerning surveillance ethics. This specification is thus increasingly important due to the general growing tendency for adherence to the precautionary principle and policies aimed at anticipating criminal acts before they are committed. Preventive surveillance of non-liable actors is considered an important instrument for obtaining this aim and thus calls for moral scrutiny in terms of permissibility and proportionality. We suggest the concept ‘wide proportionality +’ which applies to cases of intentional intrusion of non-liable individuals. (shrink)

Goffman’s (1959) dramaturgical identity theory requires modification when theorising about presentations of self on social media. This chapter contributes to these efforts, refining a conception of digital identities by differentiating them from ‘corporatised identities’. Armed with this new distinction, I ultimately argue that social media platforms’ production of corporatised identities undermines their users’ autonomy and digital well-being. This follows from the disentanglement of several commonly conflated concepts. Firstly, I distinguish two kinds of presentation of self that I collectively refer to (...) as ‘expressions of digital identity’. These digital performances (boyd 2007) and digital artefacts (Hogan 2010) are distinct, but often confused. Secondly, I contend this confusion results in the subsequent conflation of corporatised identities – poor approximations of actual digital identities, inferred and extrapolated by algorithms from individuals’ expressions of digital identity – with digital identities proper. Finally, and to demonstrate the normative implications of these clarifications, I utilise MacKenzie’s (2014, 2019) interpretation of relational autonomy to propose that designing social media sites around the production of corporatised identities, at the expense of encouraging genuine performances of digital identities, has undermined multiple dimensions of this vital liberal value. In particular, the pluralistic range of authentic preferences that should structure flourishing human lives are being flattened and replaced by commercial, consumerist preferences. For these reasons, amongst others, I contend that digital identities should once again come to drive individuals’ actions on social media sites. Only upon doing so can individuals’ autonomy, and control over their digital identities, be rendered compatible with social media. (shrink)

Clicks, comments, transactions, and physical movements are being increasingly recorded and analyzed by Big Data processors who use this information to trace the sentiment and activities of markets and voters. While the benefits of Big Data have received considerable attention, it is the potential social costs of practices associated with Big Data that are of interest to us in this paper. Prior research has investigated the impact of Big Data on individual privacy rights, however, there is also growing recognition of (...) its capacity to be mobilized for surveillance purposes. Our paper delineates the underlying issues of privacy and surveillance and presents them as in tension with one another. We postulate that efforts at controlling Big Data may create a trade-off of risks rather than an overall improvement in data protection. We explore this idea in relation to the principles of the European Union’s General Data Protection Regulation as it arguably embodies the new ‘gold standard’ of cyber-laws. We posit that safeguards advocated by the law, anonymization and pseudonymization, while representing effective counter measures to privacy concerns, also incentivize the use, collection, and trade of behavioral and other forms of de-identified data. We consider the legal status of these ownerless forms of data, arguing that data protection techniques such as anonymization and pseudonymization raise significant concerns over the ownership of behavioral data and its potential use in the large-scale modification of activities and choices made both on and offline. (shrink)

In light of the recent emergence of predictive techniques in law enforcement to forecast crimes before they occur, this paper examines the temporal operation of power exercised by predictive policing algorithms. I argue that predictive policing exercises power through a paranoid style that constitutes a form of temporal governmentality. Temporality is especially pertinent to understanding what is ethically at stake in predictive policing as it is continuous with a historical racialized practice of organizing, managing, controlling, and stealing time. After first (...) clarifying the concept of temporal governmentality, I apply this lens to Chicago Police Department’s Strategic Subject List. This predictive algorithm operates, I argue, through a paranoid logic that aims to preempt future possibilities of crime on the basis of a criminal past codified in historical crime data. (shrink)

The recently rising field of Critical Data Studies is still facing fundamental questions. Among these is the enigma of digital subjectivation. Who are the subjects of Big Data? A field where this question is particularly pressing is finance. Since the 1990s traders have been steadily integrated into computerized data assemblages, which calls for an ontology that eliminates the distinction between human sovereign subjects and non-human instrumental objects. The latter subjectivize traders in pre-conscious ways, because human consciousness runs too slow to (...) follow the volatility of the market. In response to this conundrum Social Studies of Finance has drawn on Actor-Network Theory to interpret financial markets as technically constructed networks of human and non-human actors. I argue that in order to develop an explicitly critical data study it might be advantageous to refer to Maurizio Lazzarato’s theory of machinic subjugation instead. Although both accounts describe financial digital subjectivation similarly, Lazzarato has the advantage of coupling his description to a clear critique of and resistance to finance. (shrink)

People's sense of being subject to digital dataveillance can cause them to restrict their digital communication behavior. Such a chilling effect is essentially a form of self-censorship in everyday digital media use with the attendant risks of undermining individual autonomy and well-being. This article combines the existing theoretical and limited empirical work on surveillance and chilling effects across fields with an analysis of novel data toward a research agenda. The institutional practice of dataveillance—the automated, continuous, and unspecific collection, retention, and (...) analysis of digital traces—affects individual behavior. A mechanism-based causal model based on the theory of planned behavior is proposed for the micro level: An individual's increased sense of dataveillance causes their subjective probability assigned to negative outcomes of digital communication behavior to increase and attitudes toward this communication to become less favorable, ultimately decreasing the intention to engage in it. In aggregate and triggered through successive salience shocks such as data scandals, dataveillance is accordingly hypothesized to lower the baseline of free digital communication in a society through the chilling effects mechanism. From the developed theoretical model, a set of methodological consequences and questions for future studies are derived. (shrink)

Recent disclosures suggest that many governments apply indiscriminate mass surveillance technologies that allow them to capture and store a massive amount of communications data belonging to citizens and non-citizens alike. This article argues that traditional liberal critiques of government surveillance that center on an individual right to privacy cannot completely capture the harm that is caused by such surveillance because they ignore its distinctive political dimension. As a complement to standard liberal approaches to privacy, the article develops a critique of (...) surveillance that focuses on the question of political power in the public sphere. (shrink)

Human activities are being increasingly regulated by means of technologies. Smart borders regulating human movement are no exception. I argue that the process of digitization – including through AI, Big Data and algorithmic processing – falls short of respecting (fundamental) rights to the extent to which it ignores what I term to be the problem of indeterminacy. While adopting a data feminist approach in this paper, assuming that data is the ‘new oil’, that is power, I begin theorizing indeterminacy from (...) the imminent risks of datafication as a new instrument of oppression perpetuating injustice and widening inequality gaps. I conclude that technologies regulating human activities must stand ethical scrutiny, especially if they can and do result in (human) rights violations. Unlike the oil being extracted from the ground, data is de facto extracted from people endowed with agency, autonomy, rights and contexts – all which ought to be respected and protected. (shrink)

A recent interpretation of artificial intelligence (AI) (Floridi 2013, 2022) suggests that the implementation of AI demands the investigation of the binding conditions that make it possible to build and integrate artifacts into our lived world. Such artifacts can successfully interact with the world because our environment has been designed to be compatible with intelligent machines (such as robots). As the use of AI becomes ubiquitous in society, possibly leading to the formation of increasingly intelligent bio-technological unions, there will likely (...) be a coexistence of a plethora of micro-environments wrapped and tailored around humans and basic robots. The key element of this pervasive process will be the capacity to integrate biological realms in an infosphere suitable for the implementation of AI technologies. This process will require extensive datafication. This is because data is the basis of the logical-mathematical codes and models that drive and guide AI. This process will have huge consequences on workplaces, on workers, as well as on the decision-making processes required for the functioning of future societies. In this paper we will offer a comprehensive reflection on the moral and social implications of datafication as well as a set of considerations about its desirability, which will be informed by the following insights: (1) full protection of privacy may become structurally impossible, thus leading to undesirable forms of political and social control; (2) worker’s freedom may be reduced; (3) human creativity, imagination, and even divergence from AI logic might be channeled and possibly discouraged; (4) there will likely be a push towards efficiency and instrumental reason, which will become preeminent in production lines as well as in society. (shrink)

In this paper, we examine the practice and promises of digital phenotyping. We build on work on the ‘data self’ to focus on a medical domain in which the value and nature of knowledge and relations with data have been played out with particular persistence, that of Alzheimer's disease research. Drawing on research with researchers and developers, we consider the intersection of hopes and concerns related to both digital tools and Alzheimer's disease using the metaphor of the ‘data shadow’. We (...) suggest that as a tool for engaging with the nature of the data self, the shadow is usefully able to capture both the dynamic and distorted nature of data representations, and the unease and concern associated with encounters between individuals or groups and data about them. We then consider what the data shadow ‘is’ in relation to ageing data subjects, and the nature of the representation of the individual's cognitive state and dementia risk that is produced by digital tools. Second, we consider what the data shadow ‘does’, through researchers and practitioners’ discussions of digital phenotyping practices in the dementia field as alternately empowering, enabling and threatening. (shrink)

Works on whistleblowing are overwhelmingly found within disciplines such as business ethics, law, and the professions. Despite its undeniable political and social effects, it is surprisingly understudied in political science and sociology. Recent cases such as those of Chelsea Manning, Edward Snowden, Christopher Wylie, and the Panama Papers should prompt political scientists and sociologists to engage systematically with the phenomenon. This article offers a theoretically driven discussion of three complementary questions. What kind of political action is whistleblowing? What are its (...) historical, social, and political roots? How is the practice shaped by digitalization and big data? In relation to the third question, the article argues that digitalization amplifies social complexity and challenges democratic steering. Building on Niklas Luhmann, Ulrich Beck, and Jeffrey Alexander, it lends theoretical weight to the argument that whistleblowers are likely to play an increasingly pronounced political role as digitalization accelerates. (shrink)

Many actors mobilize the cognitive, legal and technical tool-box of data protection when they discuss and address controversial issues such as digital mass surveillance. Yet, critical approaches to the digital only barely explore the politics of data protection in relation to data-driven governance. Building on governmentality studies and Actor-Network-Theory, this article analyses the potential and limits of using data protection to critique the ‘digital age’. Using the conceptual tool of dispositifs, it sketches an analytics of data protection and the emergence (...) of its configuration as ‘data protection by design and by default’. This exploration reminds us that governing through data implies, first and foremost, governing digital data. (shrink)

From ‘connecting the dots’ and finding ‘the needle in the haystack’ to predictive policing and data mining for counterinsurgency, security professionals have increasingly adopted the language and methods of computing for the purposes of prediction. Digital devices and big data appear to offer answers to a wide array of problems of (in)security by promising insights into unknown futures. This article investigates the transformation of prediction today by placing it within governmental apparatuses of discipline, biopower and big data. Unlike disciplinary and (...) biopolitical governmentality, we argue that prediction with big data is underpinned by the production of a different time/space of ‘between-ness’. The digital mode of prediction with big data reconfigures how we are governed today, which we illustrate through an analysis of how predictive policing actualizes between-ness as hotspots and near-real-time decisions. (shrink)

This article draws on the sociology of expectations to examine the construction of expectations of ‘ethical AI’ and considers the implications of these expectations for communication governance. We first analyse a range of public documents to identify the key actors, mechanisms and issues which structure societal expectations around artificial intelligence and an emerging discourse on ethics. We then explore expectations of AI and ethics through a survey of members of the public. Finally, we discuss the implications of our findings for (...) the role of AI in communication governance. We find that, despite societal expectations that we can design ethical AI, and public expectations that developers and governments should share responsibility for the outcomes of AI use, there is a significant divergence between these expectations and the ways in which AI technologies are currently used and governed in large scale communication systems. We conclude that discourses of ‘ethical AI’ are generically performative, but to become more effective we need to acknowledge the limitations of contemporary AI and the requirement for extensive human labour to meet the challenges of communication governance. An effective ethics of AI requires domain appropriate AI tools, updated professional practices, dignified places of work and robust regulatory and accountability frameworks. (shrink)

The Snowden leaks, first published in June 2013, provided unprecedented insights into the operations of state-corporate surveillance, highlighting the extent to which everyday communication is integrated into an extensive regime of control that relies on the ‘datafication’ of social life. Whilst such data-driven forms of governance have significant implications for citizenship and society, resistance to surveillance in the wake of the Snowden leaks has predominantly centred on techno-legal responses relating to the development and use of encryption and policy advocacy around (...) privacy and data protection. Based on in-depth interviews with a range of social justice activists, we argue that there is a significant level of ambiguity around this kind of anti-surveillance resistance in relation to broader activist practices, and critical responses to the Snowden leaks have been confined within particular expert communities. Introducing the notion of ‘data justice’, we therefore go on to make the case that resistance to surveillance needs to be conceptualized on terms that can address the implications of this data-driven form of governance in relation to broader social justice agendas. Such an approach is needed, we suggest, in light of a shift to surveillance capitalism in which the collection, use and analysis of our data increasingly comes to shape the opportunities and possibilities available to us and the kind of society we live in. (shrink)

This introduction to the special issue on data and agency argues that datafication should not only be understood as the process of collecting and analysing data about Internet users, but also as feeding such data back to users, enabling them to orient themselves in the world. It is important that debates about data power recognise that data is also generated, collected and analysed by alternative actors, enhancing rather than undermining the agency of the public. Developing this argument, we first make (...) clear why and how the question of agency should be central to our engagement with data. Subsequently, we discuss how this question has been operationalized in the five contributions to this special issue, which empirically open up the study of alternative forms of datafication. Building on these contributions, we conclude that as data acquire new power, it is vital to explore the space for citizen agency in relation to data structures and to examine the practices of data work, as well as the people involved in these practices. (shrink)

This commentary proceeds as follows. First, it is argued from both ethical and legal perspectives through an analysis of Court precedents that Etzioni’s has improperly developed a too narrow First Amendment interpretation and conclusion that Apple should comply with the FBI’s demand to provide the FBI with a key to open iPhones. That is, broad First Amendment considerations and not solely narrow First Amendment “compelled speech” or only Fourth Amendment privacy issues are offered and analyzed from both ethical and legal (...) perspectives. A key point here is that broad First Amendment considerations protect, with exceptions, political and ethical discretion space for “Press” organizations to exercise, or not, ethical responsibilities, including rights to publish or not publish information and opinions, rather than compliance with government orders to publish or not publish. Further, Court cases are discussed from both legal and ethical perspectives where the Courts have established that social media organizations such as Facebook and Twitter do and should have broad First Amendment protection of free expression and peaceful assembly as traditional media such as newspapers have. It is suggested that Apple can and should be considered a social media organization. In addition, special First Amendment protection and limitations concerning national security are analyzed. Second, it is suggested that Etzioni’s point that Apple protected its clients soley for “business profitability” reasons is also a too narrow interpretation since there are more complex, mixed, and combined ethical and political-economic reasons for protecting clients and First Amendment protections. Third, the philosopher Paul Ricoeur’s ethics process responsibility framework concerning relationships between ethics and law and the need for an ethics responsibility rather than a compliance approach, which is similar to Brandeis’ legal ethics approach, is compared with and offered as an alternative to Etzioni’s compliance based “Liberal communitarian” approach. It is suggested that the difference between the Rocoeur and Etzioni approaches is similar to the difference between compliance and ethics responsibility process programs in organizations. (shrink)

In this article, we explore smart deterrents and their historical precedents marketed to women and girls for the purpose of preventing harassment, sexual abuse and violence. Rape deterrents, as we define them, encompass customs, architectures, fashions, surveillant infrastructures, apps and devices conceived to manage and protect the body. Online searches reveal an array of technologies, and we engage with their prevention narratives and cultural construction discourses of the gendered body. Our critical analysis places recent rape deterrents in conversation with earlier (...) technologies to untangle the persistent logics. These are articulated with reference to the ways that proto-digital technologies have been imported into the realm of ubiquitous computing and networks. Our conceptual framework offers novel pathways for discussing feminine bodies and their messy navigation of everyday life that include both threats to corporeal safety and collective imaginings of empowerment. (shrink)

The article examines the construction of “Big Data” in media discourse. Rather than asking what Big Data really is or is not, it deals with the discursive work that goes into making Big Data a socially relevant phenomenon and problem in the first place. It starts from the idea that in modern societies the public understanding of technology is largely driven by a media-based discourse, which is a key arena for circulating collectively shared meanings. This largely ignored dimension invites us (...) to appreciate what matters to journalists and the wider public when discussing the collection and use of data. To this end, our study looks at how Big Data is framed in terms of the governmental use of large datasets as a contentious area of data application. It reconstructs the perspectives surrounding the so-called “Handygate” affair in Germany based on broadcast news and social media conversations. In this incident, state authorities collected and analyzed mobile phone data through a radio cell query during events to commemorate the Dresden bombing in February 2011. We employ a qualitative discourse analysis that allows us to reconstruct the conceptualizations of Big Data as a proper instrument for criminal prosecution or an unjustified infringement of constitutional rights. (shrink)

The potential for biases being built into algorithms has been known for some time, yet literature has only recently demonstrated the ways algorithmic profiling can result in social sorting and harm marginalised groups. We contend that with increased algorithmic complexity, biases will become more sophisticated and difficult to identify, control for, or contest. Our argument has four steps: first, we show how harnessing algorithms means that data gathered at a particular place and time relating to specific persons, can be used (...) to build group models applied in different contexts to different persons. Thus, privacy and data protection rights, with their focus on individuals, do not protect from the discriminatory potential of algorithmic profiling. Second, we explore the idea that anti-discrimination regulation may be more promising, but acknowledge limitations. Third, we argue that in order to harness anti-discrimination regulation, it needs to confront emergent forms of discrimination or risk creating new invisibilities, including invisibility from existing safeguards. Finally, we outline suggestions to address emergent forms of discrimination and exclusionary invisibilities via intersectional and post-colonial analysis. (shrink)

PurposeThis paper aims to investigate algorithmic governmentality – as proposed by Antoinette Rouvroy – specifically in relation to law. It seeks to show how algorithmic profiling can be particularly attractive for those in legal practice, given restraints on time and resources. It deviates from Rouvroy in two ways. First, it argues that algorithmic governmentality does not contrast with neoliberal modes of government in that it allows indirect rule through economic calculations. Second, it argues that critique of such systems is possible, (...) especially if the creative nature of law can be harnessed effectively.Design/methodology/approachThis is a conceptual paper, with a theory-based approach, that is intended to explore relevant issues related to algorithmic governmentality as a basis for future empirical research. It builds on governmentality and socio-legal studies, as well as research on algorithmic practices and some documentary analysis of reports and public-facing marketing of relevant technologies.FindingsThis paper provides insights on how algorithmic knowledge is collected, constructed and applied in different situations. It provides examples of how algorithms are currently used and how trends are developing. It demonstrates how such uses can be informed by socio-political and economic rationalities.Research limitations/implicationsFurther empirical research is required to test the theoretical findings.Originality/valueThis paper takes up Rouvroy’s question of whether we are at the end of critique and seeks to identify where such critique can be made possible. It also highlights the importance of acknowledging the role of political rationalities in informing the activity of algorithmic assemblages. (shrink)

A self-perceived lack of training in ethical theories and related pedagogy has kept many engineering faculty members from teaching data ethics, an important aspect of engineering research that has become more salient in recent years. This paper describes the development of a module, which includes concepts, cases, policies, and best practices, to support the teaching of ethical data practice. Based on a user-oriented design approach and a moral literacy framework, the module was designed to be used in different courses and (...) co-curricular activities for students of varying levels of competence to improve their ability to identify and analyze ethical problems associated with the handling of research data. This work seeks to encourage ethical reflection on researchers’ data practice through the idea of an “ecology of data,” which highlights the co-production of data by multiple, interconnected, and heterogeneous actors. This paper also presents online and in-class evidence about the impact and limitations of the module, which is now available for interested researchers and instructors to browse and use. (shrink)

While many forms of data-driven surveillance are now a ‘fact’ of contemporary life amidst datafication, obtaining concrete knowledge of how different institutions exploit data presents an ongoing challenge, requiring the expertise and power to untangle increasingly complex and opaque technological and institutional arrangements. The how and why of potential surveillance are thus wrapped in a form of continuously produced uncertainty. How then, do affected groups and individuals determine how to counter the threats and harms of surveillance? Responding to an interdisciplinary (...) concern with agency amidst datafication, this article explores what I term ‘anticipatory data practices’ – future-oriented practices which provide a concrete anchor and a heuristic for action amidst the persistent uncertainties of life with data. This article traces how anticipatory data practices have emerged within civil society practices concerned with countering the harms of surveillance and data exploitation. The mixed-method empirical analysis of this article draws from 50 interviews with digital security educators and technology developers; participant observation at 12 civil society events between 2016 and 2019 and the textual analysis of 100 security manuals produced by NGOs and grassroots groups. (shrink)

How a social science of big data would look like? In this article, we exemplify such a social science through a number of cases. We start our discussion with the epistemic qualities of big data. We point out to the fact that contrary to the big data champions, big data is neither new nor a miracle without any error nor reliable and rigorous as assumed by its cheer leaders. Secondly, we identify three types of big data: natural big data, artificial (...) big data and human big data. We present and discuss in what ways they are similar and in what other ways they differ. The assumption of a homogenous big data in fact misleads the relevant discussions. Thirdly, we extended 3 Vs of the big data and add veracity with reference to other researchers and violability which is the current author’s proposal. We explain why the trinity of Vs is insufficient to characterize big data. Instead, a quintinity is proposed. Fourthly, we develop an economic analogy to discuss the notions of data production, data consumption, data colonialism, data activism, data revolution, etc. In this context, undertaking a Marxist approach, we explain what we mean by data fetishism. Fifthly, we reflect on the implications of growing up with big data, offering a new research area which is called as developmental psychology of big data. Finally, we sketch data resistance and the newly proposed notion of omniresistance, i.e. resisting anywhere at any occasion against the big brother watching us anywhere and everywhere. (shrink)

Cognitive technology is an umbrella term sometimes used to designate the realm of technologies that assist, augment or simulate cognitive processes or that can be used for the achievement of cognitive aims. This technological macro-domain encompasses both devices that directly interface the human brain as well as external systems that use artificial intelligence to simulate or assist (aspects of) human cognition. As they hold the promise of assisting and augmenting human cognitive capabilities both individually and collectively, cognitive technologies could produce, (...) in the next decades, a significant effect on human cultural evolution. At the same time, due to their dual-use potential, they are vulnerable to being coopted by State and non-State actors for non-benign purposes (e.g. cyberterrorism, cyberwarfare and mass surveillance) or in manners that violate democratic values and principles. Therefore, it is the responsibility of technology governance bodies to align the future of cognitive technology with democratic principles such as individual freedom, avoidance of centralized, equality of opportunity and open development. This paper provides a preliminary description of an approach to the democratization of cognitive technologies based on six normative ethical principles: avoidance of centralized control, openness, transparency, inclusiveness, user-centeredness and convergence. This approach is designed to universalize and evenly distribute the potential benefits of cognitive technology and mitigate the risk that such emerging technological trend could be coopted by State or non-State actors in ways that are inconsistent with the principles of liberal democracy or detrimental to individuals and groups. (shrink)

Focusing on the paradoxes revealed in the multibillion dollar mistake of the Universal Camouflage Pattern and the expansive ambit of a leaked National Security Agency briefing on its approach to “identity intelligence,” this article analyzes security glitches arising from the state’s application of mechanized logics to security and visibility. Presuming that a digital-looking pattern would be more deceptive than designs inspired by natural forms, in 2004, the US Army adopted a pixelated “digital” camouflage pattern, a print that rendered soldiers more, (...) rather than less, visible in the field; it acknowledged this error in 2012. Two years later, “Identity Intelligence: Image Is Everything” visualized the episteme of National Security Agency surveillance with an illustration detailing hundreds of different types of data—biometric, biographic, and contextual—that the agency believes it could exploit to identify and monitor “targets of interest.” These glitches originate in technofetishistic convictions about the nature of digital images and information, limited ways of imagining bodies and lives, and reductive understandings of complex relationships between power and perception. Together, they expose the paradoxes that arise as the state tries to extend its power over the body and the contingency of that power on the smallest of things. (shrink)

In this article I consider how our experiences of bodily privacy are changing in the contemporary surveillance society. I use biometric technologies as a lens for tracking the changing relationships between the body and privacy. Adopting a broader genealogical perspective, I retrace the role of the body in the constitution of the modern liberal political subject. I consider two different understandings of the subject, the Foucauldian political subject, and the Lacanian psychoanalytic subject. The psychoanalytic perspective serves to appraise the importance (...) of hiding for the subject effects of excessive exposure to the Other’s gaze. I conclude to the importance of the subject’s being able to hide, even when it has nothing to hide. By considering these two facets of subjectivity, political and psychic, I hope to make sense of our enduring and deeply political passionate attachment to privacy. (shrink)

This paper explores, through empirical research, how values, engineering practices, and technological design decisions shape one another in the development of privacy technologies. We propose the concept of “privacy worlds” to explore the values and design practices of the engineers of one of the world’s most notable privacy technologies: the Tor network. By following Tor’s design and development we show a privacy world emerging—one centered on a construction of privacy understood through the topology of structural power in the Internet backbone. (...) This central “cipher” discourse renders privacy as a problem that can be “solved” through engineering, allowing the translation and representation of different groups of imagined users, adversaries, and technical aspects of the Internet in the language of the system. It also stabilizes a “flattened,” neutralized conception of privacy, risking stripping it of its political and cultural depth. We argue for an enriched empirical focus on design practices in privacy technologies, both as sites where values and material power are shaped, and as a place where the various worlds that will go on to cluster around them—of users, maintainers, and others—are imagined and reconciled. (shrink)

PurposeThis paper aims to present results of a study that focused on the question of how computer and data experts think about Internet and social media surveillance after Edward Snowden’s revelations about the existence of mass-surveillance systems of the Internet such as Prism, XKeyscore and Tempora. Computer and data experts’ views are of particular relevance because they are confronted day by day with questions about the processing of personal data, privacy and data protection.Design/methodology/approachThe authors conducted two focus groups with a (...) total of ten experts based in London. As London is considered by some as the surveillance capital of the world, and has a thriving Internet industry, it provided a well-suited context.FindingsThe focus group discussions featured three topics that are of crucial importance for understanding Internet and social media surveillance: the political economy surveillance in general; surveillance in the context of the Snowden revelations; and the question what the best political reactions are to the existence of a surveillance-industrial complex that results in political and economic control of the Internet and social media. The focus groups provided indications that computer and data experts are pre-eminently informed on how Internet surveillance works, are capable of critically assessing its implications for society and have ideas about on what should be done politically.Originality/valueStudies of privacy and surveillance after Edward Snowden’s revelations have taken on a new dimension: Large-scale covert surveillance is conducted in a collaborative endeavour of secret services, private communications corporations and security companies. It has become evident that a surveillance-industrial Internet surveillance complex exists, in which capitalist communications and security corporations and state institutions collaborate. (shrink)

The Snowden revelations and the emergence of ‘Big Data’ have rekindled questions about how security practices are deployed in a digital age and with what political effects. While critical scholars have drawn attention to the social, political and legal challenges to these practices, the debates in computer and information science have received less analytical attention. This paper proposes to take seriously the critical knowledge developed in information and computer science and reinterpret their debates to develop a critical intervention into the (...) public controversies concerning data-driven security and digital surveillance. The paper offers a two-pronged contribution: on the one hand, we challenge the credibility of security professionals’ discourses in light of the knowledge that they supposedly mobilize; on the other, we argue for a series of conceptual moves around data, human–computer relations, and algorithms to address some of the limitations of existing engagements with the Big Data-security assemblage. (shrink)

How should we understand the surveillance state post Snowden? This paper is concerned with the relationship between increased surveillance capacity and state power. The paper begins by analysing two metaphors used in public post Snowden discourse to describe state surveillance practices: the haystack and the panopticon. It argues that these metaphors share a flawed common entailment regarding surveillance, knowledge and power which cannot accurately capture important aspects of state anxiety generated by mass surveillance in an age of big data. The (...) paper shows that the nature of big data itself complicates the power attributed to mass surveillance states by these metaphors and those who use them. Relying heavily on Ezrahi’s distinction between information and knowledge, the paper situates this argument concerning the state and anxiety borne of information overload in the context of literature that concerns the state and information management. Drawing primarily on James Scott’s work on legibility, it argues that the big data born of mass surveillance problematises the concept of information as empowering the state. Instead, understanding mass surveillance in an age of big data requires understanding the relationship between the surveillance state and information in terms of anxiety as well as power. (shrink)

This article compares political clientelism and datafied campaigning as two modes of relating politicians/parties and voters that are centred around voter surveillance. It contributes to the discussion on consequences of Big Data by showing similarities of datafied campaigns with a type of electoral politics that pre-dates the advent of mass media and is usually regarded as deficient. It thus departs from the predominant perspective on datafication and surveillance, which draws on Foucault, in order to identify the particular challenges that datafication (...) poses in the realm of democratic electoral politics. They are related to four major aspects in which datafied campaigning resembles political clientelism, as opposed to the combination of ideology, issue-based campaigning and media appeal that characterized Western European party politics in the second half of the 20th century. It personalizes the relationship between politicians and voters with the help of intermediaries; it is based on an asymmetric and iterative monitoring of voters; it implies a strong particularism and an affinity with populist appeals; and it is ambivalent with regard to the volition of voters. The identification of these similarities renders general concerns about the consequences of datafied campaigning for democracy more concrete. It offers a mirror in which seemingly novel practices are revealed to have implications that are well known to be problematic for the quality of democracy. (shrink)

In a time of big data, thinking about how we are seen and how that affects our lives means changing our idea about who does the seeing. Data produced by machines is most often ‘seen’ by other machines; the eye is in question is algorithmic. Algorithmic seeing does not produce a computational panopticon but a mechanism of prediction. The authority of its predictions rests on a slippage of the scientific method in to the world of data. Data science inherits some (...) of the problems of science, especially the disembodied ‘view from above’, and adds new ones of its own. As its core methods like machine learning are based on seeing correlations not understanding causation, it reproduces the prejudices of its input. Rising in to the apparatuses of governance, it reinforces the problematic sides of ‘seeing like a state’ and links to the recursive production of paranoia. It forces us to ask the question ‘what counts as rational seeing?’. Answering this from a position of feminist empiricism reveals different possibilities latent in seeing with machines. Grounded in the idea of conviviality, machine learning may reveal forgotten non-market patterns and enable free and critical learning. It is proposed that a programme to challenge the production of irrational pre-emption is also a search for the possibility of algorithmic conviviality. (shrink)

Using Big Data to better understand urban questions is an exciting field with challenging methodological and theoretical problems. It is also, however, potentially troubling when Big Data is applied uncritically to urban governance via the ideas and practices of “smart cities”. This essay reviews both the historical depth of central ideas within smart city governance —particular the idea that enough data/information/knowledge can solve society problems—but also the ways that the most recent version differs. Namely, that the motivations and ideological underpinning (...) behind the goal of urban betterment is largely driven by technology advocates and neoliberalism rather than the strong social justice themes associated with earlier applications of data to cities. Geosocial media data and metrics derived from them can provide useful insight and policy direction. But one must be ever mindful that metrics don’t simply measure; in the process of deciding what is important and possible to measure, these data are simultaneously defining what cities are. (shrink)

The Snowden revelations in 2013 redrew the lines of debate surrounding surveillance, exposing the extent of state surveillance across multiple nations and triggering legislative reform in many. In the UK, this was in the form of the Investigatory Powers Act. As a contribution to understanding resistance to expanding state surveillance activities, this article reveals the intertwining of diverse interests and voices which speak in opposition to UK state surveillance. Through a computational topic modelling-based mixed methods analysis of the submissions made (...) to the draft Investigatory Powers Bill consultation, the article demonstrates the diversity and intersection of discourses within different actor groups, including civil society and the technology industry. We demonstrate that encryption is a key issue for these groups, and is additionally conflated with a human rights discourse. This serves to unite seemingly disparate interests by imbuing encryption with a responsibility for the protection of human rights, but also threatens to legitimate corporate interests and distract from their own data-driven activities of surveillance capitalism. (shrink)

Remote monitoring of implantable cardioverter defibrillator (ICD) patients links patients wirelessly to the clinic via a box in their bedroom. The box transmits data from the ICD to a remote database accessible to clinicians without patient involvement. Data travel across time and space; clinicians can monitor patients from a distance and instantly know about cardiac events. Based on ethnographic fieldwork in two Danish hospitals, this article explores the configuration of the wireless ICD patient by following a number of patients through (...) hospitalisation, implantation, in-clinic follow-up, and remote monitoring. Wireless therapy, we argue, scripts the patient as data. In high-tech clinical encounters, data are enacted as extensions and copies of the patient, and even proxies that, in patients’ experiences, may turn into identity thieves. In illuminating the multiple positions that data take in such clinical encounters and in patients’ experiences we discuss the ambiguities that arise when patients go wireless. (shrink)

During the course of the COVID-19 pandemic, a wide range of digital technologies and data analytics have been incorporated into pandemic response models globally, in the hope of better detecting, tracking, monitoring and containing outbreaks. This increased digital involvement in disease control has offered the prospect of heightened effectiveness in all of the above, but not without raising other concerns. This paper contributes to ongoing discussions of the digital transformation in disease control by proposing a materialist analysis of how such (...) control has become operative and what its effects may be, both now and in the future. Using Taiwan's digital pandemic response as a case study, the paper explores specific ways in which material processes and arrangements have shaped digital measures, as well as the actions that rendered such measures operable, with their ensuing consequences. This analysis illustrates the importance of historical, material and technological specificities and contingencies to our understanding of how digital disease control takes a particular shape. It also demonstrates how shifting regimes of practice continually reconfigure the ways in which digital disease control functions. The paper argues that paying greater attention to the materialities of digital disease control can provide a more nuanced understanding of the complex ways in which society may be protected or harmed by its use, possibly simultaneously. It is hoped that such increased attentiveness may inform more considered and careful preparation for subsequent pandemics. (shrink)

Algorithms are increasingly affecting us in our daily lives. They seem to be everywhere, yet they are seldom seen by the humans dealing with the consequences that result from them. Yet, in recent theorisations, there is a risk that the algorithm is being given too much prominence. This article addresses the interaction between algorithmic outputs and the humans engaging with them by drawing on studies of two distinct empirical fields – self-quantification and audit controls of taxpayers. We explore recalibration as (...) a way to understand the practices and processes involved when, on the one hand, decisions are made based on results from algorithmic calculations in counting and accounting software, and on the other hand, when decisions are made based on human experience/knowledge. In particular, we are concerned with moments when an algorithmic output differs from expectations of ‘normalcy’ and ‘normativity’ in any given situation. This could be a ‘normal’ relation between sales and VAT deductions for a business, or a ‘normal’ number of steps one takes in a day, or ‘normative’ as it is according to the book, following guidelines and recommendations from other sources. In these moments, we argue that a process of recalibration occurs – an effortful moment where, rather than treat the algorithmic output as given, individuals’ tacit knowledge, experiences and intuition are brought into play to address the deviation from the normal and normative. (shrink)

ABSTRACTThe widespread use of commercial social media platforms by protesters and activists has enhanced protest mobilisation and reporting but it has placed social media providers in the intermediary role as facilitators of dissent and has thereby created new challenges. Companies like Google and Facebook are increasingly restricting content that is published on or distributed through their platforms; they have been subject to obstruction by governments; and their services have been at the core of large-scale data collection and surveillance. This article (...) analyses and categorises forms of infrastructure-based restrictions on free expression and dissent. It shows how private intermediaries have been incorporated into state-led content policies; how they set their own standards for legitimate online communication and intervene accordingly; and how state-based actions and commercial self-regulation intersect in the specific area of online surveillance. Based on a broad review of cases, it situates the role of social media in the wider trend of the privatisation of communications policy and the complex interplay between state-based regulation and commercial rule-making. (shrink)