Hasta la vista, baby: reflections on the risks of algocracy, killer robots, and artificial superintelligence

Abstract

The neologism Algocracy may mean government or governance by algorithms. Architects of artificial intelligence have perspectives on killer robots and government by artificial superintelligence and are engaged in public debate on both themes. The risks of being dominated by artificial superintelligence and of being subjected to undemocratic, unconstitutional or illegal algo norms inspires our reflection. Institutions should organize rules of the game that prevent machine learning algorithms from learning how to dominate humans. Algorithms need new design requirements to incorporate responsibility, transparency, auditability, incorruptibility, and predictability. The algorithmic responsibility of the state, national public policies for developing a trustworthy AI, and the * DPHIL (Oxford), JSM (Stanford), LLM (Harvard), MBE (Coppe-UFRJ), BA (PUC-Rio), LLB (UFRJ). Visiting Professor at the Doctoral Program of the National Law School at UFRJ. Chair of the Working Group Law and Development at the Research Committee of Sociology of Law. Chair of the Collaborative Research Network Law and Development at the Law and Society Association. Convenor of the stream Exploring Legal Borderlands: Empirical and Interdisciplinary Approaches at the Socio-Legal Studies Association. International Director of the Brazilian Institute for Studies of Tort Law (IBERC). Research Associate at the Laboratory of Institutional Studies (LETACI). ORCID ID: 0000-0003-0548-4537. Contacto: <[email protected]>. Fecha de recepción: 15/11/2020. Fecha de aprobación: 18/02/2021. Revista de la Facultad de Derecho de México Tomo LXXI, Número 279, Enero-Abril 2021 DOI: http:// dx.doi.org/10.22201/fder.24488933e.2021.279-1.78811 Hasta la vista, baby: reflections on the risks ... Pedro Rubim Borges Fortes 46 algorithmic law of killer robots and artificial superintelligence could reduce the risks of algocracy. The particular character of algorithms demands a special discipline to control their power, architecture, and commands. law and government can channel the development and use of killer robots, eventually even setting a global prohibition of autonomous weapons. Likewise, the threat of government by algorithms posed by the emergence of an artificial superintelligence that dominates humankind also requires the development of a new algorithmic law that establishes checks and balances and controls the technological