Autonomous Weapon Systems: Legality under International Humanitarian Law and Human Rights

9 May 2017

Our new publication Defending the Boundary analyses the constraints and requirements on the use of autonomous weapon systems (AWS), also called ‘killer robots’, under international humanitarian law (IHL) and international human rights law (IHRL).

A Research Brief of this publication provides policy makers and advocacy groups with a summary of key findings.

Drawing on case law dealing with other weapon technologies and autonomous systems, it asks where and when AWS may be used, and what the procedural legal requirements are in terms of the planning, conduct and aftermath of AWS use.

The use of a ‘sentry-AWS’ to control a boundary, secure a perimeter or deny access to an area, for example along an international border, forms the backdrop to the legal discussion.

Defending the Boundary AWS under IHL and IHRL

A Timely Publication

‘This publication is particularly timely as the UN Convention on Certain Conventional Weapons (CCW) mandated a Group of Governmental Experts to consider the issue as views diverge on the circumstances in which it would be lawful to use an AWS and on whether additional law is required to ensure respect for the norms to safeguard humanity’ underlines Maya Brehm, the author of the report.

‘At the national level, several states are also looking at the legality of AWS, including in Switzerland where two parliamentary motions call for an international prohibition of fully autonomous weapons’ she adds.

Defending the Boundary AWS under IHL and IHRL CCW

What’s at Stake?

There is, as yet, no agreed definition of an AWS but the basic idea is that once activated, such a weapon system would, with the help of sensors and computationally intensive algorithms, detect, select and attack targets without further human intervention.

The use of such a weapon system can be expected to change how human beings exercise control over the use of force and its consequences. Human beings may no longer be able to predict who or what, specifically, is made the target of attack, or explain why a particular target was chosen by an AWS. That raises serious ethical, humanitarian, legal and security concerns.

According to leading researchers in the field of artificial intelligence and robotics, the deployment of AWS will be practically, if not legally, feasible within years.

The Need to Look Beyond IHL

The focus of scholarly inquiry into the legality of AWS has mostly been on compliance with IHL rules on the conduct of hostilities. Comparably, little attention has been given to the impact of AWS on human rights protection. This study aims to fill this gap by analyzing the constraints and requirements that IHRL places on the use of force by means of an AWS, both, in times of peace and during armed conflict, in relation to the conduct of hostilities and for law enforcement purposes.

‘IHL would never be the sole, and, often, it would not be the primary legal frame of reference to assess the legality of AWS’ stresses Maya Brehm.

Limited Scope for the Use of an AWS During Armed Conflict

As IHL permits the ‘categorical targeting’ of persons based on their status or imputed membership in a group (e.g. combatants), there is scope for the lawful use of an AWS for the conduct of hostilities.

However, to ensure that targeting rules can be applied in a manner that effectively protects the victims of war, human agents must bound every attack appropriately in spatio-temporal terms and retain sufficient control over an AWS to recognize changing circumstances and to adjust operations in a timely manner. ‘This calls for active and constant control over every individual attack’ underlines Maya Brehm.

Defending the Boundary AWS under IHL and IHRL Armed Conflict

AWS are Difficult to Reconcile with IHRL

To preserve life, the use of potentially lethal force for law enforcement purposes can only be justified if it is absolutely necessary and strictly proportionate in the specific circumstances. Lethal force cannot be applied automatically or categorically. ‘Human beings must therefore be actively and even personally involved in every instance of force application. AWS are difficult to reconcile with IHRL due to the need to individuate the use of force’, says Maya Brehm.

Furthermore, the algorithm-based targeting of security measures can be de-humanizing, objectifying and discriminatory. ‘Human involvement in such processes serves as an essential procedural safeguard to uphold human dignity and human rights’ according to Brehm.

To allow an independent assessment of the lawfulness of the use of force, ‘human agents must remain involved in targeting processes in a manner that enables them to explain the reasoning underlying algorithmic decisions in particular circumstances’ recalls Maya Brehm.

A Legal Duty to Exercise Meaningful Human Control can Help Ensure Compliance with IHL and IHRL

Whereas legal norms already regulate and limit the use of AWS, controversies and uncertainties about the applicability and meaning of existing norms diminish their capacity to serve as a guidepost. In addition, accommodating new practices within the existing legal framework bears the risk that existing rules are preserved formally but filled with a radically different meaning.

‘An explicit legal requirement to exercise meaningful human control in the use of weapons can help ensure compliance with the norms that safeguard humanity’ stresses Maya Brehm. ‘Action is urgently needed and the CCW Group of Governmental Experts is well placed to formulate such a requirement.’

MORE ON THIS THEMATIC AREA

Armoured vehicle patrolls the border, Tajikistan News

RULAC: Fighting between Kyrgyzstan and Tajikistan Amounts to an International Armed Conflict

26 September 2022

According to our RULAC online portal, the border fighting between Kyrgyzstan and Tajikistan that took place in mid-September 2022 amounts to an international armed conflict (IAC).

Read more

News

Our New Visiting Fellow: Natia Kalandarishvili-Mueller

8 August 2022

Natia Kalandarishvili-Mueller is a professor of international law at ALTE University in Tbilisi. Also an alumna of our LLM in IHL and Human Rights, she just started as a Visiting Fellow at the Geneva Academy and will stay with us until the end of November 2022.

Read more

Cover page of the book Event

Book Launch: ‘Serious violations of Human Rights, On the Emergence of a New Special Regime’

12 October 2022, 18:00-20:00

This event marks the launch of our LLM alumna Ilia Siatitsa’s book ‘Serious violations of human rights, On the emergence of a new special regime’ published by Oxford University Press.

Read more

Event

2022 Annual Conference of the Geneva Human Rights Platform

18 October 2022, 09:00-19:00

The 2022 Annual Conference will focus on digital connectivity in the field of human rights. This includes a view of the digital connections by and among mechanisms within the human rights system, but also the substantive impacts of digitalization.

Read more

Afghanistan, Parwan detention facility. Inside a room where detainees of the prison, separated by an acrylic glass, are allowed to meet with their families a couple of times per year with the help of the ICRC employees who facilitate the programme. Short Course

Preventing and Combating Terrorism

27 April - 8 June 2023

This online short course discusses the extent to which states may limit and/or derogate from their international human rights obligations in order to prevent and counter-terrorism and thus protect persons under their jurisdiction.

Read more

Côte d'Ivoire,  Abidjan, military instruction center in Akandjé. An ICRC dissemination session on international humanitarian law for the 1st bataillon of commando paratroopers. Short Course

The Implementation of International Humanitarian Law

7 February - 21 March 2023

This online short course will cover the ‘nuts and bolts’ of implementation, including national legislation, dissemination and training, and discuss the mechanisms such as the International Fact-Finding Commission, as set out in the treaties.

Read more

George Floyd protest in Washington D.C. Project

Promoting and Protecting the Rights to Freedom of Peaceful Assembly and Association and Civic Space Worldwide

Started in June 2020

This project aims at providing support to the UN Special Rapporteur on the Rights to Freedom of Peaceful Assembly and of Association Clément Voulé by addressing emerging issues affecting civic space and eveloping tools and materials allowing various stakeholders to promote and defend civic space.

Read more

Sign: National Human Rights Commission of Nepal Project

Local Implementation of Global Human Rights

Started in May 2020

The Geneva Human Rights Platform collaborates with a series of actors to reflect on the implementation of international human rights norms at the local level and propose solutions to improve uptake of recommendations and decisions taken by Geneva-based human rights bodies at the local level.

Read more

Cover of the publication Publication

Implementing the Treaty Body Review 2020 – Where do we stand

published on May 2022

Felix Kirchmeier, Chloé Naret, Domenico Zipoli

Read more

Cover of the publication Publication

Regulating business conduct in the technology sector gaps and ways forward in applying the UNGPs

published on April 2022

Ana Beduschi, Isabel Ebert

Read more