UK Bans AI Nudification Apps

• Misuse of Generative AI: The process of "nudification" or "de-clothing" has emerged, whereby generative AI is used to create hyper-realistic deepfake images that strip clothing from real photos. These non-consensual images can result in significant harassment and reputational harms.

• UK Government Response:

  • A proposed new set of laws aimed at banning the development and distribution of AI-powered nudification tools has been introduced as part of a strategy to reduce online violence against women and girls by 50%.
  • This legislation will criminalize the creation and supply of “nudify” applications and websites.
  • The Government emphasized the urgency of protecting women and children from such technologies.

• Online Safety Act:

  • Under the UK's Online Safety Act, it is already an offense to create explicit images of an individual without their consent.
  • The proposed laws will build upon existing rules concerning sexually explicit deepfakes and intimate image abuses.

• Statistical Context:

  • The Internet Watch Foundation (IWF) reported that over 19% of under-18s' reports to a helpline about explicit images involved manipulated imagery.

• International Measures:

  • Similar initiatives have emerged globally, including calls for bans on nudification apps in jurisdictions like New Jersey, USA.
  • Digital rights advocates caution that initiatives aimed at reducing deepfake imagery might lead to government overreach in content censorship.

• Technological Developments:

  • The UK Government is collaborating with SafeToNet, a safety tech firm that develops AI tools to detect and block sexual content.
  • Tech giants like Meta are implementing filters to identify and flag potential nudity in images and have initiated legal action against those promoting such apps.

• India's Legislative Efforts:

  • In October, India's Centre proposed amendments to the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules 2021.
  • The proposed rules would require social media platforms to confirm whether uploaded content is AI-generated and prominently label it as synthetic information.
  • Existing mandates require platforms to remove AI-generated deepfakes within 36 hours following a court order or government notice; non-compliance risks the loss of legal immunity regarding third-party content.

• Judicial and Regulatory Frameworks:

  • Legal frameworks are being developed in both the UK and India to tackle the challenges posed by AI technologies, emphasizing user consent and the importance of timely removal of harmful content.

• Calls for Action:

  • Public officials, including Rachel de Souza, Children’s Commissioner for England, advocate for a complete ban on nudification technologies, urging that the enabling technology itself should also be deemed illegal.

Overall, the responses from the UK and India's legal systems reflect growing international concern over the misuse of AI technologies, particularly concerning issues of consent and digital safety for women and minors.