The rise of artificial intelligence (AI) has brought with it a dark side: the proliferation of 'nudify' apps and AI deepfakes, which are increasingly impacting Indian women's engagement with the internet. These technologies, capable of generating non-consensual intimate imagery, are creating a "chilling effect," keeping many women offline due to fear of harassment and abuse.
Nudify apps employ AI algorithms to digitally remove clothing from images, while deepfakes use AI to create realistic but fabricated videos and images. The alarming surge in popularity of these technologies has sparked serious privacy concerns. In September alone, "nudify" platforms attracted over 24 million users, highlighting the scale of the threat to online privacy and safety. A significant number of these tools are designed to specifically target women, exacerbating gender-based digital harassment.
The consequences of these technologies are far-reaching. Victims can experience emotional distress, reputational damage, and even physical harm if manipulated images are shared or used maliciously. The creation and dissemination of non-consensual pornography through deepfakes contribute to the objectification and dehumanization of women. Celebrities and ordinary women alike have become targets, facing online harassment, bullying, and the threat of "revenge porn".
This online abuse can have severe real-world repercussions for women in South Asia, where a family's reputation often rests on its female members. Emotional harm and reputational damage are common consequences. In extreme cases, the social pressure and distress can even lead to suicide. For example, a 21-year-old Indian woman tragically took her own life after doctored images of her were shared on Facebook.
The Indian government has taken steps to address cybercrimes against women, including establishing legal frameworks and setting up reporting mechanisms. However, many women are unaware of their legal rights and are more likely to block abusers than report them. A survey revealed that 30% of respondents were not aware of laws to protect them from online harassment.
Some recent actions have been taken to combat the issue. The UK government has made creating sexually explicit deepfakes a criminal offense. In the US, the "Take It Down Act" criminalizes the non-consensual publication of intimate images. Meta has also taken action, filing a lawsuit against a Hong Kong company behind a nudify app. Despite these efforts, AI nudifying sites remain resilient.
To create a safer cyberspace for women, several measures are needed. Social media platforms must take more aggressive steps to identify and remove nudify apps and websites. Awareness programs are essential to educate women about online safety and their rights. Technology companies need to strengthen their efforts to detect and combat AI-generated abuse. Stronger laws and regulations are needed to address the specific challenges posed by deepfakes, including issues like privacy, data protection, and cybercrime. It is also crucial for social media platforms to consider the South Asian cultural context when reviewing abuse complaints.
The fear of 'nudify' apps and AI deepfakes is a significant barrier to Indian women's full participation in the digital world. Addressing this issue requires a multi-pronged approach involving government, tech companies, and civil society to create a safer and more inclusive online environment for women.
