Seoul, South Korea – In a disturbing turn of events, South Korean schools are grappling with a deepfake pornography crisis that has left students and parents in shock. Over the past few days, authorities have uncovered a sprawling network of AI-generated deepfake pornographic images targeting students and teachers, sparking outrage and calls for immediate action.
On September 8, 2024, South Korean authorities revealed the existence of multiple Telegram chatrooms where explicit deepfake images of students and teachers were being shared. These chatrooms, often set up within schools and universities, were used by students to humiliate their peers by creating and distributing fake pornographic images using AI technology1. The victims, mostly female students, found their innocuous selfies stolen from social media and transformed into explicit content.
The Role of AI and Social Media
The rapid advancement of AI technology has made it easier to create realistic deepfake images. Combined with the widespread use of social media, this has led to a surge in cyber sexual violence. Experts point out that South Korea’s super-fast internet speeds and lax regulations have exacerbated the issue, making it a breeding ground for such crimes.
Activists and Victims Speak Out
Teenage activist Bang Seo-yoon has been at the forefront of the fight against this crisis. She has collected thousands of testimonies from victims who have been devastated by the spread of these images. “It’s not just the harm caused by the deepfake itself, but the spread of those videos among acquaintances that is even more humiliating and painful,” Bang said1. Victims have reported feeling sexually insulted and mocked by their classmates in online spaces.
Police Crackdown and Legal Challenges
In response to the crisis, South Korean police have launched a crackdown on these chatrooms. Within just five days in late August, 118 cases were reported, leading to the arrest of seven individuals. However, six of the seven alleged perpetrators were teenagers, complicating prosecutions as South Korean courts rarely issue arrest warrants for minors. This has raised concerns about the effectiveness of the legal system in dealing with such crimes.
Calls for Stricter Regulations
The deepfake porn crisis has prompted calls for stricter regulations on AI technology and social media platforms. Activists argue that current laws are insufficient to protect victims and hold perpetrators accountable. The government is under pressure to implement stronger measures to prevent the creation and distribution of deepfake pornography.
Impact on Students and Schools
The psychological impact on victims has been severe. Many students now live in fear of where their manipulated images might be distributed next. Schools are also struggling to address the issue, with some implementing stricter social media policies and providing support to affected students.
As the deepfake porn crisis continues to unfold, there is a growing demand for comprehensive action to tackle the issue. This includes better education for young people about the dangers of AI technology, stricter regulations on social media platforms, and more robust legal frameworks to protect victims and prosecute offenders.
The deepfake porn crisis in South Korean schools is a stark reminder of the dark side of technological advancements. It highlights the urgent need for society to address the ethical implications of AI and ensure that such technology is used responsibly.