THERE was the Bollywood star in skin-tight lycra, the Bangladeshi politician filmed in a bikini and the young Pakistani woman snapped with a man.
None was real, but all three images were credible enough to unleash lust, vitriol - and even allegedly a murder, underlining the sophistication of generative artificial intelligence, and the threats it poses to women across Asia.
The two videos and the photo were deepfake, and went viral in a vibrant social mediascape that is struggling to come to grips with the technology that has the power to create convincing copies that can upend real lives.
"We need to address this as a community and with urgency before more of us are affected by such identity theft," Indian actor Rashmika Mandanna said in a post on X, formerly Twitter, that has garnered more than 6.2 million views.
She is not the only Bollywood star to be cloned and attacked on social media, with top actors including Katrina Kaif, Alia Bhatt and Deepika Padukone also targeted with deepfakes.
The lycra video, said Mandanna, was "extremely scary not only for me, but also for each one of us who today is vulnerable to so much harm because of how technology is being misused."
While digitally manipulated images and videos of women were once easy to spot, usually lurking in the dark corners of the internet, the explosion in generative AI tools such as Midjourney, Stable Diffusion and DALL-E has made it easy and cheap to create and circulate convincing deepfakes.
More than 90% of deepfake videos online are pornographic, according to tech experts, and most are of women.
While there are no separate data for South Asian countries, digital rights experts say the issue is particularly challenging in conservative societies, where women have long been harassed online and abuse has gone largely unpunished.
Social media firms are struggling to keep up.
Google's YouTube and Meta Platforms - which owns Facebook, Instagram and WhatsApp - have updated their policies, requiring creators and advertisers to label all AI-generated content.
But the onus is largely on victims - usually girls and women - to take action, said Rumman Chowdhury, an AI expert at Harvard University who previously worked at reducing harms on Twitter.
"Generative AI will regrettably supercharge online harassment and malicious content ... and women are the canaries in the coal mine. They are the ones impacted first, the ones on whom the technologies are tested," she said.
"It is an indication to the rest of the world to pay attention, because it's coming for everyone," Chowdhury told a recent United Nations briefing.
DEEPFAKES AND THE LAW
As deepfakes have proliferated worldwide, there are growing concerns - and rising instances - of their use in harassment, scams and sextortion.
Regulations have been slow to follow.
The U.S. Executive Order on AI touches on dangers posed by deepfakes, while the European Union's proposed AI Act will require greater transparency and disclosure from providers.
Last month, 18 countries - including the United States and Britain - unveiled a non-binding agreement on keeping the wider public safe from AI misuse, including deepfakes.
Among Asian nations, China requires providers to use watermarks and report illegal deepfakes, while South Korea has made it illegal to distribute deepfakes that harm "public interest", with potential imprisonment or fines.
India is taking a tough stance as it drafts new rules.
IT Minister Ashwini Vaishnaw has said social media firms must remove deepfakes within 36 hours of receiving a notification, or risk losing their safe-harbour status that protects them from liability for third-party content.
But the focus should be on "mitigating and preventing incidents, rather than reactive responses," said Malavika Rajkumar at the advocacy group IT for Change.
While the Indian government has indicated it may force providers and platforms to disclose the identity of deepfake creators, "striking a balance between privacy protection and preventing abuse is key," Rajkumar added.
WOMEN TARGETED
Deepfakes of women and other vulnerable communities such as LGBTQ+ people - especially sexual images and videos - can be particularly dangerous in deeply religious or conservative societies, human rights activists say.
In Bangladesh, deepfake videos of female opposition politicians - Rumin Farhana in a bikini and Nipun Roy in a swimming pool - have emerged ahead of an election on Jan. 7.
And last month, an 18-year-old woman was allegedly shot dead by her father and uncle in a so-called honour killing in Pakistan's remote Kohistan province, after a photograph of her with a man went viral. Police say the image was doctored.
Shahzadi Rai, a transgender member of Pakistan's Karachi Municipal Council, who has been the target of abusive trolling with deepfake images, has said they could exacerbate online gender-based violence and "seriously jeopardise" her career.
Even if audiences are able to distinguish between a real image and a deepfake, the woman's integrity is questioned, and her credibility may be damaged, said Nighat Dad, founder of the non-profit Digital Rights Foundation in Pakistan.
"The threat to women's privacy and safety is deeply concerning," she said, particularly as disinformation campaigns gain steam ahead of an election scheduled for Feb. 8.
"Deepfakes are creating an increasingly unsafe online environment for women, even non-public figures, and may discourage women from participating in politics and online spaces," she said.
In several countries including India, entrenched gender biases already affect the ability of girls and young women to use the internet, a recent report found.
Deepfakes of powerful Bollywood stars only underline the risk that AI poses to all women, said Rajkumar.
"Deepfakes have affected women and vulnerable communities for a long time; they have gained widespread attention only after popular actresses were targeted," she said.
The heightened focus now should push "platforms, policymakers, and society at large to create a safer and more inclusive online environment," she added.
Reuters
Fri Dec 22 2023
![Bollywood star or deepfake? AI floods social media in Asia Bollywood star or deepfake? AI floods social media in Asia](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2023-12/41702551248_TBartificialintelli.jpg)
The explosion in generative AI tools such as Midjourney, Stable Diffusion and DALL-E has made it easy and cheap to create and circulate convincing deepfakes. - FREEPIK
![Olimpik Paris 2024: Atlet Gaza tersepit antara impian dan serangan Israel Olimpik Paris 2024: Atlet Gaza tersepit antara impian dan serangan Israel](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/71722043717_Palestineathlete.jpg)
Olimpik Paris 2024: Atlet Gaza tersepit antara impian dan serangan Israel
Serangan Israel juga telah menyebabkan kematian pemain terkemuka di Gaza, termasuk juara kejohanan.
AWANI Pagi: Tutup Haji 2024, menanti lambaian 2025
Ikuti diskusi Awani PAGI pada Sabtu bersama Ketua Rombongan Haji 1445h/2024M, Datuk Seri Syed Saleh Syed Abdul Rahman bagi membincangkan mengenai operasi haji 2024 yang ditutup secara rasmi minggu ini, sekali gus menantikan lambaian Kaabah untuk tetamu Allah pada tahun 2025.
![Bordeaux fail muflis Bordeaux fail muflis](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/81722043252_TBFCGirondins.jpg)
Bordeaux fail muflis
Ditubuhkan pada 1881, FC Girondins de Bordeaux ialah salah satu kelab bola sepak paling terkenal di Perancis.
![Medan selera Taman Lembah Keramat terbakar Medan selera Taman Lembah Keramat terbakar](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/51722042268_tbmedanselera.jpg)
Medan selera Taman Lembah Keramat terbakar
Kebakaran melibatkan bangunan kelas A yang dianggarkan musnah 80 peratus.
AWANI Pagi: Berita tumpuan & menarik di astroawani.com [27 Julai 2024]
Antara fokus Awani Pagi bersama Nursyazwani Saiful Sham & Azib Zikry
- Mahkamah: kes bunuh Nur Farah Kartini dan Zayn Rayyan
- Lapan kawasan rekod cuaca panas berjaga-jaga
- Sukan Olimpik Paris 2024 secara rasmi membuka tirai
- Mahkamah: kes bunuh Nur Farah Kartini dan Zayn Rayyan
- Lapan kawasan rekod cuaca panas berjaga-jaga
- Sukan Olimpik Paris 2024 secara rasmi membuka tirai
![Pemimpin Hamas meninggal dunia dalam tahanan Israel Pemimpin Hamas meninggal dunia dalam tahanan Israel](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/51722040266_tbMustafaMuhammadA.jpg)
Pemimpin Hamas meninggal dunia dalam tahanan Israel
Mustafa Muhammad Abu Ara meninggal dunia selepas dipindahkan dari penjara di selatan Israel ke hospital.
![Lelaki buta mata selepas tampar lalat hinggap di muka Lelaki buta mata selepas tampar lalat hinggap di muka](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/41722039605_lelakibutalalat.jpg)
Lelaki buta mata selepas tampar lalat hinggap di muka
Wu dari Shenzen dilaporkan buta mata kiri selepas terkena jangkitan kuman dipercayai dibawa lalat itu.
![[KOLUMNIS] PRK Nenggiri: Petunjuk persepsi atau prestasi? [KOLUMNIS] PRK Nenggiri: Petunjuk persepsi atau prestasi?](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2023-12/81701508558_Jaripengundi.jpg)
[KOLUMNIS] PRK Nenggiri: Petunjuk persepsi atau prestasi?
Kali ini pada bulan Ogos 2024, ia adalah giliran Kelantan iaitu negeri yang masyhur dengan sejarah pemerintahan Paduka Seri Maharaja Puteri Cik Siti Wan Kembang.
![Olimpik Paris 2024: Judoka Iraq atlet pertama gagal ujian doping Olimpik Paris 2024: Judoka Iraq atlet pertama gagal ujian doping](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/81722039538_tbPositivedoping.jpg)
Olimpik Paris 2024: Judoka Iraq atlet pertama gagal ujian doping
Judoka Iraq Sajjad Sehen menjadi atlet pertama yang gagal dalam ujian doping di Sukan Olimpik Paris.
![Perubahan iklim punca banjir buruk di Filipina Perubahan iklim punca banjir buruk di Filipina](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/41722038584_TyphoonGaemi.jpg)
Perubahan iklim punca banjir buruk di Filipina
Sekurang-kurangnya 14 orang terkorban, sementara lebih 600,000 yang lain hilang tempat tinggal akibat Taufan Gaemi.
![SC beri amaran mengenai penipuan pelaburan 'deepfake' SC beri amaran mengenai penipuan pelaburan 'deepfake'](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-03/51711260576_SuruhanjayaSekuriti.jpg)
SC beri amaran mengenai penipuan pelaburan 'deepfake'
SC berkata pelaku penipuan itu biasanya memulakan aktiviti jenayah dengan menyiarkan video 'deepfake' pada platform media sosial, yang kemudiannya disebarkan melalui aplikasi pemesejan.
![JSJK minta mangsa taktik penipuan 'deepfake' tampil buat laporan polis JSJK minta mangsa taktik penipuan 'deepfake' tampil buat laporan polis](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/51720426820_RamliMohamedYoosuf.jpg)
JSJK minta mangsa taktik penipuan 'deepfake' tampil buat laporan polis
"Penipuan seperti ini memang sebenarnya berlaku dan ia semakin hari kita jangka akan terus berlaku."
![Bruce Willis nafi jual wajahnya untuk digunakan dalam teknologi 'deepfake' Bruce Willis nafi jual wajahnya untuk digunakan dalam teknologi 'deepfake'](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2022-03/51648695717_LONDON.jpg)
Bruce Willis nafi jual wajahnya untuk digunakan dalam teknologi 'deepfake'
Jurucakap pelakon itu memberitahu BBC bahawa "tiada perkongsian atau perjanjian" dibuat dengan syarikat itu.
!['Ratu Elizabeth' bertiktok, bawa mesej bahaya teknologi 'deepfake' 'Ratu Elizabeth' bertiktok, bawa mesej bahaya teknologi 'deepfake'](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2020-12/51608988904_ratuelizabeth.jpg)
'Ratu Elizabeth' bertiktok, bawa mesej bahaya teknologi 'deepfake'
Klip itu mengajak penonton untuk berfikir apakah yang dilihat dan didengar membawa mesej atau maksud yang sebenarnya.