He praised the new law but noted that juvenile offenders – who may try to bully classmates by creating such images – often aren’t prosecuted criminally the first time they are caught. GAINESVILLE – A sweeping new law in Florida that took effect Wednesday makes it illegal to produce sexual images of a person using artificial intelligence or similar technologies without their permission. To prevent the Grok misuse, xAI sued the user allegedly responsible for prompting Grok to generate the illegal content, but the question remains whether xAI is liable for the outputs. In a May preprint paper, researchers identified 420 apps touted as generic face-swapping tools and tested 155 to see if they could be used to sexualize images.
Victims report severe psychological harm, with 41% of cases involving minors according to a 2024 Thorn Foundation report Thorn Research. As we examine the ethical concerns below — contrast these with platforms prioritizing responsible innovation. Researchers and lawyers WIRED spoke to emphasize that these questions have not been answered in practice in the United States legal system. It might not say that encryption is illegal (but designing apps to prevent exposure to various harms could be interpreted to mean monitoring all private messages), which would of course mean the end of encrypted messaging features.
Nudify AI refers to artificial intelligence tools designed to digitally alter images, often by removing clothing from individuals to create explicit or semi-explicit versions of them. These apps can manipulate innocent photos (creating harmful), explicit content that is difficult to remove once shared. Education is key to preventing this issue from affecting teens in the first place. This tool is essential for parents (guardians), or victims who are dealing with the harmful spread of AI-generated explicit images.
Together, these apps have more than 700 million downloads and brought in $117 million in revenue, based AI porn reviews and rankings on data from AppMagic. Some apps later returned after developers submitted updated versions. After the group and CNBC contacted Apple, the company said it removed 28 apps and warned other developers.
What about adults?
Best AI nudify tools in 2026 compared. Uploaded photos deleted within 30 seconds (end-to-end encryption), zero data sharing. It constitutes child sexual abuse material (CSAM) under the laws of virtually every country. Similar state laws also allow victims to sue in state courts — if they so choose.
The use of AI to create sexually explicit images of people without their consent has been a growing concern amid the proliferation of platforms capable of creating photo-realistic material at the click of a mouse. “While this move won’t eliminate the problem of abusive technology in one fell swoop (alongside existing laws and our world-leading online safety reforms), it will make a real difference in protecting Australians,” she added. The researcher contacted the company about what he had found.
As Light et al argue — researchers can leverage this analysis to understand the intended use case of the platform. In particular, researchers document the sign-up and registration process through well-articulated observation notes and examine the first elements the user interacts with. We use this methodology in our research to complete a critical analysis of AI nudification applications.
‘Vexatious’ Litigant Will Need Federal Court’s OK Before Any New California Privacy Claims
He cited reports of increased extortion schemes and mental health crises among victims. The ease with which such “image manipulation” may be carried out without the knowledge of its victims is alarming. Deepfake detection company Sensity recently published research into Telegram. The first step to ensure your child’s online safety is getting the right guidance. This briefing explores where children with additional needs spend their time, the benefits and drawbacks of that time, and how they can be best supported.
Big tech must deal with scam ads under Ofcom proposals
And in two of these websites, they could not register an account until after purchase (which the researchers did not do). Our researchers were able to observe and traverse much of the web pages before being required to register for an account. This focus aligns with findings from prior work on non-AI facilitated IBSA, which found that over 90% of content on “revenge porn websites” was of people who based on visual presentation appeared to the researchers to be women . We use the term “women” to describe those depicted on the websites we analyze who appear to the researchers to present as women based on their dress or anatomy , visible breasts, vulva,.
The primary victims of these AI-powered nudify apps are teens, particularly those who post innocent photos on social media without realizing the risks. These apps often claim to have safeguards, such as preventing the processing of minors’ photos. AI-powered nudify apps are websites or mobile applications that use artificial intelligence to alter photos, often to create nude or explicit images. AI-powered nudify apps and deepfake technology have created a dangerous environment for teens, especially when they unknowingly become victims of these malicious practices. A newer — more insidious form of harassment has emerged, powered by artificial intelligence (AI). Thank you for taking time to provide your feedback to the editors.
Laws pertaining to CSAM are enforced on images regardless of their method of creation, which also encompasses content generated by AI. Engaging in the creation and distribution of such materials is prohibited, and severe legal repercussions could be faced by anyone participating. The law categorizes images (even if they are not considered “real” in a conventional manner), as child sexual abuse material (CSAM).
Anika Wells, the Minister for Communications, remarked that the government intends to collaborate closely with the industry to determine the most effective methods to restrict access to nudify tools proactively. At present (it is not illegal in Australia to develop), host, or promote these tools designed for generating either adult or child content. It constitutes a criminal offense to not only share child sexual abuse material (including those fictional (cartoonish), or AI-generated images) but also to create, access, possess, or solicit such materials. A study conducted in July 2025 revealed that 85 nudify websites collectively attracted an average of 18.5 million visitors over the previous six months. In the first half of 2024, over 200 million visits were recorded for 16 nudify websites mentioned in a lawsuit filed by San Francisco City Attorney David Chiu.
Australian state and territory laws broadly define an “intimate image” of an adult to encompass digitally modified or altered visuals. This definition extends to include fictional or fake images, such as drawings, cartoons, or AI-generated content. Potential strategies may involve blocking access to nudify and deepfake websites, although bypassing such blocks can be achieved with VPNs.
For years, the proliferation of “nudify” apps and websites has allowed individuals to produce abusive and nonconsensual images of women and girls, including child sexual abuse material. Some of these platforms assert that they require users to secure consent from victims for creating fake explicit images; however, Chiu’s investigation unsurprisingly revealed that this requirement is often disregarded. Earlier this year (the DOJ stated that child sexual abuse materials (CSAM) generated by AI should still be classified as CSAM following a rare arrest), indicating that more arrests might follow. The US Department of Justice shares the shock of San Francisco city officials, yet there has been little accountability to date for those responsible for creating or distributing harmful materials. Chiu anticipates that the lawsuit will not only restrain companies allegedly facilitating the production and distribution of deepfakes but also assist in identifying anonymous site operators — who city officials claim are currently “hiding in the shadows.” One site (whose operator remains unknown), advertised, “Imagine wasting time taking her out on dates when you can just use” a deepfake site “to get her nudes.”