With the EU banning “nudifier” apps in one month, our latest investigation has uncovered a network behind the publication of hundreds of such apps, promoted by thousands of pornographic ads on Meta.

At the beginning of September, we discovered an operation behind over 400+ nudifier apps published on Google Play and the Apple App Store.

To avoid detection, these apps disguise themselves as legitimate (a hair salon or outfit swap). But when the user installs it through a Meta ad, the app becomes sexually explicit, with ready-made abuse templates.

To test what moderation might look like moving forward, we’re introducing Veto, a collaborative game in which you can attempt to get past moderation levels of increasing difficulty, from Hugging Face to OpenAI’s model. (No real images are generated.) Your participation will also help us determine how robust each of these safeguards are.

Try it here: https://veto.aiforensics.org/.