AI Dungeon fans blast Latitude for developer’s new sex filters

AI Dungeon is an infinite, procedurally generated sport by which gamers create a traditional textual content adventure-style narrative by writing ingenious or intelligent prompts. In a latest replace, AI Dungeon developer Latitude applied a brand new system that stops the sport from producing sexual content material involving minors — and the neighborhood is outraged on the implementation.

The system (which the developer is at present testing) was designed to detect “specific content material involving descriptions or depictions of minors.” In that circumstance, AI Dungeon will inform the participant “Uh oh, this took a bizarre flip…” and power them to attempt different prompts. In line with a press release from Latitude, the system solid a far wider internet than anticipated, typically blocking the procedural era of tales involving youngsters or something associated to particular phrases like “5 years previous.”

On Tuesday, Latitude posted an extended weblog explaining the replace in an try to assuage the neighborhood’s largest issues.

Yesterday, we launched a take a look at system to forestall the era of sure sexual content material that violates our insurance policies, particularly content material which will contain depictions or descriptions of minors (for which we’ve got zero tolerance), on the AI Dungeon platform. We didn’t talk this take a look at to the Group prematurely, which created an setting the place customers and different members of our bigger neighborhood, together with platform moderators, have been caught off guard. Due to this, some misinformation has unfold throughout Discord, Reddit, and different elements of the AI Dungeon neighborhood. In consequence, it grew to become tough to carry the conversations we need to have about what sort of content material is permitted on AI Dungeon.

The developer stated that the take a look at had unintended implications, writing: “Whereas this take a look at has largely solely prevented the AI from producing sexual content material involving minors, due to technical limitations it has typically prevented the era of content material that it wasn’t meant to.”

Followers have been reacting to those modifications — each the meant objective and unintended uncomfortable side effects — on Latitude’s social media. A few of these posts are memes that are supposed to be a easy dunk on the developer and little else, whereas different posts seem to mirror authentic anger.

Customers have been sharing examples of their tales coming to a sudden finish when the take a look at system appears to detect controversial content material … even when there clearly isn’t any. AI Dungeon permits for limitless roleplay and storytelling potentialities, and Latitude helps different NSFW materials, together with intercourse, violence, and swearing. Some gamers really feel alarmed that their non-public fiction with grownup themes might be topic to moderation and skim by one other individual from the event crew. Latitude stated that its system will flag doubtlessly rule-breaking posts, which might then be additional reviewed by a workers member.

“Latitude opinions content material flagged by the mannequin for the needs of enhancing the mannequin, to implement our insurance policies, and to adjust to regulation,” the developer stated. In response to the query “Is Latitude studying my unpublished adventures?” the developer wrote, “We constructed an automatic system that detects inappropriate content material.” We’ve reached out to Latitude for remark and clarification.

This has customers nervous about their safety and privateness, particularly in the event that they’ve submitted weak or private info into the AI Dungeon system. For now, the take a look at system remains to be in place.