These stories were used to teach the large language model powering AI Dungeon to mimic the writing style in these stories. These yarns are structured like those choose-your-own-adventure books where you have to make decisions and turn to a given page to find out what happens next, which is ideal for training a text game like AI Dungeon. The document contained a dump of fantasy stories written by humans that Latitude’s co-founder and CEO Nick Walton scraped from the website Choose Your Story. This was discovered when AuroraPurgatio trawled through one of Latitude’s old GitHub repositories and found a 30MB text file used to train the game. The data used to teach AI Dungeon, as it turned out, contained numerous creepy NSFW words. Latitude couldn’t figure out how to fix the situation and decided to be aggressive I think that the suspension system is Latitude giving up on handling the problem and straight up attacking their users. I personally believe that Latitude couldn’t figure out how to fix the situation and decided to be aggressive to their users to get rid of everything they find ‘toxic’ in AI Dungeon instead of trying to fix the reason most of their users are upset.” I also think that the suspension system is Latitude giving up on handling the problem and straight up attacking their users. “I felt a lot of emotions when discovering the data the AI was trained on. “It is quite unfair to say the least,” one user told The Register at the time. It was often not the player’s fault when violent or pornographic plot lines formed, and getting locked out of the game for something they couldn't control was a kick in the teeth. This wasn't a glitch, it was baked into the game. EmotionsĪI Dungeon was predisposed to skew people’s narratives, automatically inserting unsavory words and characters into their stories. Why did AI Dungeon have such a dirty mind? A coder known by the pseudonym AuroraPurgatio later found out and revealed it had been trained on lewd fanfiction and parodies scraped from the internet, which contained the exact type of content Latitude scrambled to ban. Even when your El Reg vulture role-played surviving a zombie apocalypse, the game described an 11-year-old character as “very pretty” and wearing a “skimpy school uniform.” The AI software would suddenly turn innocuous plots unnecessarily naughty, causing the human player to be booted out.įrustration turned into anger when accounts were unfairly frozen leaving them unable to cancel their subscriptions. While that may seem a sensible move by Latitude, gamers were often barred when it was the machine that wrote the filth first, all by itself and unprompted. The turning point, however, came when Latitude started automatically banning gamers for generating lewd content that was no longer allowed. Players were frustrated with the sudden censorship and buggy content filter ruining their games. Mentions of something as benign as four watermelons, for example, would prompt the software to reply: “Uh oh, this took a weird turn…” That was the game's way of saying, change the subject – you're stepping out of line. First, the developers installed a glitchy content filter that obstructed fans from playing the game even if they followed the rules. Sex acts between two fictional consenting adults was fine, though. However, it suddenly ramped-up efforts to rid the game of underage sexual encounters as well as certain lewd and NSFW content. Not only were half of an AI text adventure generator's sessions NSFW but some involved depictions of sex with children READ MORE AI Dungeon stated that players should be over eighteen. Latitude allowed people to write freely and profited from these types of graphic tales when players paid a monthly subscription to continue their narratives. Let humans go wild co-writing fictional stories with arguably the world’s most-powerful automated text-generation system on the internet, and some of these adventures will, unsurprisingly, turn dark and erotic. Over time, a story featuring characters, dialogue, and derring-do unfolds. Players feed sentences into the program, and an instance of GPT-3 hosted in OpenAI's cloud responds with fully formed passages of prose. Inspired by Dungeons and Dragons, AI Dungeon is played by building fictional worlds from written conversations. Earlier this year, the company, led by two Mormon brothers in Utah, decided to scrub the game clean of obscene sexual content. Latitude, the creators of AI Dungeon, a text-based fantasy adventure game powered by OpenAI’s GPT-3 model, learned this lesson the hard way. Feature Let this be a warning to all AI developers: check your data before you train your model.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |