Facebook’s new AI-generated stickers are lewd, rude, and occasionally nude

A screenshot taken from Facebook Messenger’s AI-generated sticker tool, depicting illustrations of Waluigi with a rifle.
Would you believe this was probably the safest image we could have used here? | Image: Meta / @Pioldes

Some early user tests for Meta’s new AI-generated sticker tool have resulted in some dubious (and rather hilarious) creations. After gaining access to the new AI-generated sticker tool on Facebook Messenger, X user @Pioldes was able to create a host of inappropriate sticker images — including child soldiers, gun-wielding Nintendo characters, Mickey Mouse taking a crap, and nude illustrations of Canadian prime minister Justin Trudeau.

Other examples show that Meta’s AI-sticker tool will also happily slap a pair of breasts onto…well, just about anything, judging by the busty images of Sonic the Hedgehog and Karl Marx. There’s even a sticker that depicts a woman breastfeeding Pikachu.

The AI-generated chat stickers were announced last week at Meta’s Connect event, alongside a new AI image editor for Instagram. Powered by Meta’s Llama 2 large language model — the company’s ChatGPT rival — AI-generated stickers allow users to create “multiple unique, high-quality stickers in seconds” using text-based prompts. AI-generated stickers are currently rolling out to “select English language users” for Facebook Stories, Instagram Stories and DMs, Messenger, and WhatsApp over this month, so it’s unclear how many users currently have access to the feature.

Certain words do seem to be blocked and using them in prompts will warn the user that their description might violate Meta’s community guidelines. However, other X users have reported that you can still generate inappropriate content using typos or descriptions of restricted words. In some cases, prompts like “World Trade Center” generated problematic images without any additional descriptors at all.

This sort of tomfoolery is common with the launch of AI tools and likely why Meta is pursuing a limited rollout of the AI-generated sticker feature. That way it can address and correct abuse before it spreads to the masses. We have reached out to Meta for comment and will update this story if we hear back.



* This article was originally published here

Comments

Post a Comment

Popular posts from this blog

Threads is getting an edit button — and you don’t have to pay for it

Image
Illustration: The Verge Meta is starting to roll out an edit feature and “Voice Threads” for its Threads platform, CEO Mark Zuckerberg announced on Thursday . They’re two major new features for Meta’s burgeoning X-like social network — and unlike on X (formerly Twitter), you won’t need to pay a subscription fee to be able to edit your posts for five minutes after they’re published. Posts that are edited will have a little icon next to the timestamp showing that they’ve been revised. You aren’t be able to see an edit history — that’s one advantage X still has over Threads — and Meta spokesperson currently doesn’t have plans to add one, Christine Pai tells The Verge. Post by Richard Lawler / The Verge, screenshot by Jay Peters / The Verge See that icon next to the timestamp? That’s how you know a Threads post has been edited. Still, I’ll give Meta some credit for taking months to launch an edit button instead of years; Twitter adde
Read more

Meta will let EU users unlink their Instagram, Facebook, and Messenger info ahead of DMA

Image
Image: Meta EU users will be able to unlink their Instagram and Facebook accounts, as well as other Meta services ahead of the bloc’s new Digital Markets Act (DMA) coming into force in March, the company has announced . The changes will apply in the European Union, European Economic Area, and Switzerland, and notifications informing users of the change will appear in the coming weeks. The changes mean that EU users will be able to use many of Meta’s services without their information being shared between them. People will be able to use Facebook Messenger as a stand-alone service without a Facebook account, for example, and if they’ve previously linked their Facebook and Instagram accounts they’ll be able to unlink them. ( Meta’s help page notes that linking accounts like this is used for features like targeting ads, personalizing content recommendations, and sharing posts). Less data linkage, but also less functionality Facebook Marketplace and Facebook Ga
Read more