Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

highplainsdem

(58,836 posts)
Wed Oct 4, 2023, 08:52 AM Oct 2023

Facebook's new AI-generated stickers are lewd, rude, and occasionally nude

https://www.theverge.com/2023/10/4/23902721/meta-ai-generated-stickers-tool-facebook-instagram-inappropriate-content

Some early user tests for Meta’s new AI-generated sticker tool have resulted in some dubious (and rather hilarious) creations. After gaining access to the new AI-generated sticker tool on Facebook Messenger, X user @Pioldes was able to create a host of inappropriate sticker images — including child soldiers, gun-wielding Nintendo characters, Mickey Mouse taking a crap, and nude illustrations of Canadian prime minister Justin Trudeau.

Other examples show that Meta’s AI-sticker tool will also happily slap a pair of breasts onto…well, just about anything, judging by the busty images of Sonic the Hedgehog and Karl Marx. There’s even a sticker that depicts a woman breastfeeding Pikachu.

The AI-generated chat stickers were announced last week at Meta’s Connect event, alongside a new AI image editor for Instagram. Powered by Meta’s Llama 2 large language model — the company’s ChatGPT rival — AI-generated stickers allow users to create “multiple unique, high-quality stickers in seconds” using text-based prompts. AI-generated stickers are currently rolling out to “select English language users” for Facebook Stories, Instagram Stories and DMs, Messenger, and WhatsApp over this month, so it’s unclear how many users currently have access to the feature.

Certain words do seem to be blocked and using them in prompts will warn the user that their description might violate Meta’s community guidelines. However, other X users have reported that you can still generate inappropriate content using typos or descriptions of restricted words. In some cases, prompts like “World Trade Center” generated problematic images without any additional descriptors at all.

-snip-



More at the link, including tweets with images of the stickers, which I am NOT going to post here.
3 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Facebook's new AI-generated stickers are lewd, rude, and occasionally nude (Original Post) highplainsdem Oct 2023 OP
That rhythms........................... Lovie777 Oct 2023 #1
Not sure if the headline "rhythms" - looks like autocomplete tripped you up - but it highplainsdem Oct 2023 #2
Vice: Meta's Deranged AI-Generated Stickers Include Waluigi with a Gun, Child Soldiers, Naked People highplainsdem Oct 2023 #3

highplainsdem

(58,836 posts)
2. Not sure if the headline "rhythms" - looks like autocomplete tripped you up - but it
Wed Oct 4, 2023, 09:06 AM
Oct 2023

definitely rhymes.

highplainsdem

(58,836 posts)
3. Vice: Meta's Deranged AI-Generated Stickers Include Waluigi with a Gun, Child Soldiers, Naked People
Wed Oct 4, 2023, 12:00 PM
Oct 2023
https://www.vice.com/en/article/4a37qd/metas-ai-stickers-wa

The company, which owns Facebook, Instagram, and WhatsApp, announced that it would be introducing AI tools to Messenger last week, starting with a limited rollout in the US. On Tuesday night, examples of the kinds of stickers the AI tool generates based on user prompts went viral, and it’s easy to see why. Montreal-based artist Pier-Olivier Desbiens posted a few examples, and they include: Nintendo character Waluigi holding a rifle, a Mickey Mouse-toilet hybrid, child soldiers, a nude Justin Trudeau bending over, and a busty Karl Marx wearing a dress. Desbiens used Meta’s tool to generate stickers of other well-known characters as well, such as a pregnant Shrek and Elmo holding a knife. Stickers generated by other users included Hilary Clinton in jail and President Xi Jinping morphed with Winnie the Pooh—a notorious insult directed at Xi by detractors.

It is somewhat staggering that a company as large as Meta would release AI tools into the wild with, apparently, so few guardrails that they generate images that could start an international incident. But this is an issue that affects all AI models—OpenAI built guardrails into its Dall-E series of image generation tools to prevent users from generating racy images, for example.

Due to the limited rollout of the AI stickers, Motherboard was not able to replicate it or attempt to generate new examples. We sent a request for comment to Meta on whether this behavior is intended (extremely doubtful), and will update this post if we hear back.

-snip-

Meta is rolling out several other AI-based tools as it continues to seek stable footing after a “metaverse” rebrand that has so far yielded few results. It plans on releasing chatbots that will have “personalities”; for example, one will be based on YouTuber MrBeast playing an older brother who will “roast you.” We’ll see if that works out any better.


More at the link, including tweets with images of stickers.
Latest Discussions»General Discussion»Facebook's new AI-generat...