While Meta is working on ways to automatically detect such content, it also requires users to label AI-generated content on the platform. The majority of images do not indicate on the post or page that they were generated by AI.
Mehta did not respond to requests for comment.
Information researchers are increasingly concerned about the impact of flooding social platforms with unchecked AI images, as generative AI technologies make it easier to spread misleading content and outright disinformation.
According to comments found in many posts, certain characteristics of AI-generated art could make it easier to distinguish between real and synthetic images, but there is currently no systematic labeling. Therefore, some users, especially the elderly, are being fooled by fake content. Although these Facebook pages do not indicate a clear motive for AI spam, users have already flagged possible fraudulent activity.
The Stanford University study, which has not yet been peer-reviewed, found that some of the images, posted from Facebook pages, were stolen from other people and organizations, including a Georgia church and a windmill dealer, and reused in AI spam. It also became clear that page.
One such page is now filled with AI images of Jesus and a flight attendant, along with the name of a North Carolina high school band. Davie County Schools spokeswoman Karen Jarvis confirmed in an email that the “Davie High School War Eagle Band” page is not affiliated with the school, which has now been forced to create a new page.
“This was actually the original DCHS band Facebook page, but it was hijacked from our high school band and has since become what you see today,” Jarvis wrote. “There were countless attempts (from band directors, school officials, current band members, and alumni) to take back control and report the page and images, but Facebook did not respond.”
This phenomenon has led some observers to speculate that the page may be guiding gullible users to identify potential scam targets.
“AI-generated content appears to be a boon for spammers and fraudsters because images are easy to generate, often visually sensational, and “This is because it attracts engagement.”
In addition to engaging with genuine commenters, these pages utilize a “corpse of inauthentic followers” to make themselves appear more legitimate, and fraudulent accounts sometimes They say they ask for personal information and try to sell fake products.
A search by NBC News found multiple replies from accounts asking to be friends with commenters, each using a similar script. One commenter wrote: very cute! ! ” I posted an AI-generated image of a toddler cuddling with a basket of kittens, and within hours I received a reply from a recently created account by the name Stephen Townsend. The account responded to a request for comment. However, other than the profile and cover photo uploaded on the same day, no personal information or posts were displayed.
“Hello, to be honest, I’m really impressed with your profile and personality. I also admire your sense of humor here. I don’t usually write in the comments section, but you did this I think you deserve a compliment,” the profile replied. “I want to be friends with you. Please send me a friend request. If you don’t mind. Thank you.”
This is the same style of commenting seen across Facebook, typically left in replies to comments on popular AI posts, as well as directly on users’ profile pages. Some users, who suspect that these pages are promoting potential fraudulent campaigns, have posted comments warning that it may be difficult to tell that certain images are generated by AI. I’m leaving it.
Hazel Thayer, a Facebook user who noticed strange images in her feed a few weeks ago and shared some of them on TikTok, says she now sees an AI like this on probably every 10 posts. He said he started receiving images. Only he got one. So he had 4 posts. ”
And from her point of view, it certainly looks like a fake activity.
“Because when you see these shrimpy Jesus comments, people say, ‘Amen,'” Thayer said. “I don’t think anyone would shout ‘Hallelujah’ to our shrimp master.”
