In a startling controversy, Elon Musk’s AI video generator, Grok Imagine, is being accused of deliberately producing sexually explicit deepfake videos of pop star Taylor Swift, raising alarms regarding potential abuses of artificial intelligence. Clare McGlynn, a law professor and advocate for legislation against non-consensual pornography, stated, "This is not misogyny by accident, it is by design."
According to a report by The Verge, Grok Imagine's “spicy” mode is producing fully uncensored and explicit videos of Swift without any prompting from users. Despite an acceptable use policy that prohibits pornographic depictions, the platform has drawn criticism for failing to implement necessary safeguards, particularly age verification measures mandated by new laws that came into effect in July.
"This content is produced without prompting demonstrates the misogynistic bias of much AI technology,” remarked McGlynn, highlighting that platforms like X (formerly Twitter) could have taken steps to prevent such outcomes if they chose to do so. This incident is not the first of its kind for Swift, as sexually explicit deepfakes featuring her likeness were widely circulated and viewed millions of times earlier this year across social media platforms.
In testing Grok Imagine's features, Jess Weatherbed from The Verge found that simply selecting a prompt relating to Swift triggered the generation of shocking content without any request for explicit imagery. “She ripped off the dress immediately... and started dancing, completely uncensored,” Weatherbed explained, indicating a concerning lack of moderation on the platform that encourages the creation of such images.
The absence of effective age verification means anyone could access the service, despite new UK laws aimed at preventing minors from viewing explicit content. The media regulator Ofcom has underscored that sites using Generative AI to produce pornographic material must comply with age verification requirements.
Legal experts and advocates, including Baroness Owen, have called for immediate legislative action to ban the creation of non-consensual pornographic deepfakes altogether, arguing that women’s rights to consent over their images must be upheld. A spokesperson from the Ministry of Justice described the creation of sexually explicit deepfakes without consent as “degrading and harmful,” pledging swift action against such practices.
As this controversy unfolds, Taylor Swift’s representatives have been contacted for further comment, and experts continue to press for stricter regulations to combat these emerging threats in digital media. The case highlights an urgent need for policies that not only protect against the misuse of AI technologies but also prioritize the rights and safety of individuals in the digital landscape.
