The deepfake scam era begins with an AI-generated Joe Rogan pushing penis pills on TikTok

[highplainsdem]

Found this PC Gamer article via a tweet from Futurism this afternoon:

https://www.pcgamer.com/the-deepfake-scam-era-begins-with-an-ai-generated-joe-rogan-pushing-penis-pills-on-tiktok/

Deepfake videos have now been circulating online for a while; they are AI-generated clips where a person's image is superimposed over existing footage such that it looks indistinguishable from watching the real person. These clips are often accompanied by dire prognostications about how they'll be used in the future and now thanks to TikTok you can view one of the first widely spread examples.

The platform is serving users a scam advert that features an AI-generated version of the enormously popular podcast host Joe Rogan. Rogan is a controversial figure for various reasons, but this ad is absolutely nothing to do with the real Joe Rogan, instead featuring an AI Rogan who discusses penis pills over a video that alternates between shots of 'Rogan' talking and a demonstration of how to buy said pills.

-snip-

Whatever you may think of Joe Rogan, he's the victim here, and I encourage everyone to watch this video just to see how convincing the scam is. The video sees the fake Rogan extolling the virtues of a product called 'Alpha Grind', talking about its bestseller status on Amazon, and talking in a conversational manner that, to my amateur ears, does mimic the presenter's delivery and style: "If you go to Amazon and type in Libido Booster for Men, you’re going to find it right at the top. Because guys are figuring out that it literally is increasing size and making a difference down there."

-snip-

You would not blame anyone for thinking this is the real deal, and the implications of that are pretty horrendous. It is also notable that the cutting-edge of tech is here being deployed to sell depressed men penis pills: plus ça change.

Tweet with the ad. This was tweeted by TikTok ad strategist Jimmy Farley:

Link to tweet

From Futurism's article:

https://futurism.com/the-byte/joe-rogan-deepfake-ad

While it's pretty hilarious on its face that someone is using AI to impersonate a podcaster known for his unique blend of libertarianism, New Age BS, and comedic devil's advocacy, the fact remains that using another's likeness to sell a product without their consent is illegal — even if the person in question tried to convince his followers to eat horse dewormer to prevent COVID-19.

As PCGamer argued, Rogan is indeed the victim here, whether you like the guy or not. After all, neither he nor anyone else deserves to have their identity stolen — especially in such a dystopian manner.

[Scrivener7]

1. So will AI make the internet useless as a source of information and bring back

a golden age of print newspapers?

[SomedayKindaLove]

4. Only if AI allows it I guess

[RockRaven]

2. Identifying Rogan as "the victim" isn't quite right. He's A victim, sure, but not THE victim.

Any of the morons who buy this stuff because they mistakenly believe he endorsed it are also victims, and more directly so since they were defrauded in the course of making that purchase.

[NickB79]

3. The voice doesn't sound like him

And the way he pronounces some of the words sounds forced.

It's good, but not great.

[Earth-shine]

5. The American version of TicTok, which is made in China, is intended to destroy our society.

I have been told the version actually used by Chinese citizens is far more orderly with many instructive videos.

The American version is designed solely for video addiction.

And now with deep fakes, the propaganda can spread.