Challenges Of AI-Driven Disinformation - Insights from TechCrunch Disrupt 2023

However, with the emergence of generative AI tools, mitigating the surge of disinformation has become increasingly challenging. A riveting discussion at TechCrunch Disrupt 2023's AI panel, featuring Sarah Brandt from NewsGuard and Andy Parsons of Adobe's Content Authenticity Initiative (CAI), highlighted this very concern, especially in the face of upcoming elections.

Parsons candidly emphasised the gravity of the situation, asserting that shared, objective truth is the backbone of any democracy. Without it, the very foundation of democratic conversations is at risk.

While Brandt and Parsons both conceded that disinformation isn't a novel concern, AI's role in it certainly is. Parsons reminisced about the manipulated 2019 video of Nancy Pelosi, but Brandt drew attention to a growing concern: AI, especially generative AI, is drastically simplifying the creation and mass distribution of fake news. NewsGuard's findings are alarming: hundreds of unreliable, AI-driven websites have been detected, some publishing thousands of articles daily.

But why this sudden increase in AI-manufactured content? Parsons provides clarity: "It's largely about volume and revenue. Many aim to flood search engines, hoping to generate ad revenue, while others have malicious intentions of spreading misinformation."

Moreover, a recent NewsGuard study highlights a potential concern with OpenAI's text-generating model, GPT-4. Compared to its predecessor, GPT-3.5, GPT-4 seems more adept at propagating convincing yet deceptive narratives across various formats.

So, how can we address this growing challenge?

Parsons indicates that Adobe, with its AI suite Firefly, actively integrates preventive measures against misuse. The CAI, co-founded by Adobe, the New York Times, and Twitter in 2019, encourages a consistent industry standard for data provenance. But its voluntary nature doesn't guarantee universal adoption or that it can't be sidestepped.