Mark Zuckerberg’s Secret Weapon For AI Is Your Facebook Data

(Bloomberg Opinion) -- For many people, Facebook the internet, and the number of its users is still growing, according to Meta Platforms Inc.’s latest financial results. But Mark Zuckerberg isn’t just celebrating that continuing growth. He wants to take advantage of it by using data from Facebook and Instagram to create powerful, general-purpose artificial intelligence. Sounds great and Meta is well positioned to do it, but his billions of users may end up paying the price with their privacy and more. 

Here’s how Zuckerberg teased his next move in AI on Thursday: 

.”

The point that Zuck makes here about “Common Crawl” startled observers in the tech press, because that archive is already huge: 250 billion web pages spanning 17 years. It’s one of the biggest and most popular repositories of the public internet used for training AI systems today. When OpenAI launched its GPT-3 language model in 2020, close to 60% of the text used to train the system came from Common Crawl. 

But Meta’s data mountain is even bigger, which means it could theoretically build “smarter” AI. That’s because research has shown that training AI models on more data tends to make them more capable and accurate. That formula has worked wonders for OpenAI, which over the years has increased the amount of data used to create models like ChatGPT.  

If Zuckerberg wants to make a more powerful chatbot, the pile of data he’s sitting on is especially valuable because so much of it comes from comment threads. Any text that represents human dialogue is critical for training so-called conversational agents, which is why OpenAI heavily mined the internet forum Reddit Inc. to build its own popular chatbot. 

It’s easy to scoff whenever Zuckerberg talks about a new ambition -- whether it’s bots or crypto or the metaverse. His latest quixotic vision is especially grand: to build “general intelligence,” or software systems that meet or surpass human intelligence. But with all that data, Zuckerberg’s quest looks doable. The problem is what the fallout could be for the rest of us.

It’s odd that in the same message where Zuckerberg said that his AI team had been working on building general intelligence “for more than a decade,” he also said that Facebook would only now turn to its user’s data to build models as “the next key part of our playbook.” Why hasn’t Meta done that already? Perhaps because using all that data isn’t so straightforward. For one thing, it would represent yet another infringement on the privacy of Facebook’s 3 billion users and Instagram’s 1.5 billion users. In the same way OpenAI has come under fire for scraping up the copyrighted data of artists and writers to train its models, Facebook stands to face reputational blowback for exploiting people’s data all over again. Not only does that raise thorny ethical questions, doing so could require stringent data handling practices and compliance with global data protection laws, which could raise the hackles of European regulators.

The other issue is all the bias and toxicity in the data. OpenAI had to deal with this issue with Common Crawl, whose vast trove included web pages like adultmovietop100.com and adelaide-femaleescorts.webcam, according to a 2021 study by the University of Montreal. The same study says that between 4% and 6% of all the websites in Common Crawl included racial slurs, hate speech, or racially charged conspiracy theories. 

While Facebook’s content-moderation software has become better at blocking hate speech and conspiracy theories, it’s not perfect and tends to be worse in countries outside the United States. Some of the content on Facebook that gets flagged as toxic doesn’t get reviewed by a human anymore and is left on the site. Worse: When Zuckerberg said that Meta’s data was bigger than that of Common Crawl, he was likely lumping in the company’s historic archive that would include all the hyperbolic political content and fake news that were on the site before Zuckerberg took pains to clean it up.

All the work that must go into careful data handling and checking might explain why Zuckerberg has only now talked about capitalizing on the data mountain that he sits on. If he doesn’t do it properly, he risks reliving the nightmare of public criticism about how Facebook has handled fake news and harmful content. 

Still, if there’s one thing we know about Zuckerberg, it’s that he has a Caesar-like obsession with winning and domination. Last week, about 24 hours after he faced a crowd of parents in Washington, D.C. who accused him of leading their children to self-harm or even suicide, he went on to announce one of Meta’s most successful financial quarters yet and tease how he’d use people’s data to create powerful AI.

The proximity of those events should serve as a reminder: Facebook’s path to riches has hurt many. So too might its road to building powerful AI. 

More From Bloomberg Opinion:

• A Revived Meta Buys the Permission to Keep Spending: Dave Lee
• Elon, Please Keep the Internet Out of Our Brains: Parmy Olson
• Sam Altman's Open AI Leadership Is All Too Human: Tim O'Brien

This column does not necessarily reflect the opinion of the editorial board or Bloomberg LP and its owners.

Parmy Olson is a Bloomberg Opinion columnist covering technology. A former reporter for the Wall Street Journal and Forbes, she is author of “We Are Anonymous.”

More stories like this are available on bloomberg.com/opinion

©2024 Bloomberg L.P.