AIQ: The Tech Edition

The Anti-Social Network

Social media companies face reckoning over hate speech

Facebook, Twitter and other platforms are drawing criticism for their failure to tackle hate content. But will the hit to their reputation do any lasting commercial damage?

In April 2021, English football announced a boycott of social media. Players, coaches and pundits from across the sport shunned Twitter, Facebook and Instagram for four days in protest against racism on these platforms. Corporate sponsors including Adidas and Barclays also took part in the boycott.

This was just the latest episode in a wider backlash against social media companies over their failure to tackle hate speech. In July 2020, more than 1,000 prominent advertisers launched a month-long boycott of Facebook as part of the #StopHateForProfit campaign, pressing the firm to do more to stamp out racist content in the wake of George Floyd’s murder and the Black Lives Matter protests.1

Despite these controversies, social media companies continue to enjoy the confidence of the market. Share prices have risen in line with the wider tech sector amid growing demand for online tools, even as the bricks-and-mortar economy suffers under COVID-19 restrictions. But as advertisers pull out, users log off and regulators circle, some investors are warning the persistence of hate speech on social media could yet pose a serious threat to the future of the tech giants.

Real-world effects

As defined by the United Nations, hate speech encompasses “any kind of communication in speech, writing or behaviour, that attacks or uses pejorative or discriminatory language with reference to a person or a group on the basis of who they are”. This might include their religion, ethnicity, nationality, race, gender, sexuality or any other identity factor.2

Internet hate speech has real-world effects, making it a fundamental human rights issue. In Germany, a correlation was found between anti-refugee posts on Facebook by the far-right Alternative für Deutschland party and physical attacks on refugees.3

Internet hate speech has real-world effects, making it a fundamental human rights issue

The perpetrators of racist mass shootings in the US and elsewhere have publicised their acts to supporters on the major social media sites and even used the platforms to broadcast videos of their crimes. The shooter who murdered 51 people at two mosques in Christchurch, New Zealand, in March 2019 streamed a video of the attacks using Facebook Live, and clips of the footage spread quickly across Facebook and YouTube.4

While this sort of activity tends to get taken down relatively swiftly, Facebook only blocked white nationalist content as a matter of policy in the immediate aftermath of the Christchurch attacks.5 YouTube and Twitter allowed Ku Klux Klan leader David Duke to post on their networks for years before finally banning him in 2020.6

Social media firms have global reach and hate speech is a global problem. In Myanmar, military personnel used Facebook to spread propaganda demonising Rohingya Muslims ahead of a campaign of ethnic cleansing, according to a UN investigation. In India, lynch mobs have used Facebook-owned messaging service WhatsApp to coordinate attacks.7

Echo chambers

Some experts blame social media business models. Social networks encourage like-minded individuals to gather, to target them more efficiently with advertisements. But as algorithms push users towards content that aligns with their pre-existing views, echo chambers can form. Without the corrective offered by opposing opinions or moderating voices, rhetoric can quickly spiral towards extremes.

Each social media platform has its own rules over what is permissible

Each social media platform has its own, more or less stringent, rules over what is permissible. Facebook’s guidelines are relatively detailed, while YouTube and Twitter also have clear guidelines over what should be removed – any incitement to violence is off-limits – and what should be allowed to remain with content warnings attached (this includes certain forms of hate speech).

Enforcement of these rules is patchy, however. To varying degrees, social media firms rely on three methods of policing content: artificial intelligence, human moderators and user reporting. The algorithms used to detect and delete content that violates the rules are opaque. Human moderators, meanwhile, can quickly become overwhelmed by the thankless task of sifting through reams of disturbing content, which takes its toll on their mental health. 

Tougher regulation

As global businesses whose operations span countries with very different laws on freedom of expression, social media companies must tread a fine line when deciding which content to ban or to flag as harmful.

President Donald Trump was banned from both Twitter and Facebook after he contested Joe Biden’s presidential election victory and incited a riot by his supporters at the US Capitol building in Washington DC in January 2021. Twitter said Trump’s tweets around this time “were highly likely to encourage and inspire people to replicate the criminal acts that took place at the US Capitol”.8

Social media firms drew criticism for their delay in banishing Trump and for censoring free speech

In some quarters, the social media firms drew criticism for their delay in banishing Trump; in others, they were criticised for censoring free speech. Facebook CEO Mark Zuckerberg has asked governments to devise a consistent set of rules for Internet companies, including guidelines on how to deal with harmful content. The company has also set up an independent oversight panel – dubbed Facebook’s Supreme Court – to review content management decisions and potentially overturn them.9 In May 2021 the panel upheld Trump’s suspension, but said the indefinite nature of the ban was unusual and called on Facebook to be more transparent in its decision-making process.10

From the tech companies’ perspective, a worst-case scenario would be an amendment to Section 230 of the US Communications Decency Act, according to which technology companies are currently immune from prosecution from harmful or defamatory content published by third parties on their platforms. For its part, the European Commission is drawing up legislation that will force tech giants to remove illegal content or face the threat of sanctions under a comprehensive Digital Services Act due to be unveiled at the end of 2021.

Commercial impact

Even if they manage to avoid costly regulatory sanctions, it is likely big technology companies will have to invest much more heavily in content-management initiatives in the future, from improved automated systems to new armies of human moderators.

Advertising boycotts could also have a growing impact over time, given ad sales make up the vast majority of social media companies’ revenues (see Figure 1), though the impact so far has been small. Facebook’s ad revenues actually increased during the boycott in July 2020, partly because its customers are mostly local, “mom-and-pop” businesses that did not participate in the walk-out.

Figure 1: Leading source of revenue for tech companies (per cent)
Source: Facebook, Twitter, Alphabet, Apple, Amazon, Microsoft, March 2020

That’s not to say the boycott will not work in forcing changes at Facebook’s handling of hate speech, however. YouTube responded to an ad boycott in 2017 by tweaking its algorithms to curb extreme content.

This example shows tech companies will respond when sufficient external pressure is applied, indicating investor engagement could bear fruit. And the fate of the tech companies is certainly an issue of increasing significance to investors, for financial as well as ethical reasons. The five biggest technology companies (Alphabet, Amazon, Apple, Facebook and Microsoft) accounted for about 22 per cent of the total market capitalisation of the S&P 500 as of May 1, 2021.11

More and more investors are beginning to question the social media firms over content

With both moral and financial risks at stake, more investors are beginning to question the social media firms over content. Louise Piffaut and Charles Devereux, ESG analysts at Aviva Investors, set out a framework for engaging with these companies in key areas. They recommend investors should ensure social media firms are properly assessing how their operations affect human rights, developing more robust content policies in light of these principles and demonstrating how these are enforced.

Investors should also engage with social media firms to improve internal accountability and provide more transparency as to their actions on hate speech. Investment in more sophisticated detection algorithms would lessen the burden on human moderators, the analysts say.

While social media companies in the West face criticism for being lax in shutting down abusive content on their platforms, technology firms in other countries, such as China or Russia, may be too quick to restrict debate at the behest of authoritarian governments. In those cases, the onus is on investors to pressure companies to defend individual freedoms and maintain their access to information where possible.

Domino effect

Striking the right balance when engaging globally with social media companies over content management may be tricky, but investors must be willing to do this if they are to invest according to their own moral framework and defend the value of those investments. After all, if hate speech is allowed to flourish, calls will grow to rein in the social media firms with stronger regulation, and perhaps even to break them up.

Biden criticised Facebook's content-management policies and ordered it to “move fast and fix it”

During the election campaign in 2020, President Biden signalled he would take a tough line on Facebook. In June, he wrote an open letter to the company in which he criticised its content-management policies and ordered it to “move fast and fix it”, referring to the problems of hate speech and misinformation; he and his supporters disseminated this slogan on the network.12

Whether or not regulators decide to break up the larger tech companies – and a recent court ruling in Washington presents a blow to this – there is a possibility users could become disaffected by the increasingly poisonous atmosphere on social media platforms. This could create a negative feedback loop, whereby a decline in user engagement removes the incentive for companies to pay for ads over the long run.

There are already signs users don’t value Facebook particularly highly in monetary terms. Consider a recent study led by Erik Brynjolfsson, director of the Initiative on the Digital Economy at the Massachusetts Institute of Technology. It asked people how much they would have to be paid to forgo search engines for a year; respondents offered an average figure of $17,500. The same respondents were willing to give up access to Facebook for less than $600.13

Hate speech threatens to trigger a domino effect among Facebook’s users, advertisers and investors

To grasp the risk of a user exodus, one only needs to consult Mark Zuckerberg himself, or at least his fictional alter ego in the 2010 biographical film, The Social Network. In a key scene, Zuckerberg frets about how quickly the fortunes of his company could turn: “Users are fickle,” he says. “Even a few people leaving would reverberate through the entire user base. The users are interconnected. That is the whole point. College kids are online because their friends are online. And if one domino goes, the other dominos go. Don't you get that?”

As hate speech threatens to trigger a domino effect among Facebook’s users, advertisers and investors, the real Zuckerberg would do well to heed the warning.

Would you like to read the whole of AIQ: The Tech Edition?

Subscribe to download a PDF copy or get a printed edition delivered directly to you.

Thank you for requesting a copy of our latest AIQ. We will send this to you shortly.

To keep up-to-date with our latest insights, please visit our main views page.

Please enable javascript in your browser in order to see this content.

Please select the format you wish to receive.

If you wish to receive a printed copy of AIQ, please enter your full postal address below.

I acknowledge that I qualify as a professional client or institutional/qualified investor. By submitting these details, I confirm that I would like to receive a digital and/or printed copy of the latest AIQ and receive thought leadership email updates from Aviva Investors, in addition to any other email subscription I may have with Aviva Investors. You can unsubscribe or tailor your email preferences at any time.

For more information, please visit our Privacy Policy.

Important information

Except where stated as otherwise, the source of all information is Aviva Investors Global Services Limited (AIGSL). Unless stated otherwise any views and opinions are those of Aviva Investors. They should not be viewed as indicating any guarantee of return from an investment managed by Aviva Investors nor as advice of any nature. Information contained herein has been obtained from sources believed to be reliable but has not been independently verified by Aviva Investors and is not guaranteed to be accurate. Past performance is not a guide to the future. The value of an investment and any income from it may go down as well as up and the investor may not get back the original amount invested. Nothing in this material, including any references to specific securities, assets classes and financial markets is intended to or should be construed as advice or recommendations of any nature. This material is not a recommendation to sell or purchase any investment.

In Europe this document is issued by Aviva Investors Luxembourg S.A. Registered Office: 2 rue du Fort Bourbon, 1st Floor, 1249 Luxembourg. Supervised by Commission de Surveillance du Secteur Financier. An Aviva company. In the UK Issued by Aviva Investors Global Services Limited. Registered in England No. 1151805. Registered Office: St Helens, 1 Undershaft, London EC3P 3DQ. Authorised and regulated by the Financial Conduct Authority. Firm Reference No. 119178. In France, Aviva Investors France is a portfolio management company approved by the French Authority “Autorité des Marchés Financiers”, under n° GP 97-114, a limited liability company with Board of Directors and Supervisory Board, having a share capital of 17 793 700 euros, whose registered office is located at 14 rue Roquépine, 75008 Paris and registered in the Paris Company Register under n° 335 133 229. In Switzerland, this document is issued by Aviva Investors Schweiz GmbH.

In Singapore, this material is being circulated by way of an arrangement with Aviva Investors Asia Pte. Limited (AIAPL) for distribution to institutional investors only. Please note that AIAPL does not provide any independent research or analysis in the substance or preparation of this material. Recipients of this material are to contact AIAPL in respect of any matters arising from, or in connection with, this material. AIAPL, a company incorporated under the laws of Singapore with registration number 200813519W, holds a valid Capital Markets Services Licence to carry out fund management activities issued under the Securities and Futures Act (Singapore Statute Cap. 289) and Asian Exempt Financial Adviser for the purposes of the Financial Advisers Act (Singapore Statute Cap.110). Registered Office: 1 Raffles Quay, #27-13 South Tower, Singapore 048583. In Australia, this material is being circulated by way of an arrangement with Aviva Investors Pacific Pty Ltd (AIPPL) for distribution to wholesale investors only. Please note that AIPPL does not provide any independent research or analysis in the substance or preparation of this material. Recipients of this material are to contact AIPPL in respect of any matters arising from, or in connection with, this material. AIPPL, a company incorporated under the laws of Australia with Australian Business No. 87 153 200 278 and Australian Company No. 153 200 278, holds an Australian Financial Services License (AFSL 411458) issued by the Australian Securities and Investments Commission. Business Address: Level 30, Collins Place, 35 Collins Street, Melbourne, Vic 3000, Australia.

The name “Aviva Investors” as used in this material refers to the global organization of affiliated asset management businesses operating under the Aviva Investors name. Each Aviva investors’ affiliate is a subsidiary of Aviva plc, a publicly- traded multi-national financial services company headquartered in the United Kingdom. Aviva Investors Canada, Inc. (“AIC”) is located in Toronto and is registered with the Ontario Securities Commission (“OSC”) as a Portfolio Manager, an Exempt Market Dealer, and a Commodity Trading Manager. Aviva Investors Americas LLC is a federally registered investment advisor with the U.S. Securities and Exchange Commission. Aviva Investors Americas is also a commodity trading advisor (“CTA”) registered with the Commodity Futures Trading Commission (“CFTC”) and is a member of the National Futures Association (“NFA”). AIA’s Form ADV Part 2A, which provides background information about the firm and its business practices, is available upon written request to: Compliance Department, 225 West Wacker Drive, Suite 2250, Chicago, IL 60606.

Related views