The UK's tech regulator, Ofcom, has ordered social media companies to implement emergency measures to prevent illegal content from going viral, as authorities seek to curb the kind of misinformation that spread after the 2024 summer riots.
New crisis protocols required
Platforms such as X (formerly Twitter) and TikTok will be required to have a 'crisis protocol' in place to intervene when the sharing of dangerous content begins to spike. Under the new rules, online platforms must also establish a dedicated communication channel for police to contact them during a crisis.
Background and concerns
The move follows high-level government concerns about the speed at which misinformation spreads during critical moments. Ofcom's announcement also comes after riots broke out in Southampton over the police response to the fatal stabbing of Henry Nowak.
The idea of forcing social media platforms to have emergency measures ready to stop illegal viral content was suggested by the Commons Science, Innovation and Technology Committee. The committee made the recommendation after an investigation launched following the summer 2024 riots, when misinformation spread rapidly after the murder of three girls at a dance class in Southport.
Committee findings
The committee's report found that 'misleading and hateful messaging proliferated rapidly online, amplified by the recommendation algorithms of social media companies.' Ofcom said it would define a crisis as an 'extraordinary situation in which there is a serious threat to public safety in the United Kingdom,' which is highly likely to have 'resulted from a significant increase in relevant content.'
During a crisis, certain kinds of illegal content and/or content harmful to children can spread rapidly online. In some cases, this can create a significant risk to public safety within the United Kingdom. For example, evidence from previous crisis events illustrates how perpetrators use online services to carry out illegal activity, such as inciting racial or religious hatred, making threats, or inciting violence. This can lead to an increase in the amount of illegal content circulating online and manifest in real-world violence.
Such crises are exceptional, meaning that online service providers' usual content moderation systems and processes may not be sufficient. The bar for implementing these protocols is high, dealing only with outright illegal content. The new measures will come into force after being approved by parliament.
Urgency and additional measures
The move signals the urgency with which both ministers and the regulator are keen to tackle the speed at which misinformation can travel in the often confusing climate of a crisis. Experts examining the flow of dangerous viral content have also pointed to other successful measures for countering fast-moving misinformation. Analysis by the Centre for Emerging Technology and Security (Cetas) found that 'debunking' efforts involving police forces, community leaders, and local councillors could be effective in alerting communities to false information.
Cetas research found that a swift and coordinated response to an incident in Liverpool, where a vehicle hit spectators at Liverpool FC's league title parade in May last year, helped reduce the risk of misinformation running rampant online.
