Australia’s eSafety Commissioner, Julie Inman Grant, has delivered a searing indictment of major social media platforms, alleging they are actively engaged in the distribution and monetisation of “gore” and “fringe content.” Her testimony, presented to the Royal Commission into Antisemitism and Social Cohesion, specifically highlighted the contentious practices of X (formerly Twitter) under its owner, Elon Musk.

Inman Grant told the inquiry on Thursday that her office is locked in a constant battle with X to restrict or remove horrific content, including footage from recent terror attacks such as the Bondi Junction stabbings. The Commissioner’s impassioned plea underscores a growing frustration among regulators worldwide who grapple with the platforms' perceived reluctance to take decisive action against harmful material.

Big Tech's Content Conundrum

The eSafety Commissioner’s evidence paints a grim picture of a digital landscape where algorithms frequently prioritise sensational and extreme content, often to the detriment of public safety and social cohesion. She argued that the existing business models of these platforms incentivise the spread of such material, effectively turning human suffering into profit. “Mainstream platforms are fighting to distribute and monetise ‘gore’ and ‘fringe’ content,” The Guardian Australia reported her as stating. This assertion suggests a deliberate choice by the platforms, driven by engagement metrics and advertising revenue, rather than a mere oversight.

The inquiry heard that X, in particular, has proven a significant challenge for the eSafety office. Inman Grant detailed the ongoing struggles to enforce safety standards and content moderation policies against a company that, under Musk’s leadership, has often championed a more expansive view of “free speech,” even if it includes content deemed offensive or dangerous by regulators. This tension between platform autonomy and regulatory oversight is a recurring theme in the broader debate about online safety.

The Unseen Toll of Online Extremism

The impact of online extremism and antisemitism, amplified by these platforms, was a central focus of the royal commission. The eSafety Commissioner’s testimony brought into sharp relief the tangible consequences of allowing such content to proliferate. The rapid dissemination of graphic images and videos from real-world tragedies, such as the Bondi Junction attack, not only re-victimises those affected but also contributes to an atmosphere of fear and distress within the community.

Experts familiar with content moderation policies suggest that platforms often weigh the potential for viral engagement against the risks of regulatory action or public backlash. However, Inman Grant’s claims suggest that, in many instances, the pursuit of engagement, and by extension, revenue, currently trumps these other considerations. The economic incentive to keep users engaged, regardless of the content, is a fundamental challenge for regulators attempting to curb the spread of harmful narratives and imagery.

A Call for Greater Accountability

Commissioner Inman Grant's appearance before the royal commission serves as a powerful call for greater accountability from social media companies. Her office, established to keep Australians safe online, finds itself in a David-and-Goliath struggle against global tech giants with vast resources at their disposal. The ongoing battle to remove horrific footage, like that from the Bondi attack, highlights the urgent need for more effective mechanisms to compel platforms to act responsibly.

The findings and recommendations of the Royal Commission into Antisemitism and Social Cohesion are expected to carry significant weight, potentially influencing future legislative and regulatory frameworks. The eSafety Commissioner's testimony undoubtedly strengthens the argument for more stringent controls over online content, particularly as it relates to hate speech, extremism, and the gratuitous display of violence. The financial models of these powerful platforms are now squarely in the spotlight, with calls growing for them to prioritise human safety over profit.