TikTok Under Fire for Withholding Algorithm Safety Feature

Senators Marsha Blackburn and Richard Blumenthal have sent a sharply worded letter to TikTok’s top executives, questioning the company’s safety record and its algorithm’s role in fueling problematic ‘filter bubbles.’

Source: engadget.com

The letter comes after a report by Bloomberg revealed an experiment the company began in 2021 related to an algorithmic safety feature. The change was meant to help users avoid ‘repetitive patterns’ or ‘filter bubbles’ in its ‘for you’ feed. However, the company withheld the feature for millions of users, using them as a control group to test its impact on engagement.

According to an internal TikTok document, a US teen who died by suicide after his account became part of the control group ‘fell into a filter bubble where his account was recommended a repetitive amount of content surrounding Suicide and Self Harm and depressive topics, particularly leading up to the date of his suicide.’

In their letter, the senators demand that TikTok provide details about the experiment and others like it. They also press the company on whether it ever decided against rolling out a safety feature because of its potential impact on engagement or ad revenue. The company has been given a deadline of September 1 to provide responses.

The senators’ letter highlights the ‘sinister’ nature of TikTok’s actions, stating that the company ‘not only possessed information about the dangers created by its recommendation systems, but deliberately denied millions of users access to a safety intervention so that the company could study the intervention’s impact on engagement.’

Both lawmakers have been closely involved in pushing social media companies for more safeguards for teens and have been major advocates for the Kids Online Safety Act (KOSA). The 2021 experiment began shortly after a TikTok policy official appeared at a Congressional hearing during which Blumenthal and Blackburn urged the company to do more to protect children on its platform.

The senators write, ‘These revelations are appalling, but they are made even more sinister because TikTok was on notice about the effects of its recommendation algorithms on children.’

TikTok has not immediately responded to a request for comment.

Key points from the senators’ letter include:

• TikTok’s experiment in 2021 involved withholding an algorithm safety feature from millions of users to test its impact on engagement.
• The company was aware of the dangers created by its recommendation systems, including the risk of ‘filter bubbles’ that can lead to problematic content.
• TikTok has not provided details about the experiment or other similar tests, despite being given a deadline by the senators.
• The company’s actions have been described as ‘sinister’ by the senators, who argue that TikTok deliberately denied users access to a safety intervention for the sake of engagement and ad revenue.
• The senators are pressing TikTok to provide more information about its safety record and to take steps to protect children on its platform.

The Kids Online Safety Act (KOSA) has been a key focus for the senators, who believe that social media companies have a responsibility to protect children from the potential harms of their platforms.

The 2021 experiment has raised concerns about the impact of social media algorithms on mental health and the need for greater transparency and accountability from companies like TikTok.

As the debate over social media safety continues, the senators’ letter to TikTok highlights the need for greater action to protect children and teenagers from the potential harms of these platforms.