TL;DR
Open a free Amazon Business account
Business pricing, bulk buying and tax-exempt orders.
As an affiliate, we earn on qualifying purchases.
Roblox launched an AI-based age verification system last week, but it has quickly become unreliable, misidentifying users’ ages and prompting user revolt. The company claims initial success but faces mounting criticism over accuracy and privacy concerns.
Roblox’s new AI-powered age verification system, launched last week across multiple countries, is facing significant problems, with reports of widespread misidentification and user dissatisfaction. The system, designed to allow safer chat interactions by verifying users’ ages, is malfunctioning, leading to complaints from players, developers, and safety experts.
Roblox introduced the AI-based age verification process last week, requiring users to record a short video or upload government-issued IDs for those over 13. The system estimates ages using facial recognition technology processed by the company Persona. However, within days, users reported frequent misidentifications, with some adults being labeled as minors and vice versa. Several users shared videos demonstrating how they tricked the system using avatars or altered images, raising questions about its effectiveness.
In response to the backlash, Roblox’s chief safety officer Matt Kaufman acknowledged the scale of the challenge, stating that “expecting flawless performance overnight is unrealistic” and emphasizing that “tens of millions” of users have already verified their age. The company also announced ongoing efforts to improve the system and address issues such as parents verifying their children’s ages incorrectly, which sometimes results in minors being classified as adults.
Why It Matters
This development matters because Roblox is one of the world’s largest online platforms for children and teenagers, with over 150 million daily users. The failure of its age verification system raises concerns about user safety, privacy, and the platform’s ability to prevent predators from exploiting its chat features. The widespread misidentification could undermine trust in the platform’s safety measures and complicate efforts to enforce age-appropriate interactions.
adult facial recognition verification device
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Background
Roblox announced the new age verification requirement last July, amid mounting legal and regulatory pressure following lawsuits and investigations into its safety practices. The system was initially rolled out in Australia, New Zealand, and the Netherlands in November, with a global launch last week. Critics have long questioned the effectiveness of AI-based facial recognition for age verification, citing privacy concerns and technological limitations. The recent rollout follows a series of lawsuits accusing Roblox of failing to protect young users and enabling predatory behavior.
“Expecting the system to be flawless overnight is ignoring the scale of this undertaking.”
— Roblox’s chief safety officer Matt Kaufman
“The most widespread danger is the large number of accounts that have been mistakenly filed into the wrong age category, complicating safety efforts.”
— Ry Terran, independent extremism researcher
government ID verification scanner
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
What Remains Unclear
It is still unclear how Roblox plans to improve the accuracy of its AI system or how it will address the privacy concerns raised by users. The company has not detailed the specific methods for rechecking ages or handling false positives, and the extent of the misidentification problem remains uncertain as more user data emerges.
As an affiliate, we earn on qualifying purchases.
What’s Next
Roblox is expected to continue refining its AI age verification system, with updates aimed at reducing errors and addressing privacy issues. The company may also implement additional safeguards, such as more transparent re-verification processes and enhanced moderation. Monitoring user feedback and safety reports will be critical in assessing the system’s effectiveness moving forward.
privacy-focused identity verification tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
Why did Roblox introduce AI-powered age verification?
Roblox introduced the system to create a safer environment by verifying users’ ages, thereby limiting adult interactions with minors and complying with legal safety requirements.
What are the main problems with the current system?
Users report frequent misidentification of ages, with some adults being labeled as minors and young children incorrectly categorized as adults. Additionally, users have demonstrated ways to trick the system, raising doubts about its reliability.
How is Roblox addressing these issues?
Roblox has acknowledged the problems, stating they are working on improvements and will recheck suspicious accounts. However, specific solutions and timelines have not been publicly detailed.
Are there privacy concerns with the new system?
Yes, many users and parents are concerned about sharing facial videos or government IDs, despite Roblox’s assurances that personal data is deleted after processing.
Fall Picks
fall essentials
As an affiliate, we earn on qualifying purchases.
