AI failures · Misrepresented AI capability
Workado (Formerly Content at Scale AI): FTC Final Order Over Unsupported "98 Percent" Accuracy Claim for Its AI Content Detector (2025)
Verified Checked against its sources on 4 sources quoted
- Where it happened
- United States
- Organization
- Workado, LLC (formerly Content at Scale AI)
- Date
- Complaint and proposed consent order announced April 28, 2025; final Decision and Order issued August 21, 2025 (Docket No. C-4822) and announced August 28, 2025
- Function
- Product marketing and advertising
- Where it happened
- Advertising an AI product's accuracy
- System
- AI Content Detector (also marketed as AI Content Checker), built on a third-party AI model
- Technology
- Machine learning
- Type of failure
- Misrepresented AI capability
- Caught by
- A regulator
Summary
On April 28, 2025, the Federal Trade Commission announced an administrative complaint and proposed consent order against Workado, LLC, formerly Content at Scale AI, an Arizona company that sold an AI Content Detector meant to tell whether written text was AI-generated, with a $49-a-month paid subscription from September 2023 to August 2024. The FTC alleged that Workado advertised the detector as 98 percent (98.3%) accurate and as trained on varied material such as blog posts and Wikipedia entries, when the model it used, which it did not build, train or fine-tune, was trained on abstracts of scholarly articles. According to the complaint, Workado relied on the model developers' published test results for academic content and did not test the detector on the marketing and plain-language text its users typically submit; the developers' own results showed 74.5% accuracy at best on a mix of non-academic content and correct detection of AI-generated non-academic text only 53.2% of the time. The FTC's April release put general-purpose accuracy at 53 percent. Workado neither admitted nor denied the allegations. The Commission issued the final Decision and Order on August 21, 2025, after public comment, barring effectiveness claims for AI-detection products unless they are not misleading and backed by competent and reliable evidence, and requiring Workado to keep that evidence, email eligible consumers about the order, and file compliance reports for four years. The claims are the FTC's allegations; the order contains no finding of violation and no monetary payment.
Consequence
- FTC Decision and Order (Docket No. C-4822) issued August 21, 2025, after a public comment period
- Workado barred from making effectiveness claims for AI content detection products unless they are not misleading and supported by competent and reliable evidence when made
- Workado required to email eligible consumers about the consent order and settlement
- Workado required to submit a compliance report one year after the order and annually for three years after that
Who caught it A regulatorFound outside the organization
Analysis
What could have been done
Evidence behind claims about AI
Public statements about AI capability are backed by evidence before they are made.
The FTC alleged that Workado advertised 98.3% accuracy on the strength of the model developers' results for academic content alone, while the developers' own results for non-academic text showed 74.5% accuracy at best and 53.2% detection of AI-generated text.
The system is tested for accuracy, bias and failure modes on representative cases before use.
According to the complaint, Workado did not build, train or fine-tune the model and did not test whether the detector reached the claimed accuracy on the marketing and plain-language text its users typically submit.
What would likely have prevented it
- Before publishing an accuracy figure for an AI product, test it on samples of the content customers actually submit and state the figure for that content.
- When a claim rests on a third party's model or test results, confirm that the test data matches the advertised use before repeating the figure, and keep the evidence on file.
What would likely have caught it earlier
- Re-measure the product's accuracy periodically on a labelled sample of real customer submissions, and escalate to the owner of the claim when the measured rate falls below what is advertised.
Key dates
- April 28, 2025Event
- October 21, 2026Checked against sources
Developments are added when the record is reviewed. Next review: October 21, 2027.
Evidence
Each passage is quoted from its source. The quoted passages are re-checked against the live pages every month.
-
The order settles allegations that Workado promoted its AI Content Detector as “98 percent” accurate in detecting whether text was written by AI or human. But independent testing showed the accuracy rate on general-purpose content was just 53 percent
Supports: the alleged 98 percent claim and the FTC's 53 percent general-purpose accuracy figure
The FTC alleges, however, that the AI model powering the AI Content Detector was only trained or fine-tuned to effectively classify academic content.
Supports: allegation: the model was effective only on academic content
The Commission vote to issue the administrative complaint and to accept the consent agreement was 3-0.
Supports: the Commission accepted the consent agreement (April 2025)
Agency alleges Workado lacks evidence to support its claims that its AI Content Detector tool was 98 percent accurate at detecting AI-generated text April 28, 2025
Supports: announcement date April 28, 2025
-
Respondent claims that its AI Content Detector will predict with 98.3% accuracy whether text was generated using AI technology such as ChatGPT, GPT4, Claude, Bard, or another generative AI technology.
Supports: the alleged 98.3% accuracy claim
In fact, the AI model Respondent uses for its AI Content Detector was trained on abstracts of scholarly articles. Respondent did not create, train, or fine tune the AI model used in its AI Content Detector, nor has it tested whether the AI Content Detector would achieve the same accuracy rate
Supports: allegations: model trained on scholarly abstracts; not built or tuned by Workado; not tested on users' typical text
the developers’ best result for the AI Model’s accuracy when evaluating a mix of human-created and AI-generated non-academic content was 74.5%.
Supports: the developers' results: 74.5% best accuracy on a mix of non-academic content
The developers’ testing data also showed that the AI Model struggled to identify AI-generated content as AI-generated when evaluating non- academic content, correctly detecting AI-generated text merely 53.2% of the time.
Supports: the developers' results: 53.2% detection of AI-generated non-academic text
Beginning in September 2023 and continuing until August 2024, Respondent added a $49 per month paid subscription option for the AI Content Detector on its website.
Supports: the paid subscription, September 2023 to August 2024
Respondent relied solely on the publicly available testing results for the AI Model’s evaluation of academic content, to claim an accuracy rate of 98.3%.
Supports: allegation: the 98.3% claim rested only on the developers' academic-content results
-
By the Commission. April J. Tabor Secretary SEAL: ISSUED: August 21, 2025
Supports: final Decision and Order issued August 21, 2025
One year after the issuance date of this Order, and annually thereafter for 3 years, Respondent must submit a compliance report
Supports: compliance reporting obligation
statements by Respondent that it neither admits nor denies any of the allegations in the Complaint
Supports: Workado neither admitted nor denied the allegations
DOCKET NO. C-4822
Supports: docket number
-
Is prohibited from making any representations about the effectiveness of any AI content detection product unless it is not misleading, and the company has competent and reliable evidence to support the claim at the time it is made;
Supports: order term: no effectiveness claims without competent and reliable evidence
Must email eligible consumers about the consent order and settlement with the Commission
Supports: order term: notify eligible consumers by email
Following a public comment period, the Commission voted 3-0 to approve the final consent order and respond to two comments the FTC received on the proposed order.
Supports: final approval after public comment (announced August 28, 2025)
Suggested citation. Eminence Scan, “Workado (Formerly Content at Scale AI): FTC Final Order Over Unsupported "98 Percent" Accuracy Claim for Its AI Content Detector (2025)”, Eminence Growth Solutions, last verified October 21, 2026, https://eminencegrowthsolutions.com/tools/eminence-scan/record/fail-101/.
Using our research: you may read and quote Eminence Scan with credit to “Eminence Scan, Eminence Growth Solutions” and a link; all other rights reserved. Terms: Using our research.
Spotted an error, or a development we have missed? Report a correction. How we check records: research methodology.
