Content at Scale is a new AI-writing assistant tool that helps write content quicker. Besides the text-generation capabilities, Content at Scale offers a free AI content detector tool.
This can help you identify when your AI-written content looks like it was generated with AI. A tool like this might be useful because these days it’s impossible to tell if a piece of text was written by AI or not.
This is a complete review of the Content at Scale AI content detector. Notice that Content at Scale is a full-on AI writing tool and I’m only reviewing the AI content detector which is just one of their features.
In this review, I test the Content at Scale AI detector by feeding it both AI-written and human-written text samples to see how it performs. Besides, I’ll try to make some small tweaks to the inputs to try to trick the algorithm.
đź’ˇ Make sure to read my comprehensive guide to the Best AI Content Detectors.
What Is the Content at Scale AI Content Detector?
Content at Scale is a complete AI writing tool with long-form content creation capabilities.
One of the cool features of this tool is the free AI content detector.
The idea of the AI detector is simple:
- Take a piece of text.
- Copy-paste it into the AI detector.
- See how likely your text was written by AI.
Content at Scale AI detector gives you a human-written score between 0% and 100%. This score reveals how much the tool thinks your content is human-written and how much AI-written.
A score of 0% means the tool thinks your content is entirely written by AI. A score of 100% means the tool thinks you wrote it all yourself.
Next, let’s put the Content at Scale AI content detector to the test.
Performance
I extensively tested the AI content detector by feeding it two types of data:
- 10 pieces of human-written text from my blog.
- 10 samples of AI-generated text (using ChatGPT).
1. Human-Generated Content
Let’s start with human-generated inputs.
These inputs are random samples of blog posts I’ve written myself. In other words, all these inputs should give me a close 100% score.
Example 1
Falsely detected as AI-written—mission failed.
Example 2
Falsely detected as AI-written—mission failed.
Example 3
Correctly detected as human-written—mission successful.
Example 4
Falsely detected as AI-written—mission failed.
Example 5
Correctly detected as human-written—mission successful.
Example 6
Correctly detected as human-written—mission successful.
Example 7
Falsely detected as AI-written—mission failed.
Example 8
Falsely detected as AI-written—mission failed.
Example 9
Falsely detected as AI-written—mission failed.
Example 10
Falsely detected as AI-written—mission failed.
By tallying up the scores, the Content at Scale AI detector only detected 30% of the human-written samples to be human-written.
So when it comes to detecting human-written content, Content at Scale did a really poor job.
Next, let’s try the AI-detection tool by feeding it some AI-generated content. This is the main way content creators will use AI detectors anyways—to find out if their content looks natural.
2. AI-Written Content
I generated 10 pieces of text using ChatGPT—the revolutionary AI writing model released by OpenAI.
If the AI content detector works, it should give a score close to 0% for all the following pieces of text.
Example 1
Correctly detected as AI-written—mission successful.
Example 2
Correctly detected as AI-written—mission successful.
Example 3
Falsely detected as human-written—mission failed.
Example 4
Correctly detected as AI-written—mission successful.
Example 5
Correctly detected as AI-written—mission successful.
Example 6
Correctly detected as AI-written—mission successful.
Example 7
Correctly detected as AI-written—mission successful.
Example 8
Correctly detected as AI-written—mission successful.
Example 9
Correctly detected as AI-written—mission successful.
Example 10
Correctly detected as AI-written—mission successful.
Summing up the results, it appears that the Content at Scale AI detector is quite good at detecting AI content.
In total, it correctly identified 90% of the AI-written articles as AI-written.
However, the problem is that it didn’t quite identify human-written pieces as human-written. In total, the tool was successful 12/20 times which is only 60%.
So if you don’t know in advance whether the piece of text is written by AI, there’s no way to detect it reliably with Content at Scale.
Can You Trick the AI Content Detector?
Now, let’s play some tricks with the Content at Scale AI detector to see if it’s easy to fool.
I’ve reviewed other AI detectors and noticed that small changes in the input can have a big impact on the output.
This means in the eyes of an AI detector, text with a 100% AI-written score becomes 100% human-written by a tiny change in the input—obviously not good! Small changes should only have little to no impact on the score.
Let’s see what happens when I try to fool the Content at Scale AI detector.
Test 1: Remove a Comma
➡️ TLDR; Removing a comma didn’t change the results significantly.
As a first step, I tried to fool Content at Scale by tweaking the output by a tiny bit. More specifically, I removed a single comma that follows the word “Additionally”.
This is a mistake AI these days would never do, so perhaps the tool now thinks I’ve written the content…
But here’s what happened:
The AI detector score changed a tiny bit. But it was clearly unphased by the fact that I removed a comma from the output.
Test 2: Make a Typo
➡️ TLDR; Removing a single letter changed the AI detector score by quite a bit.
I’m trying another similar “trick”. This time, I’ll put the comma back and instead introduce a typo by removing the letter “i” from “their”.
Here’s what happened this time:
Now the score changed quite a bit. The tool still says the content is written by AI but with less confidence. I can imagine making one or two of these changes could completely change its mind.
Based on these two tests, it seems it’s quite easy to fool the Content at Scale AI detector. Given a 100% AI-written score, just change a character or two and your content might get a 100% human text score.
Test 3: Use an AI Paraphraser
➡️ TLDR; AI-paraphrased content did not fool the tool.
Last but not least, let’s try fooling the AI content detector by rephrasing the content with AI.
I used a tool called QuillBot to re-write the AI-generated input in hopes to make it look less AI-generated in the eyes of AI detectors. In the image below, the right-hand side is the AI-generated rephrased version of the AI-generated input text.
Now, let’s feed this rephrased version to the Content at Scale AI detector:
Amazing! It did not get fooled by the paraphrasing of the input. It still knows the content is written by AI.
Based on these tests, it still seems you can pretty easily fool the AI detector. Sometimes the result remains unchanged even when using paraphrasing tools like Quillbot. But on the other hand, sometimes the tool is phased by a small change like an extra word, comma, or typo.
Pros
- Free to use. Content at Scale offers the AI detector for free. This makes it easy to use and worthwhile to try.
- Decent accuracy. With AI-generated content, the AI content detector identified 90% of the inputs as AI-written. With human-generated content, the result was less impressive, though.
- Other AI-writing features. The AI content detector is just one of the features of Content at Scale.
Cons
- Inaccurate with human text. The Content at Scale AI Detector couldn’t quite detect human-written content.
- Pretty easy to mislead. By making small changes in the input, you can fool the AI content detector to believe your content is human-generated.
Final Verdict
Because the Content at Scale AI detector is a free tool, it won’t hurt to give it a try!
The accuracy was pretty impressive with AI-generated content. But because it didn’t detect human-written text as human-written, you can’t really rely on it.
Based on a bunch of AI detector tools I’ve tested, there’s not really a fully reliable AI content detector. You for sure cannot use a tool like this to detect if homework or essays were written by AI.