For the last year, all of the major players in the AI content generation space have been working to improve on the GPT-3. In this review, we’ll take an in-depth look at three available solutions, Nichesss, CopyAI and CopySmith. We’ll be looking at features such as accuracy, ease of use, and overall versatility. So, let’s get started!
There are three objectives of this review:
- to ascertain which of these 3 AI-powered content generators could generate the best copywriting, hopefully mimicking human writers
- to explore whether any of these tools could actually write long form content, such as a blog post of at least 1,000 words or more
- to determine how best these AI-generated content can help digital marketers in their content marketing strategy
In order to have the most accurate results, the following steps are adopted:
- We want to compare apple to apple and orange to orange. So only these three AI content generators are chosen. All of them are using the latest GPT-3 framework, developed by OpenAI.
- All of them are coded to generate short form content, i.e. less than 250 to 800 characters (about 50 to 150 words) in total.
- The experiments are conducted by using each app to generate Blog Introduction paragraphs, except CopySmith. CopySmith does not have this feature but the closest alternative is their Blog Ideas tool.
- Each app will be tested based on the same input: How to Optimize for Voice Search Using Simple SEO Strategies
- This input is actually a modified title from Neil Patel’s blog post, “How to Optimize for Voice Search: 4 Simple SEO Strategies”
- Three pieces of generated content from each app are then sent to a group of reviewers to rank them in private (which none of them know how the others voted)
- The contents that were sent out to reviewers are not edited at all. They are straight from the results page from each app, virgin and pure.
- The reviewers are required to rank the 9 pieces of content by giving them a score from 1 to 9. Number 1 is the best copy and number 9 is the worst score amongst all. One content can only have one score (number).
- The name of the apps are not disclosed to the reviewers during the survey.
Survey Of Blog Introduction Paragraph
Results Of Survey
The results of the survey is tabulated as below. Link: Survey Results – Review AI Content Generators
Referring to first sheet, Results
- A total of 21 respondents came back with their ranking results
- On the first row of the table are the anonymous respondents
- The first column show the 9 different content copies
- The second last column is the Score, the lower the number the better is the copywriting
- The last column show the which content is generated by which app, i.e. Nichesss, CopySmith or CopyAI
Referring to second sheet, Summary
- The last column (Rank) is the final ranking of the survey results, 1 being the “best copy” and 9 being the “worst copy” among all the content
- The Score column is the marks of each piece of content, the lower the marks means the copy is better
Rankings Of AI Generated Content
The best copy is generated by Nichesss, followed by CopyAi and then Nichesss again (top 3 positions).
The worst copy is generated by CopySmith and the second worst is also by CopySmith, followed by CoyAI.
The “Best” Copy
The best copy of the introduction paragraph for the blog post title “How to Optimize for Voice Search Using Simple SEO Strategies”:
The “Worst” Copy
The worst copy is as follows.
A few interesting conclusions could be drawn from these experiments.
- The length of the introduction paragraph is an important factor. You can see that all the top five best results are longer than those shorter content (bottom three results). See column E (No. of words) and F (Number of characters) in the Summary sheet.
- All top three results are of more than 350 characters in length.
- The bottom three results are less than 300 characters (about 50-word length).
- The most probable reason is the longer the content, the more idea or meat could be put inside, thus conveying more information.
- All the top three results have got “numerical data” in them.
- For example, in the best content A: “about 10% of overall search, it is expected to grow to 30% by 2020”.
- All the bottom three results have got none “numerical data” in them.
The unedited raw data from which the results are obtained are listed below.
Data From Nichesss
The data from Nichesss could be accessed here https://nichesss.com/home/marketing-plans/pnynVzBE6
If you haven’t got an account with Nichesss, you could sign up a FREE account, in order to view the data.
Data From CopyAI
The data from CopyAi is here.
Data From CopySmith
Data from CopySmith is viewable from here https://copysmith.ai/share/blogIdea/?userid=4NHkT1goNfUiRmwySGdpKLIsKUG3&projectid=esxfQBLoFejeZqedWI6K
The counting tools used are:
Online Word Counter For Text
Link: Online Word Counter