🤖 Chat-GPT: The Difficulty in Producing Good ContentsteemCreated with Sketch.

in WORLD OF XPILARlast year (edited)

image.png
Separator-grey.png

I recently wrote a post about my experiments with Chat-GPT with a view to using it to generate sports match reports that could be SEO optimised and used to attract new users to the platform.

Whilst I thought that my initial effort was decent, I felt that it lacked personality and didn't really sound like me, even though it being "trained" in my writing style with some previous articles.

Despite the lack of personality, I was impressed with the output.


Note: I won't share the exact methodology that I used throughout this article because (in the unlikely event that a scammer reads somebody else's content), I don't want to give the scammers any bright ideas. @disconnect commented that this first article was identified as a 17% probability of being AI generated.

Separator-grey.png

2nd Attempt: ⚽ Arsenal v. Manchester City

Arsenal v. Manchester City Match Report 👆 Source + Photoshop

So I tried again, this time creating a new account (@match-report) which would help with SEO when people search for "Blah Blah Blah Match Report". This time, for the Arsenal v. Manchester City match.

On this occasion, I asked Chat-GPT to include some emojis to give it a bit of personality and I think that proved to be successful. I did encounter a number of problems generating this though, in particular with Chat-GPT's database only going up to September 2021. One specific detail being that at that time, Gabriel Jesus played for Manchester City and not Arsenal which it got confused by.

The outcome in this case was impressive once again although it did take a lot of effort to reach this point.

In this instance, the article was identified as 37% AI generated.

Separator-grey.png

3rd Attempt: 🏏 India v. Afghanistan

With no new football on due to the International Break, I decided to see how we would get on with a cricket match - this time for an event that I hadn't watched.

India v. Afghanistan Match Report

This is without doubt my favourite match report of them all but it's fair to say the effort to produce it wasn't the 15 minutes that I'd hoped... it probably required more effort that it'll take me to write this post!

Whilst the emojis of the 2nd Attempt added some character, some of the feedback from my initial test was that it lacked my customary "sarcasm" which I took to mean "immense wit and humour" that embody my content 😅

So this time, I asked Chat-GPT (amongst other things) to include some "amusing metaphors" which I think that it probably went over the top with.

As I mentioned above though, this was hard work - much harder to get an accurate output despite it being fed accurate data. It would frequently get run totals wrong and obvious errors - like the chronology of events seemed to be a huge problem. With a lot of requests and corrections, I got there in the end.

The AI checker though thought that this content was more authentic, assessing that it was 100% human written (hence my reluctance to share my methodology).

image.png
Separator-grey.png

😠 Pure Frustration: The End of my Experiment

Despite what I consider to be impressive output, the process to get there is infuriating to say the least. Chat-GPT makes schoolboy errors which despite requests to correct, it fails at. I've been told that Chat-GPT works better if you're nice to it but much like asking a young child to sit at the table to eat their food, patience is limited.

As you'll see below, even after being asked to correct its contradiction and it thinking that it had done so, it had simply highlighted the exact words that I had an issue with.

image.png
Separator-grey.png

These kinds of errors are consistent and it would appear persistent. To correct them all using Chat-GPT would be more onerous and time consuming than simply watching the match highlights and writing my own match report, somewhat defeating the objective of my experiment and bringing an end to my use of Chat-GPT to generate match reports.

In addition, at the time of writing, none of the match reports have been indexed by Google 🤷‍♂️
Footer-Bottom.png

Sort:  

My observation with ChatGPT, for both programming and writing, is that it's a great way to get started, but - as you also illuminated - a polished final product is challenging. Also, it has a word token limit that it doesn't tell you about unless you ask. If you run into that limit, it gets really unwieldy without telling you why. That's where it seems especially likely to ignore requests for corrections or to reintroduce previously corrected errors.

To me (at least with the free version), the best work flow seems to be:

  1. Get an outline and/or draft version from ChatGPT/Bard
  2. Iterate until satisfied
    2.1. Polish it with human revisions
    2.2. Ask for advice from ChatGPT/Bard. This can take the form of generalized feedback about the revisions or delving into specific details.

To me, it seems like a very helpful assistant, but it's definitely not ready to be a sole content producer for high quality content. I don't think it really saves much time (which you also noticed), but I do think that the interactive process can produce a better result. (Kind of like a Jevons paradox for information productivity. ;-)

In general, I prefer ChatGPT over bard, but there have been cases where Bard gave me better results. With the 2021 information cutoff that you mentioned, Bard might do a better job on articles about current events.

Aside from writing articles, I do have to say that this is a pretty useful skill - but again - it doesn't always get it right, so supervision and critical evaluation is needed from the human side:

Me

ChatGPT

 last year 

It is interesting to see that you have tried it out.
But as I understand there is more work a fun

That's a good one for 0%! Google might have some advanced tools to analyze AI-generated content. Maybe that could be the reason it's not getting indexed. All in all it is very rarely that Steemit content score high authority values in SEO.

 last year 

That's a good one for 0%!

It wasn't a conscious objective but once completed, I was curious what it would be. I only tested the Arsenal v. Man City article as I wrote the post and was quite surprised that it was a lot higher.

Steemit's content getting indexed on Google seems completely random. Even if I include "site:steemit.com" and the exact title in quotes, they don't always come up! I'd love to know why.

I believe the crawlers tend to overlook Steemit, they probably don't want to promote a decentralized system that they have no control over Google ads. But anyway these SEO algorithms are complex and ever changing. So its very hard to understand all the facts of getting indexed.

TEAM 1

Congratulations! This post has been upvoted through steemcurator04. We support quality posts , good comments anywhere and any tags.
Curated by : @o1eh



 last year 

Thank you as always @o1eh 👍

Coin Marketplace

STEEM 0.21
TRX 0.20
JST 0.035
BTC 91178.33
ETH 3192.43
USDT 1.00
SBD 2.96