You are viewing a single comment's thread from:
RE: Grapes ๐ : A Taste of History in Every Bite ! Health Benefits ๐
I've checked the four detection links with ChatGPT-texts and my own posts:
AI Text Classifier marks all as AI generated ;-((
AI Content Detector doesn't work ;-((
ChatGPT Detector by ZeroGPT and GPT-2 Output Detector give exact results (but the last one is only partly functional demo version...)
My recommendation is clear: ChatGPT Detector by ZeroGPT is the most trustworthy tool for me. May be @the-gorilla can confirm or contradict...?
I've only done a very quick test (it's past my bed time) and initial results are fairly consistent. A couple of them have character limits and I tend to get more consistent results when analysing 3 or 4 paragraphs.
I took the "Some Definitions" section from my lazy or unmotivated article...
โ AI Text Classifier said it's "Very Unlikely" to be AI Generated
โ GPT-2 Output Detector gave me a 99.98% REAL rating
โ AI Content Detector gave me a 100% human content rating
๐ ZeroGPT said it was 24.5% AI generated - one paragraph that I wrote and one which was quoted from another source.
If I then generate 3 paragraphs with the prompt "write 3 paragraphs about confused pandas":
โ AI Text Classifier said it's "Likely" to be AI Generated
โ GPT-2 Output Detector gave me a 99.69% FAKE rating
๐ฉ AI Content Detector gave me a 47% human content rating
โ ZeroGPT said it was 97.25% AI generated
My thoughts are that by submitting 3 to 4 paragraphs of text will give a better result than an entire article (because the article could be 5 or 6 prompts combined or the tool will just get confused with a large amount of data) and my brief test shows that none of the tools are terrible.
I think that like @remlaps suggests, a combination of tools and a bit of brain power should lead to a decent estimation as to whether something's AI generated or not.
One thing that worries me is the combination of these tools with language translation web sites. I'm under the impression that translation web sites use the same sort of statistical/word-frequency analysis as LLMs. Not sure how the AI detection sites would react to a legitimate article after machine translation.
I tried taking an English article, using google translate to translate to German then Spanish then back to English, and passed that through the "GPT-2 Output Detector". The detector did alright with it, but I'm hoping to find time to run some more trials.
Thank you very much - I'm really confused by this new problem...
I am as confused as you are, but I can't help it, so I will see how far it goes and in which direction. I can see that some of the newbies who have been handed the charge of moderating will get even more confused. And the way they are reacting on this page, I can imagine you will see the result sooner than your expectations.
You were right @dove11, just check out this post and you will know. ๐