It is a common idiom to say “Set a thief to catch a thief”. A modified version of this phrase in the ChatGPT era is “Set AI to Catch AI”.
GPTzero.me is the new tool that has emerged to detect if any text has been generated by ChatGPT or similar AI and not by a human. This tool is developed to help educators to detect if AI has been used to generate text responses in essays and assignments. Just like the “Plagiarism” detection tool, this tool checks the text and identifies the possibility of a text having been generated by an AI.
At first glance it appears to be working reasonably fine and it generates an “Average Perplexity Score” ) measurement of randomness of the text) for the subject text and highlights possible portions generated by AI. Another score called the “Burstiness Score” measures the variation in perplexity.
The product could be useful to preserve the integrity of the education evaluation system as we use today though we need to re-work on our assessment systems soon.
Naavi