5 fake detection tools to find out if the content is written by bots like ChatGPT

SINGAPORE – Students love it, but it’s a teachers’ nightmare. ChatGPT, an artificial intelligence (AI) chatbot, has been thrust into the limelight since its latest version was released in November 2022.

Developed by well-funded US startup OpenAI, the chatbot can create coherent essays and solve word-based math problems.

The race to beat AI-assisted plagiarism and fraud is on. The Straits Times looks at five blasphemy detection tools.

1. GPTZero

Mr. Edward Tien, senior at Princeton University, spent his winter break in 2022 and New Year’s Eve. GPTZeroan app to quickly find out if an essay is written by a human or chatgpt.

The 22-year-old, who is pursuing a double major in computer science and journalism, uploaded a beta version of the tool to app-hosting platform Streamlit in early January to help teachers detect AI-assisted plagiarism. .

“We tested the beta with a dataset of BBC news reports and GPT-generated articles (with similar headlines). The false positive rate is less than 2 percent,” he told The Straits Times.

This means that up to two out of every 100 articles are incorrectly classified as ChatGPT-absent.

“We’re making several model improvements to make GPTZero more accurate and easier for educators to use,” he said, pointing to a sign-up list for the upcoming ad launch. GPTZero.me

GPTZero uses two different metrics to evaluate whether content is written by bots: confusion and fragmentation. Confusion is a measure of randomness within a sentence, while fluency measures the overall degree of randomness of all sentences in a text, increasing in length.

Text saved to the application is assigned a number for both parameters. The lower the number, the more likely the content will be generated by a bot. Human writing tends to have complex sentences, while bots are more coherent. Texts with higher ambiguity are more chaotic and cannot be generated by language models.

Mr Tien said he has since been approached by several venture capital firms, including US VCs Sequoia Capital and Andreessen Horowitz.