This New Tool Can Detect AI-Generated Academic Papers With 99% Accuracy!


Shreya Bose

Shreya Bose

Jun 19, 2023


An AI detector developed by the University of Kansas can detect AI-generated content in academic papers with a 99% accuracy rate.

This New Tool Can Detect AI-Generated Academic Papers With 99% Accuracy!

This is one of the few detectors on the market developed specifically for academic writing.

Background

OpenAI’s chatbot, ChatGPT, was opened to the public in November 2022.

It rapidly gained popularity, having surpassed the million-users mark in less than a week. 

People used it for things like creating code and writing essays.

However, its popularity led to scrutiny over whether students were writing genuine papers by themselves or not.

Several schools either indefinitely or temporarily banned the software, including New York Public Schools, Seattle Public Schools and the Los Angeles Unified School District.

The process of detection

A team of researchers selected 64 perspectives (a type of article) and used them to make 128 articles using ChatGPT, which was then used to train the AI detector.

The detector could detect with 100% accuracy what were human-created articles from AI-generated ones.

It also had a 92% accuracy rate for identifying specific paragraphs within the text.

Lead author statement

“Right now, there are some pretty glaring problems with AI writing,” lead author Heather Desaire said in a statement. 

“One of the biggest problems is that it assembles text from many sources and there isn’t any kind of accuracy check—it’s kind of like the game Two Truths and a Lie.”

AI detectors and accuracy

It should be noted that AI detectors have not proven to be 100% accurate.

For example, a University of California at Davis student alleged she was falsely accused of cheating with AI.

She pleaded her case and ultimately won, using time stamps to prove she wrote the paper.

The point is that this wasn’t the only time educators falsely labeled assignments as AI-generated.

Existing programs and services

There are several programs which promise to identify AI-written content.

TurnitIn: An AI detection tool for papers which shows an overall percentage of the amount of work AI software generated within the paper.

The company claims 98% accuracy at spotting AI-written work.

Copyleaks: This software can detect AI content in multiple languages, including Spanish, Russian, French, Dutch and German.

It claims to have an AI detection accuracy rate of 99%.

OpenAI’s Classifier: Though these are the same makers behind ChatGPT, the tool isn’t very accurate.

It has a success rate of around 26% and incorrectly labels human work as AI work 9% of the time.

However, it is claimed that its accuracy increases as the length of the text increases along with it.

Otherwise It’s “very unreliable” on texts with 1,000 characters or less.

The company itself warns against using this tool as the primary decision making tool and suggests using it along with other methods of detection.


Shreya Bose
Shreya Bose
  • 609 Posts

Subscribe Now!

Get latest news and views related to startups, tech and business

You Might Also Like

Business
Dec. 8, 2022

Beat The Burden Of Medical Inflation With A Health Insurance

As disease rates rise and medical technology develops, treatment costs climb. It’s essential to understand that medical costs are not exclusively associated with hospitals. The cost of prescription drugs, diagnostic procedures, ambulance and operating room fees, consultations with doctors, and other costs are also constantly increasing. All of them could put a big strain on […]

Business
Dec. 8, 2022

3 Biggest Changes Of iOS 16.2 Update That Every iPhone User Should Know!

In its latest update Apple said that it is preparing for the iOS 16.2 update for iPhones across the world. Notably, like the previous release, there are a couple of changes coming for the iPhones.  iOS 16.2 Update Release Date So far, Apple has not announced a release date for iOS 16.2 update. Reportedly, the […]

Business
Dec. 8, 2022

300 Microsoft Employees Create Employee Union, First Time Ever: This Is How Microsoft Reacted

Around 300 workers at Microsoft Corp.’s ZeniMax Studios have commenced the process of forming a union which is said to be the first at the software giant in the US.  Here, Microsoft Corp.’s ZeniMax Studios known for popular video games including Skyrim and Fallout. Forming Union In Microsoft Corp Moreover, the quality assurance employees at […]

Business
Dec. 7, 2022

India Beats China In Air Travel Safety: Ranking Jumps From 102 To 48 In Global Aviation Safety

India’s air safety protocols and executions have improved drastically over the years, as validated by the findings of a specialized agency of the United Nations, the International Civil Aviation Organization or ICAO. The UN watchdog has upgraded India’s ranking in terms of aviation safety to the 48th position, jumping past the rankings of countries like […]

Recent Posts

Related Videos

   

Subscribe Now!

Get latest news and views related to startups, tech and business

who's online