To stop ChatGPT abuse, OpenAI has a new tool that can tell you whether a piece of text is more likely to have come from an AI program or a human.
OpenAI introduced the classifier tool(Opens in a new window) on Tuesday to help crack down on AI-generated text thats being passed off as coming from a human. The problem has become especially pronounced in education with students exploiting ChatGPT to complete homework assignments.
In a blog post(Opens in a new window), OpenAI also noted that AI-generated text could pose a threat when used to generate automated text for misinformation campaigns.
The classifier tool is pretty straightforward: Submit some text at least 1,000 characters in length, and OpenAI will tell you the likelihood that it came from an AI program or a human. The tool was created by training a computer model to discern between pairs of human-written text and AI-written text on the same topic.
(Credit: OpenAI)
However, the San Francisco lab admits the classifier is far from perfect. In our evaluations on a challenge set of English texts, our classifier correctly identifies 26% of AI-written text (true positives) as likely AI-written, while incorrectly labeling human-written text as AI-written 9% of the time (false positives), OpenAI wrote.
The classifiers reliability also drops when examining short snippets or a few paragraphs of text. So the tool will only work on submissions at over 1,000 characters in length. In addition, sometimes human-written text will be incorrectly but confidently labeled as AI-written by our classifier, OpenAI noted.
Additionally, students may quickly learn how to evade detection by modifying some words or clauses in generated content, the lab said.
Hence, OpenAI says the tool should not be used as a primary decision-making tool when it comes to determining whether a piece of text is AI-generated or not. But despite all the limitations, OpenAI decided to release the tool as it works on mitigations to prevent students from exploiting ChatGPT for cheating purposes.
Were making this classifier publicly available to get feedback(Opens in a new window) on whether imperfect tools like this one are useful, OpenAI added. Our work on the detection of AI-generated text will continue, and we hope to share improved methods in the future.
An example of an essay ChatGPT can write.(Credit: Open AI)
Launched in November, ChatGPT is so advanced that the AI program can write essays, poems, and answer test questions on a wide variety of topics within seconds. While the quality of the responses can be shaky, researchers have found that ChatGPT is smart enough to (barely) pass an MBA exam and even fix numerous bugs in computer code.
Inevitably, the emergence of ChatGPT has sparked questions over whether the same program threatens to undermine education and disrupt white-collar jobs. Already, some schools and teachers have decided to block the AI program on their networks over concerns that ChatGPT makes cheating on homework and tests all too easy. Meanwhile, some third parties have released their own free(Opens in a new window) tools(Opens in a new window) to help educators ferret out AI-generated text.
OpenAI said its trying to address the cheating problems by reaching out to teachers in the US to learn about their experiences.The lab has also published a document(Opens in a new window) with advice on how educators could introduce and oversee ChatGPT use in their classrooms safely.
But OpenAI also noted its still too early to say how programs like ChatGPT will affect education and society. To date we have seen instances of productivity improvements that transform jobs, job displacement, and job creation, but both the near and long term net effects are unclear, it said.
Sign up for What's New Now to get our top stories delivered to your inbox every morning.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
More here:
Are You Smarter Than ChatGPT? OpenAI Tool Aims to Detect AI-Generated ...
- A Murder At The End Of The World's Retreat Guests Explained: Who ... - Screen Rant - November 18th, 2023 [November 18th, 2023]
- The Moon People: Assimilation and the Jewish Literary Transvestite - Tablet Magazine - November 18th, 2023 [November 18th, 2023]
- Will two generations of Moon walkers shake hands? - OnlySky Media - November 18th, 2023 [November 18th, 2023]
- SpaceX Prepares for Second Starship Launch as it Eyes Moon and ... - OPP.Today - November 18th, 2023 [November 18th, 2023]
- Invincible Season 2 Episode 3 Review - But Why Tho? - November 18th, 2023 [November 18th, 2023]
- TV Recap: "A Murder at the End of the World" - Chapter 1: Homme ... - Laughing Place - November 18th, 2023 [November 18th, 2023]
- Thursday: Hili dialogue Why Evolution Is True - Why Evolution Is True - November 18th, 2023 [November 18th, 2023]
- Space Habitat Market to grow by USD 169.38 million from 2023 to ... - PR Newswire - November 18th, 2023 [November 18th, 2023]
- Cosmic conservation: Why experts argue portions of the solar ... - Salon - September 11th, 2023 [September 11th, 2023]
- We havent even set foot on Mars and we are already setting up a ... - Softonic EN - September 11th, 2023 [September 11th, 2023]
- NASA's MOXIE Experiment Triumphs in Generating Oxygen ... - The Weather Channel - September 11th, 2023 [September 11th, 2023]
- ECOVIEWS: Thermal vents produce bizarre life forms | Features ... - Charleston Post Courier - September 11th, 2023 [September 11th, 2023]
- Elon Musk's 'most powerful rocket ever made' is finally ready for launch - Technext - September 11th, 2023 [September 11th, 2023]
- What's the Bare Minimum Number of People for a Mars Habitat? - Universe Today - September 11th, 2023 [September 11th, 2023]
- India may be moving to change its name to ancient Sanskrit term ... - FOX Bangor/ABC 7 News and Stories - September 11th, 2023 [September 11th, 2023]
- My Nuclear Family - The Good Men Project - September 11th, 2023 [September 11th, 2023]
- The MCU Multiverse Is Continuing A Great Marvel Trend - Screen Rant - April 30th, 2023 [April 30th, 2023]
- How Starship Will Change Humanity Soon - by Tomas Pueyo - Uncharted Territories - April 30th, 2023 [April 30th, 2023]
- China is taking 3D printers to the moon - TechRadar - April 27th, 2023 [April 27th, 2023]
- Mae Martins SAP showcases affirming, optimistic humor - The Wellesley News - April 27th, 2023 [April 27th, 2023]
- Of Moths and Marsupials - bioGraphic - April 27th, 2023 [April 27th, 2023]
- Teachers Rejoice! OpenAI Released Tool to Catch ChatGPT Writing - January 31st, 2023 [January 31st, 2023]
- What is Artificial Intelligence (AI) ? | IBM - January 31st, 2023 [January 31st, 2023]
- Overview | Earth's Moon NASA Solar System Exploration - January 27th, 2023 [January 27th, 2023]
- Moon Phases | Moon in Motion Moon: NASA Science - January 27th, 2023 [January 27th, 2023]
- All About the Moon | NASA Space Place NASA Science for Kids - January 27th, 2023 [January 27th, 2023]
- January 21, 2023: Closest New Moon Since the Middle Ages - January 27th, 2023 [January 27th, 2023]
- Colonization of Europa - Wikipedia - January 4th, 2023 [January 4th, 2023]
- American Colonization Society | abolitionist organization - January 4th, 2023 [January 4th, 2023]
- Deimos (moon) - Wikipedia - December 28th, 2022 [December 28th, 2022]
- Everything NASA is taking to the moon before colonizing Mars - December 21st, 2022 [December 21st, 2022]
- Chinese Lunar Exploration Program - Wikipedia - December 21st, 2022 [December 21st, 2022]
- Moon - Wikipedia - November 23rd, 2022 [November 23rd, 2022]
- Artemis is our first step toward space colonization - Big Think - November 21st, 2022 [November 21st, 2022]
- Supermoon - Wikipedia - October 15th, 2022 [October 15th, 2022]
- Captain Kirk Went to Space and Saw Absolutely Nothing - TheStranger.com - October 15th, 2022 [October 15th, 2022]
- We'koqma'q First Nation helps keep tradition alive with ribbon skirt bank - CBC.ca - October 15th, 2022 [October 15th, 2022]
- Review: Andor Episode 6 gives a heartbreaking victory to the rebels of Aldhani - Winter is Coming - October 15th, 2022 [October 15th, 2022]
- National Indigenous Peoples Day 2022: Everything to Know - Newsweek - October 15th, 2022 [October 15th, 2022]
- Who's the enemy here? - The Korea JoongAng Daily - October 15th, 2022 [October 15th, 2022]
- Avatar: Where We Were and Where We're at The Minnesota Republic - Kent Kaiser - October 6th, 2022 [October 6th, 2022]
- Glitching Time and Time-Based Media The Brooklyn Rail - Brooklyn Rail - October 6th, 2022 [October 6th, 2022]
- New Artwork on the Toronto Sign Pays Tribute to the Rights of Indigenous Language Speakers Worldwide - Storeys - September 29th, 2022 [September 29th, 2022]
- Is it finally time for a permanent base on the moon? - Popular Science - September 22nd, 2022 [September 22nd, 2022]
- Venice Review: In Viaggio is a Fascinating Rorschach Test of the Pope - The Film Stage - September 22nd, 2022 [September 22nd, 2022]
- Bon Apptit's 2022 Heads of the Table Awards - Bon Appetit - September 22nd, 2022 [September 22nd, 2022]
- Coast Salish sweat-lodge keeper welcomes all to share in healing - Broadview Magazine - September 22nd, 2022 [September 22nd, 2022]
- In Guam, even the dead are dying: the US military is building on the graves of our ancestors - The Guardian - September 22nd, 2022 [September 22nd, 2022]
- Living Underground on the Moon: How Lava Tubes Could Aid Lunar Colonization - August 25th, 2022 [August 25th, 2022]
- Colonization of the Solar System - Wikipedia - August 25th, 2022 [August 25th, 2022]
- Under Capitalism, the Colonization of Space Means the ... - Jacobin - August 25th, 2022 [August 25th, 2022]
- A New World of Heavenly Art - The Epoch Times - August 25th, 2022 [August 25th, 2022]
- New Releases Tuesday: The Best Books Out This Week - Book Riot - August 25th, 2022 [August 25th, 2022]
- Diving into student research at the Summer 2022 SEA Fellows Symposium - UMaine News - University of Maine - University of Maine - August 25th, 2022 [August 25th, 2022]
- Skywatch for the week of August 22, 2022 - WQCS - August 23rd, 2022 [August 23rd, 2022]
- Law alum's career heads into orbit with unexpected passion for space law - University of Calgary - August 23rd, 2022 [August 23rd, 2022]
- Heres where we might really be able to set up a colony on the Moon - BGR - August 10th, 2022 [August 10th, 2022]
- Elon Musk's Flawed Vision and the Dangers of Trusting Billionaires - TIME - August 10th, 2022 [August 10th, 2022]
- Travel Bug: You don't have to be a diver to enjoy Palau - Pacific Daily News - August 10th, 2022 [August 10th, 2022]
- Avatar Was James Cameron's Tribute To A Legend Of VFX Filmmaking - /Film - July 31st, 2022 [July 31st, 2022]
- Sonic Youth : Sister, EVOL, Bad Moon Rising - The trilogy | Treble - Treble - July 31st, 2022 [July 31st, 2022]
- NASA's Lunar Orbiter spots comfortably warm 'pits' all over the Moon - The Register - July 27th, 2022 [July 27th, 2022]
- Will 3D Printing Be Used for the First Commercial Mission to Mars? - 3Dnatives - July 27th, 2022 [July 27th, 2022]
- Abe Leaves Behind Complex Legacy in Japan's Neighborhood - The Diplomat - July 27th, 2022 [July 27th, 2022]
- Moon Off-Roading In The Wild GM Electric Car That Makes Hummer EV Look Normal - SlashGear - June 30th, 2022 [June 30th, 2022]
- A conversation with a poet whose home burned to the ground - Yale Climate Connections - June 30th, 2022 [June 30th, 2022]
- Before Langley Air Force Base: The muddy history of Shellbanks, Sherwood and other plantations of Elizabeth City County - Daily Press - June 30th, 2022 [June 30th, 2022]
- colonization of Australia | Britannica - June 24th, 2022 [June 24th, 2022]
- NASA Reveals Three Design Concepts For Nuclear Power On The Moon - SlashGear - June 24th, 2022 [June 24th, 2022]
- Interview: Small modular reactors get a reality check about their waste - Bulletin of the Atomic Scientists - June 22nd, 2022 [June 22nd, 2022]
- Of Wazhazhe Land and Language: The Ongoing Project of Ancestral Work - Literary Hub - June 22nd, 2022 [June 22nd, 2022]
- The Oddest of Organs: A Brief History of the Tongue - Literary Hub - June 22nd, 2022 [June 22nd, 2022]
- 'For All Mankind' Season 3: Episode 2 - Recap And Ending, Explained - Who Was Chosen To Head The Mars Mission? | DMT - DMT - June 20th, 2022 [June 20th, 2022]
- New moon - Wikipedia - June 11th, 2022 [June 11th, 2022]
- Why Neil deGrasse Tyson Is Skeptical About Mars Colonization - June 3rd, 2022 [June 3rd, 2022]
- Bitcoin And The Great Filter - Bitcoin Magazine - June 3rd, 2022 [June 3rd, 2022]
- Art Attack: Where to Find Art on First Friday Weekend in Denver - Westword - June 3rd, 2022 [June 3rd, 2022]
- Scramble Campbell on His Two Decades as Red Rocks' Artist-in-Residence - Westword - June 3rd, 2022 [June 3rd, 2022]
- Pro and Con: Space Colonization | Britannica - May 31st, 2022 [May 31st, 2022]
- How Many Humans Could the Moon Support? | Live Science - May 31st, 2022 [May 31st, 2022]