Back when artificial intelligence development company OpenAI created the text-writing algorithm GPT-2, it initially said it was too dangerous to release into the world.
Of course, it eventually did did release a full version of the neural network. By and large, it turned out that people were more interested in using GPT-2 as an AI dungeon master than churning out the endless torrent of fake news and propaganda that OpenAI had worried about.
But one evil genius slipped through the cracks: Tiago, a student whos getting his masters degree in business, told Futurism that hebeen using GPT-2 to write essays for his coursework.
He was willing to share his story and copies of his AI-generated essays on the condition that Futurism didnt share identifying information beyond his first name.
I dont know if it qualifies as plagiarism, Tiago told Futurism. I figure no, maybe, but thats not a gamble Id like to take right now.
Below is Futurisms conversation with Tiago, which has been lightly edited for clarity.
So, you used the AI algorithm GPT-2 to write one of your homework assignments. I have to say, thats an incredible move to pull off.
Tiago: Well, not that amazing. I would say, all my friends that work in tech and the STEM fields dont understand how poor the business school curriculum is in general. Its not as much a feat for GPT-2, Id say, as proof of the poorness of business schools curriculum.
You couldnt write an essay on science that could be anywhere near as convincing using the methods that I used. Many of the courses that I take in business school wouldnt make it possible as well. However, some particular courses are less information-dense, and so if you can manage to write a few pages with some kind of structure and some kind of argument, you can get through. Its not that great of an achievement, I would say, for GPT-2.
What was the actual assignment?
We did a presentation on some kind of business case, and then we had to do a follow-up essay. Three to five pages on that business case, and what it meant. Its weird to explain.
I would have to say also Im more pessimistic than the average business school student those courses that revolve around the business cases are not as fact-based as courses you might be used to. Because business cases are not like a theorem, theyre more like a parable.
It could be how innovation is important or something like that. You can take any conclusion that you want, and if it makes sense and if it fits in the more general narrative, you are assured a passing grade. Its very far from publishing an academic essay Id like to stress that point.
What gave you the idea to use GPT-2 for this assignment in particular?
I read an article about a student contest for essays on climate change. One of the entries was not a student, but a journalist at The Economist who used GPT-2 to write an entry. It was a very close experiment to my essay.
At that point, I started looking up how I could use GPT-2 to write essays in some of my classes. However, I do not have a technical background at all, so it was too much for me.
One thing that was made available between that time and the essay that I wrote was a tool, Talktotransformer.com, which makes GPT-2 accessible to everyone through a web browser. I dont know the details, but thats what made it possible for someone with a non-technical background like me to use GPT-2 to write my essay.
How did you actually write the essay? Did you have a game plan going in, or did you basically put some writing into TalkToTransformer and hope for the best?
Basically, I wrote the outline of my essay, with a few sentences or a paragraph per section, each with a point. And then I fed the first sentence of each paragraph that I wrote, fed it to GPT-2, and I got a full paragraph.
I had to iterate a few times to get something that was close to what I was looking for, and then I put it back in my word document and went to my next paragraph.
So you provided one sentence per paragraph, sort of like a topic sentence, and let the algorithm fill it out?
I wrote the structure and one sentence per paragraph. All the information that was in that final essay was in that structure, but the sentences were added by GPT-2. It added false quotes sometimes, or false information about the companies I was talking about. I found adding words like innovation, synergy,and stuff like that made the essay sound more suited for the course.
I did it for two essays in two different courses. What I figured as I was doing it was that if I write my first sentence in a certain way, it increases the probability that the paragraph will look how I want it to. So, if I use the words that are in a lot of business review articles, then the probability of similar words and similar points being made in the generated paragraph was increased.
What did you think of the output? Did it seem believable to you? Did you have to fix any errors?
I would write the first sentence of the paragraph, lets say the point of the paragraph is Starbucks has innovated by raising the quality of its coffee. I would write a sentence that encompasses the whole point, and then I would feed it to GPT-2, and then I would get a paragraph. I would generate again until I get something that I found more or less believable.
Some sentences would generate paragraphs indifferent tones. So, for instance, if I used some keywords, it would write a quote from the Starbucks CEO like what he would say in a shareholders meeting. But if I wrote it slightly differently, it might produce something about how to make coffee.
So you didnt change the paragraph at all once it looked about right?
There was light editing. Removing a sentence from a paragraph or adding it elsewhere. Sometimes GPT-2 would start a quote without ending it, so I would have to remove it.
Or it would make some bold claims that I was not comfortable with because they were factually false. Those I would remove.
And how was it received? Did the paper get a passing grade?
Both times I passed. But there was not much feedback on one of them, just a grade. And the second one, there was a grade on relationship to the subject, whether it got the point across.
It did get an okay grade. I dont have the grades for other students, but I think 80 percent of the class passed. Its hard to tell. I passed and some students didnt, but I was far from the best. I was clearly one of the worst ones that did pass.
It was okay for me because Im at the end of my masters and this was one of my last classes. For me, it was just pass or fail.
Were you nervous at all when you were submitting the work? Were you concerned that youd be found out?
I was confident enough to turn it in. However, I then was looking online and found out theres a really easy way to find out if an essay was written by GPT-2. Its to feed it to GPT-2 and if its able to predict the next words, then it was written by the AI. Its easier to find out than normal plagiarism.
I knew that the business school had software that they were using to look out for plagiarism in all the essays that are turned in to their online platform, which is how I turned in my essays. So I was slightly worried that the company that sold them the anti-plagiarism software would have made an update.
I dont think the professors even considered the possibility of GPT-2 writing the essays, but I was slightly worried that the company making the software added a module. But not that much.
Were you surprised when you passed?
Not really. I think its hard to get across to people who didnt study in business school how poor the standards are for essays that are turned in. I think the professors are too proud to think of the possibility of AI writing an essay. But it was really easy to do.
I think it will become an issue for business schools in the future, and unfortunately for students, its easily solved through anti-plagiarism software.
I know youre basically done with school. But if you had more ahead of you, would you do this again? Or was it more of a fun experiment for you?
Yeah, this is something Id do again. You just cant expect a good grade. The final essay is pretty poor, its just not poor enough for the professor to fail you.
More on GPT-2: Now You Can Experiment With OpenAIs Dangerous Fake News AI
- Introducing the Campus Technology Insider Podcast - Campus Technology - June 24th, 2020
- This is What Sunsets on Other Planets Would Look Like - Futurism - June 24th, 2020
- Astronomers May Have Discovered First-Ever Black Neutron Star - Futurism - June 24th, 2020
- NASA: Next Moon Astronauts Will Hike 10 Miles on Lunar Surface - Futurism - June 24th, 2020
- As fashion resets, its algorithms should too - Vogue Business - June 24th, 2020
- China Is Building a Genetic Database of Every Man in the Country - Futurism - June 24th, 2020
- The Death of the Open-Plan Office? Not Quite, but a Revolution is in the Air - Nextgov - June 24th, 2020
- Freestyle Acquires Divos!; Docs The Prison Within & Superhuman Find Homes; Random Media Takes Opus Of An Angel Film Deal Briefs - Deadline - June 24th, 2020
- Nicholas Mallis' Final Station, And More Music News and Gossip | Flagpole - Flagpole Magazine - June 24th, 2020
- Renewal Shows the Possibility of a Better World Post-Covid - Press Release - Digital Journal - June 24th, 2020
- Working from home is missing something that only offices and cities can provide - MarketWatch - June 24th, 2020
- Futurist site: Flamingo Land thanked for 'sticking with us'; remarketing the site 'would not be appropriate' says council's deputy leader - The... - June 20th, 2020
- How a global pandemic is changing the world: Part 1 - SmartBrief - June 20th, 2020
- Step into 2030: Join The Drum's futurist session to hear what the next decade holds - The Drum - June 13th, 2020
- This Flying Car Looks Like the DeLorean From "Back to the Future" - Futurism - June 13th, 2020
- Bad News: Another Deadly Virus Is Spreading in the US - Futurism - June 13th, 2020
- This Guy Accidentally Took a Photo That Crashes Android Smartphones - Futurism - June 13th, 2020
- Coronavirus live updates: Here's what to know in South Florida on June 12 - msnNOW - June 13th, 2020
- Scientists Claim the Universe Is Actually Flat - Futurism - June 13th, 2020
- SpaceX Trying to Figure Out How to Land Starship on the Moon - Futurism - June 13th, 2020
- Scientists Claim to Have Recreated Earth's First Life - Futurism - June 13th, 2020
- Collapsed Star Proves Another of Einstein's Theories - Futurism - June 13th, 2020
- Elon Musk: Teslas Semi Truck is Officially Going Into Production - Futurism - June 13th, 2020
- This Quasar Warps Itself Into a Ring by Distorting Spacetime - Futurism - June 13th, 2020
- Justice League: Who Is the DC Universe's Tony Stark? | CBR - CBR - Comic Book Resources - June 13th, 2020
- A Futurist's Advice on Navigating through the Technology Valley of Death - CEOWORLD magazine - June 13th, 2020
- A Futurist Explains What Emerging Jobs Will Be Necessary Post-Virus - Hit 107 - June 6th, 2020
- Experts: Protests Unlikely to Cause Huge Wave of COVID Cases - Futurism - June 6th, 2020
- After Explosion, SpaceX Still Hoping to Launch Starship This Year - Futurism - June 6th, 2020
- NASA InSight Lander Finally Manages to Bury Its Probe Into Mars - Futurism - June 6th, 2020
- Evidence Suggests That the Entire Early Universe Was Rotating - Futurism - June 6th, 2020
- Elon Musk Just Absolutely Roasted the Russian Space Program - Futurism - June 6th, 2020
- Study: More Than 500 Vertebrates Poised To Go Extinct - Futurism - June 6th, 2020
- Allison Fine Featured in The New Yorker - Philanthropy Women - June 6th, 2020
- MSN Fires Journalists, Replaces Them With AI - Futurism - June 6th, 2020
- What will design look like in 2030? We asked 3 futurists - Business of Home - June 1st, 2020
- Interstellar Visitor May Be One of Rarest Objects In Universe - Futurism - June 1st, 2020
- Vancouver Island's long road to recovery will have a few bumps - vancouverislandfreedaily.com - June 1st, 2020
- 5G Technology - The Cybersecurity Implications of Widespread - tripwire.com - June 1st, 2020
- Half the Visible Universe Was Missing. Scientists Just Found It. - Futurism - June 1st, 2020
- The New Reality: Future of shopping malls in jeopardy as COVID-19 pandemic pushes shoppers online - cjoy.com - June 1st, 2020
- Only One in Two Americans Say They'd Take a COVID-19 Vaccine - Futurism - June 1st, 2020
- Watch the Astronauts Give Their Kids Virtual Hugs Before Launch - Futurism - June 1st, 2020
- Changing face of Liverpool city centre and the shops we've lost along the way - Liverpool Echo - June 1st, 2020
- Folk's Jason Wilber Examines the World Through a Futurist Lens in 'Time Traveler' (album stream) - PopMatters - May 29th, 2020
- The Conversation: Beware of Unemployment Insurance Scammers - Hawaiipublicradio - May 29th, 2020
- The long road to recovery will have a few bumps Victoria News - Victoria News - May 29th, 2020
- The stakes have never been higher as America reopens. What can a post-coronavirus world look like? - USA TODAY - May 29th, 2020
- On the Futurist Cookbook - Apollo Magazine - May 14th, 2020
- UWO alumnus and renowned futurist: 'There has never been more opportunity to make a difference' - UW Oshkosh Today - May 14th, 2020
- What will the world look like after corona? - ISRAEL21c - May 14th, 2020
- US Officials: Chinese Hackers Are Targeting Vaccine Research - Futurism - May 14th, 2020
- Dock a SpaceX Spacecraft to the ISS in This Amazing Simulator - Futurism - May 14th, 2020
- WHO: The Coronavirus Might Be Here Forever - Futurism - May 14th, 2020
- Documentary Spaceship Earth resurrects stranger-than-fiction story of utopian Biosphere 2 experiment - ABC News - May 14th, 2020
- Scientists Have a Promising New Idea to Defeat the Coronavirus - Futurism - May 14th, 2020
- Fauci: Reopening Too Soon Could Lead to "Suffering and Death" - Futurism - May 14th, 2020
- Augmented reality giant Magic Leap is closing its Seattle office amid layoffs - GeekWire - May 14th, 2020
- How will you re-introduce your business to customers? - Trinidad Guardian - May 14th, 2020
- There's a Resurgence of Coronavirus Cases in China - Futurism - May 14th, 2020
- Futurism | Definition, Manifesto, Artists, & Facts ... - April 30th, 2020
- 7 Top Futurists Make Some Pretty Surprising Predictions ... - April 30th, 2020
- The White House Is Trying to Shut Down NASA's Last Mars Rover - Futurism - April 30th, 2020
- Free DNA Test Claims to Warn Whether COVID Is Likely to Kill You - Futurism - April 30th, 2020
- New Zealand Claims to Have Eliminated COVID-19 - Futurism - April 30th, 2020
- The Laws of Physics May Break Down at the Edge of the Universe - Futurism - April 30th, 2020
- These Mathematicians Think the Universe May Be Conscious - Futurism - April 30th, 2020
- This COVID-19 Vaccine Could Be Ready by September - Futurism - April 30th, 2020
- The Conversation: The Future After the Coronavirus Crisis - Hawaiipublicradio - April 30th, 2020
- Elon Musk Says the Starlink Network Will Go Live in Six Months - Futurism - April 26th, 2020
- NASA: Something Is Off About This Interstellar Comet - Futurism - April 26th, 2020
- This is What Air Travel Could Look Like After the Pandemic - Futurism - April 26th, 2020
- The Coronavirus May Be Doing Something Strange to Your Toes - Futurism - April 26th, 2020
- We Need Herd Immunity From Trump and the Coronavirus - The New York Times - April 26th, 2020
- The revolution will not be memorised - Schools Week - April 26th, 2020
- For the First Time Ever, the Price of Oil is Now Negative - Futurism - April 26th, 2020
- The future of work is here: How 'distance work' is transforming the workplace - Washington Technology - April 26th, 2020
- Living In The City - The Chattanoogan - April 26th, 2020
- New Study Predicts the Ocean Ecosystem Will Collapse This Decade - Futurism - April 11th, 2020
- Terrifying Simulation Shows How Viruses Spread When You Cough - Futurism - April 11th, 2020