Should schools ban AI? It is the question every district, dean, and department head has been wrestling with since ChatGPT landed. However, it is the wrong question.
Here is the short answer: banning AI does not hold, and it does not prepare students for a world that already runs on it. In fact, the schools spending their energy on enforcement are spending it on something that does not work. By contrast, the schools redesigning how they teach are the ones actually getting students ready. Ultimately, the real divide is not ban versus allow. It is policing versus teaching.
This is not a hunch. Rather, there is hard evidence behind every part of it, and most of it points the same direction.
TL;DR: Key Takeaways
- Bans don’t hold. Even New York City, the largest US school district, reversed its ChatGPT ban within one semester.
- The enforcement tool is broken. OpenAI shut down its own AI detector, and NYU, Vanderbilt, and Waterloo switched theirs off for false-flagging honest students.
- AI lies with confidence. GPT-4 still fabricates citations, and newer models have not eliminated the problem.
- The real skill is verification, and it is teachable. Teaching students to check AI’s sources, not banning the tool, is what prepares them for the workplace they are heading into.
Should schools ban AI? It is the question every district, dean, and department head has been wrestling with since ChatGPT landed. However, it is the wrong question.
Here is the short answer: banning AI does not hold, and it does not prepare students for a world that already runs on it. In fact, the schools spending their energy on enforcement are spending it on something that does not work. By contrast, the schools redesigning how they teach are the ones actually getting students ready.
Ultimately, the real divide is not ban versus allow. It is policing versus teaching.
This is not a hunch. There is hard evidence behind every part of it, and most of it points in the same direction.
Should schools ban AI? The bans aren’t holding
Start with the biggest test case we have. In December 2022, New York City’s Department of Education, the largest school system in the country, blocked ChatGPT on its networks and devices [1]. The reasons will sound familiar: concerns about accuracy and a worry that the tool “does not build critical-thinking and problem-solving skills” [1].
However, the ban lasted about one semester.
On May 18, 2023, Chancellor David Banks reversed the decision in an op-ed. He wrote that the “knee-jerk fear and risk overlooked the potential of generative AI to support students and teachers” and that “our students are participating in and will work in a world where understanding generative AI is crucial” [2].
Rather than simply lift the block, the district committed to giving educators implementation resources, a shared repository of what worked, and toolkits for classroom conversations about AI ethics [2].
If the nation’s largest district could not make a ban stick past one semester, that tells you something about the strategy itself.
Furthermore, New York City is not alone in walking back enforcement. Across higher education, the tools built to catch AI use are being switched off. Washington State University cancelled its Turnitin AI-detection contract in early 2026, aligning with R1 peers that had already dropped detectors, including UC Berkeley, Colorado State, Indiana, Michigan State, Oregon State, and the University of Washington [3].
AI detection can’t enforce a ban on AI in schools
A ban is only as good as your ability to enforce it, and enforcement rests on AI detection. That is where the whole strategy quietly collapses.
Even OpenAI couldn’t build a working detector
Consider who gave up first. OpenAI, the company that makes ChatGPT, shut down its own AI-detection tool in July 2023 because of its “low rate of accuracy” [4].
At launch, it caught only 26% of AI-written text while falsely flagging 9% of human writing as machine-made [4]. When the company that built the engine cannot build a reliable radar for it, that is not a bug you patch with a better detector.
False positives punish honest students
The classroom data is worse because the false positives are not random. They land hardest on the students least able to defend themselves.
- A Stanford study found detectors flagged 61% of essays by non-native English speakers as AI-generated, compared with about 5% for native speakers [5]. Same tools, same day.
- The same study showed how easily detectors are fooled. Adding one instruction, “elevate the text with literary language,” crashed detector accuracy from nearly 100% to 13% [5]. The tools punish honest writers and wave through anyone who knows a single trick.
- Vanderbilt ran the math on its own usage, roughly 75,000 papers in 2022. Even at Turnitin’s advertised 1% error rate, that meant about 750 students falsely accused in a single year, so the university disabled the detector [6].
- NYU found the real-world false-positive rate closer to 4%, or 1 in every 25 honest students, and disabled it too [7].
- The University of Waterloo dropped the detector after internal tests flagged human-written text as “100% AI-generated” [3].
Better models won’t fix it
This is not just an engineering problem that better models will fix.
Researchers demonstrated mathematically that reliable AI-text detection is “not possible in the limit.” Recursive paraphrasing can defeat watermarked, neural, zero-shot, and retrieval-based detectors. As models improve, the statistical gap between human and machine text also shrinks [8].
Likewise, an evaluation of 14 detection tools found them “neither accurate nor reliable.” The tools were easily degraded by simple obfuscation and tended to classify text as human-written [9].
You cannot police your way out of this. The radar does not work.
Isn’t AI destroying critical thinking?
This is the fear underneath most bans, and it deserves an honest answer rather than a slogan.
The honest answer is that it depends entirely on how the tool is used.
Used passively, AI can be an atrophy machine. If an assignment only asks a student to find a source, summarize it, and cite it, AI automates that overnight. The student offloads the work, and no thinking happens.
Right now, many students are using it passively. Among surveyed university students, only 27.5% consistently verified AI-generated content, while 60.8% had submitted AI text with minimal editing [10]. Among teens aged 13 to 18, 70% had used generative AI. Of those using it for schoolwork, nearly half did so without their teacher’s permission [11].
That is the tell. Verification is a teachable skill, but students need opportunities to practice it.
The move is to push the work up a level. Instead of “summarize three sources,” the assignment becomes: “Here is what the AI told you. Now find where it is wrong.”
And it will be wrong, which we will get to in a moment.
A student who has to catch a fabricated citation is evaluating credibility, tracing evidence, and defending a judgment. That is harder and more valuable than a summary assignment that AI can complete in seconds.
AI did not kill critical thinking. Lazy assignment design did, and AI just made it impossible to hide.
Can we even trust AI? Not blindly, because it lies with a straight face
The most dangerous thing about AI is not that it fails. It is that it fails confidently, handing you a polished, plausible answer with a real professor’s name attached to a paper that does not exist.
The evidence on fabricated citations
The research on fabricated citations is sobering:
- When researchers asked ChatGPT for medical references, 69% of the citations were completely fabricated, complete with real authors’ names, plausible titles, and real-looking journals [12].
- Another study found only 7% of ChatGPT’s medical citations were both real and accurate, with a wrong identifier appearing in 93% of them [13].
- This is not just a problem with the earliest models. A Scientific Reports analysis found GPT-4 fabricated 18% of citations outright. Of the real sources it cited, 24% had major errors in the journal, volume, or page [14].
When AI hallucinations reach the courtroom
These are not abstract risks. They are producing real consequences for people who should know better.
A federal court fined lawyers $5,000 for a brief built on six ChatGPT-invented cases [15]. In an Oregon case, a court imposed $110,204.38 in combined sanctions and dismissed a lawsuit involving roughly $12 million in claims after filings included 15 nonexistent cases and eight fabricated quotations [16].
In 2026, a California appellate court affirmed $6,000 in sanctions against a law firm and three attorneys [17]. A Mississippi federal judge also sanctioned lawyers on both sides of a case for AI-hallucinated citations [18].
If trained attorneys with everything on the line get fooled, a 19-year-old writing at 2 a.m. does not stand a chance.
So can we trust AI? Not blindly, and anyone who tells you otherwise is selling something.
The answer is not “trust it” or “ban it.” It is “verify it.” Trust the sources you can check.
Banning AI is a preparation problem, not a cheating problem
Here is the part that bans get exactly backwards: the workplace students are heading into already runs on AI.
A 2025 survey of 3,000 workers across the United States, United Kingdom, and Germany found that 78% used AI in their role. Of those workers, 97% used it weekly [19]. A separate 2025 survey of more than 1,300 organizations found roughly 95% used AI, with 58% using it daily [19].
A blanket ban does not protect students from that world. It sends them into it missing a core skill while pretending the tool does not exist.
It is like teaching someone to drive by hiding the car.
That said, “just let them use it” is equally lazy because most students are not checking the output. The goal is not AI-proof assignments. It is AI-literate students.
In practice, that means guided use with verification built into the work:
- Show your sources.
- Explain how you evaluated them.
- Defend your reasoning.
- Flag what the AI got wrong.
- Disclose how the tool contributed.
What works instead of banning AI: teach verification
If detection is unreliable and bans do not hold, schools should build the skill students need most.
That skill is not simply finding information. It is interrogating it.
Can you trace a claim back to a real source? Can you tell when a citation is a ghost? Can you determine whether a real paper actually supports the claim attached to it?
Verification is the new literacy. The schools that teach it now will graduate students who can think with AI instead of being fooled by it.
Turn AI literacy into something students can practice
The complete framework, four-step citation check, classroom exercises, and templates are available in CoChat’s free Definitive Guide to AI Literacy for Academic Research.
The guide helps students, researchers, and faculty use AI with greater confidence, accuracy, and integrity. It includes:
- A practical workflow for checking whether a citation exists, whether its metadata is correct, and whether it supports the claim
- An AI Research Tool Evaluation Checklist
- An AI Use Disclosure Statement for coursework, journal articles, and theses
- A Literature Review Table starter
- Exercises instructors can adapt into assignments
Get the free guide and templates →
This is also the problem CoChat was built to solve. CoChat is an AI research workspace where verification is built into the workflow.
When a student is working on a paper, CoChat checks citations against academic databases including CrossRef, Semantic Scholar, OpenAlex, and arXiv, so a hallucinated source can be caught before it reaches the bibliography [20]. It reads the full text of available sources, not just the abstract.
It also turns research into things students actually use, including literature review tables, citation-managed exports, and flashcards built from the findings.
This is assistive, not magic. On a deep search, CoChat can screen up to 1,000 sources and report on the most relevant 50, so a human still makes the final call on what belongs.
That is the point. The tool does the checking a student cannot do at scale, and the student does the judging that no tool should do for them.
It is the difference between an AI that hands you an answer and one that shows you the receipts.
The question was never whether students use AI
It was whether they can tell when it is wrong.
Banning AI answers the first question and ignores the second, which is the one that determines whether a student is ready for college, work, and a world where confident, fluent, fabricated information is everywhere.
Detection cannot reliably enforce a ban. Bans do not hold. Neither one teaches the skill that fixes the real problem.
So the honest answer to “should schools ban AI?” is no.
Stop policing. Start teaching students to verify. That is the assignment now.
Want to see what verification-first research looks like in practice? Explore CoChat or read how we fixed citation hallucinations.
References
- Chalkbeat. “NYC bans access to ChatGPT on school computers, networks.” January 3, 2023.
- Chalkbeat. “ChatGPT caught NYC schools off guard. Now, we’re determined to embrace its potential.” David Banks op-ed. May 18, 2023.
- University of Waterloo. “Discontinuing use of AI detection functionality in Turnitin.” September 2025. Washington State University and R1 peer detail, February 2026.
- OpenAI. “New AI classifier for indicating AI-written text.” January 31, 2023. Discontinued July 20, 2023.
- Liang W, Yuksekgonul M, Mao Y, Wu E, Zou J. “GPT detectors are biased against non-native English writers.” Patterns. 2023. DOI: 10.1016/j.patter.2023.100779
- Vanderbilt University. “Guidance on AI Detection and Why We’re Disabling Turnitin’s AI Detector.” August 16, 2023.
- New York University, Office of the Provost. “Disabling the AI Tool in Turnitin.” September 7, 2023.
- Sadasivan VS, Kumar A, Balasubramanian S, Wang W, Feizi S. “Can AI-Generated Text be Reliably Detected?” arXiv:2303.11156. 2023.
- Weber-Wulff D, et al. “Testing of detection tools for AI-generated text.” International Journal for Educational Integrity. 2023. DOI: 10.1007/s40979-023-00146-z
- Naik GR, Pednekar R, Shaikh M, Khan U. “Artificial Intelligence (AI) Tools in Higher Education: An Empirical Study.” International Journal of Computer Science and Engineering. 2026. DOI: 10.5281/zenodo.20683366
- Common Sense Media. “The Dawn of the AI Era: Teens, Parents, and the Adoption of Generative AI at Home and School.” 2024.
- Gravel J, D’Amours-Gravel M, Osmanlliu E. “Learning to Fake It: Limited Responses and Fabricated References Provided by ChatGPT for Medical Questions.” Mayo Clinic Proceedings: Digital Health. 2023. DOI: 10.1016/j.mcpdig.2023.05.004
- Bhattacharyya M, Miller VM, Bhattacharyya D, Miller L. “High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content.” Cureus. 2023. DOI: 10.7759/cureus.39238
- Walters WH, Wilder EI. “Fabrication and errors in the bibliographic citations generated by ChatGPT.” Scientific Reports. 2023. DOI: 10.1038/s41598-023-41032-5
- Mata v. Avianca, Inc., S.D.N.Y. June 2023. $5,000 sanction for six fabricated ChatGPT citations.
- Couvrette v. Wisnovsky, No. 1:21-cv-00157-CL, D. Oregon, 2025 to 2026. Judge Mark D. Clarke dismissed plaintiff Joanne Couvrette’s claims with prejudice as a terminating sanction on December 12, 2025, and approved $110,204.38 in combined sanctions. The sanctions consisted of a $15,500 fine on lead counsel Stephen Brigandi plus $94,704.38 in fees, over 15 nonexistent cases and eight fabricated quotations. The case involved roughly $12 million in claims.
- Quinteros v. Harbor Distributing, LLC, No. A174202, California Court of Appeal, June 11, 2026. Affirmed $6,000 in sanctions, with $5,000 payable to defendants and $1,000 to the court, against Lipeles Law Group and three attorneys.
- Withers v. City of Aberdeen, No. 1:24-cv-00218, N.D. Miss., June 8, 2026. Senior Judge Sharion Aycock sanctioned lawyers on both sides for AI-hallucinated citations.
- SnapLogic / 3GEM “AI at Work” survey, 3,000 workers across the United States, United Kingdom, and Germany; American Management Association 2025 AI survey, 1,365 respondents.
- CoChat verifies citations against a database of more than 200 million papers using CrossRef and Semantic Scholar before a source reaches a draft.
