Are ChatGPT and Claude Making You a Worse Writer? The ‘Fluency Trap’ Explained
Have you ever used ChatGPT or Claude to polish a paragraph, only to realize later that the content was hollow? A new study suggests you might be falling into what researchers call the fluency trap. This phenomenon occurs when AI-generated text feels so smooth and confident that it tricks writers into thinking the work is complete—even when the ideas are shallow or inaccurate.
Published in the journal Computers and Composition, the research followed 38 undergraduate students over two semesters in an experimental “AI and Writing” course. The findings are a wake-up call for anyone relying on AI for writing tasks.
What Is the Fluency Trap in AI Writing?
The fluency trap describes a dangerous dynamic: AI writing tools produce text that reads as polished, authoritative, and error-free. But this surface-level perfection often masks a lack of depth. According to Abram Anders, associate professor of English at Iowa State University and co-author of the study, “AI writes in confident sentences, uses the right tone and sounds smart. But that polish can trick students into trusting it, even when it’s wrong, shallow, or missing the point entirely.”
Many students initially approached AI like a search engine—typing in a vague prompt and accepting whatever output appeared. They assumed that because the text flowed well, it was accurate and complete. In reality, the AI was generating plausible-sounding but hollow content.
Why Polished Output Isn’t Enough
This trap is particularly insidious because it exploits our cognitive biases. When text looks clean and reads smoothly, we naturally assume it’s correct. However, as the study highlights, fluency does not equal accuracy. Writers end up with a false sense of accomplishment, skipping the critical thinking required to evaluate and refine ideas.
As Anders and co-author Emily Dux Speltz (assistant professor at Embry-Riddle Aeronautical University) note, students who fell into the trap often spent less time revising or fact-checking. They mistook AI’s confident tone for reliable substance.
How to Avoid the Fluency Trap
The good news is that the fluency trap is avoidable. The researchers identified three key thresholds that writers must cross to use AI effectively:
1. Embrace Trial and Error
Effective AI writing isn’t about a single prompt and accept. It requires genuine trial and error. Writers need to experiment with different prompts, refine their queries, and compare multiple outputs before settling on a version. This process mirrors the drafting and revision cycle that strong writers already practice.
2. Apply Human Judgment
AI output still needs human oversight. Writers must check claims, refine logic, and ensure the text matches the expectations of their audience or context. As the study emphasizes, “AI can generate text, but it cannot generate purpose.” Only the writer can decide what the piece is arguing and why it matters.
3. Move from Outsourcing to Orchestrating
Students who mastered these thresholds stopped treating AI as a shortcut. Instead, they used it to test ideas, evaluate options, and sharpen their arguments. Anders and Dux Speltz describe this shift as moving from outsourcing your writing to orchestrating it. This approach transforms AI from a crutch into a creative partner.
For more on improving your writing process, check out our guide on best practices for AI-assisted writing.
What Good AI-Assisted Writing Looks Like
So, what does effective AI-assisted writing actually look like? It starts with a clear purpose. Instead of asking AI to “write an essay on climate change,” a skilled user might prompt: “Generate three contrasting arguments about carbon pricing, each supported by one potential counterpoint.” This approach forces the writer to think critically about structure and evidence.
The researchers observed that students who succeeded treated AI as a brainstorming tool rather than a final editor. They used it to explore angles, identify gaps in their reasoning, and test the strength of their thesis. In the end, they produced work that was both fluent and substantive.
If you’re looking to refine your AI writing skills, consider exploring our resource on effective prompt engineering techniques.
The Bottom Line: Writing Is Still Thinking
As Anders puts it, “AI changes the workflow, but it doesn’t change the fact that writing is thinking.” This distinction matters more than ever as AI-generated text becomes harder to distinguish from human writing. The fluency trap is real, but it’s not inevitable. By staying aware of its dangers and adopting a more deliberate approach, writers can harness AI’s power without sacrificing depth or originality.
Ultimately, the best AI-assisted writing combines machine fluency with human insight. Don’t let the polish fool you—keep questioning, keep refining, and keep thinking.
