ChatGPT in Education – A Shortcut or a Learning Revolution?
When ChatGPT, the now-famous AI developed by OpenAI, took a seat (virtually, of course) in a control systems engineering course at the University of Illinois Urbana-Champaign, expectations ran high. Could this ground-breaking technology compete with human undergraduates? Would it ace the course, stumble, or offer a glimpse into the future of education?
Researchers in the Aerospace Engineering Department at The Grainger College of Engineering decided to put ChatGPT through its paces. Over an entire semester, the AI was tasked with completing assignments side-by-side with actual students, using exactly the same prompts and course materials. And, unsurprisingly, the results sparked a fascinating conversation about AI’s role in education.
Solid Performance, Questionable Depth
On structured, straightforward maths assignments, ChatGPT shone brightly, achieving an impressive A-grade. Yet, on assignments demanding critical thinking and nuanced analysis, its performance plunged dramatically, managing only a disappointing D-grade. Averaging these results, the AI finished the semester with an overall grade of 82%, barely scraping a low B. Human students edged slightly ahead, achieving an average of 84.85%.
PhD researcher Gokul Puthumanaillam summarised the outcomes succinctly: “We found ChatGPT technology can get an A on structured, straightforward questions. On open-ended questions it got a 62, bringing ChatGPT’s semester grade down to an 82, a low B.” He added that while the results indicate a potential shortcut to passing grades, the underlying understanding and learning processes were significantly compromised.
The Mirage of Effortless Success
ChatGPT might offer a tempting route for students looking to pass with minimal effort, but the reality of learning can’t be ignored. A student relying solely on the AI might achieve passing grades through a peculiar combination of excellent basic arithmetic and barely adequate analytical skills, without truly mastering the course content.
Puthumanaillam’s advisor, Melkior Ornik, reflected critically on these findings: “Like calculators in maths classes, ChatGPT is a tool that’s here to stay and that students will use. What the results of this study pointed out to me is that I need to adjust as an educator.” Ornik highlighted the necessity of reshaping courses to emphasise higher-level thinking and complex, open-ended questions, thereby reinforcing genuine understanding rather than superficial learning.
Oddities and Imperfections
While undeniably efficient, ChatGPT wasn’t without its quirks. The AI often delivered answers swiftly—20 seconds compared to a student’s 20-minute effort—but accuracy wasn’t guaranteed. Puthumanaillam noted: “ChatGPT solves it in less than 20 seconds, but the correctness is sometimes questionable.”
The researchers observed some bizarre responses, too. Despite receiving comprehensive course material, the AI occasionally fabricated technical jargon such as “quasi-periodic oscillations”—terms entirely absent from the curriculum. This phenomenon, known as hallucination in AI circles, illustrates how ChatGPT can confidently deliver incorrect information.
The Limitations of AI’s ‘Learning’ Ability
Can ChatGPT learn from past mistakes? According to the researchers, only superficially. When corrected, the AI improved slightly on multiple-choice questions, yet overall performance remained fairly stagnant. “If it scored 90 percent in homework, it ended up scoring 90 or 92 at the conclusion of the semester,” Puthumanaillam remarked, underscoring the limited nature of ChatGPT’s adaptive learning within the test parameters.
Interestingly, the study used the freely accessible version of ChatGPT rather than the premium subscription. Puthumanaillam speculated that premium versions, equipped with enhanced memory capabilities and analytical strengths, might have yielded slightly better results. Yet, cost remains a barrier for the average student.
AI’s Impact on Future Educational Models
This study isn’t just an academic curiosity—it signals profound implications for the educational landscape. Rather than viewing ChatGPT purely as a shortcut to completing coursework, it might be better leveraged as an innovative learning companion. This, however, demands careful educational reform, transforming traditional assessments into rigorous, project-based, open-ended tasks that necessitate genuine intellectual engagement.
Looking forward, educators must rethink their strategies. Integrating AI could lead to classrooms where mundane, repetitive tasks are AI-driven, freeing human cognition for creative, analytical, and deeply thoughtful activities. This symbiotic relationship between AI and education might represent the ideal future scenario, where technology enhances rather than undermines educational quality.
Encouraging Authentic Learning
Ultimately, reliance on AI to pass courses without genuine learning is akin to using a calculator to complete maths homework without ever understanding arithmetic. It might get you through the test, but it won’t equip you for real-world applications or professional challenges.
To fully embrace AI’s potential in education, it must be used judiciously and strategically. As the researchers at Illinois propose, educators need to adapt and elevate the complexity and creativity of their assignments. Only then can tools like ChatGPT truly augment education rather than diminish it.
Moving Forward with Intelligence and Integrity
The future of education, influenced profoundly by AI, hinges on striking the right balance. Students must be encouraged to view technologies like ChatGPT as partners in their educational journey, not mere substitutes for effort and intellectual engagement. For educational institutions, this moment represents a pivotal opportunity to rethink pedagogical approaches and assessment strategies.
As ChatGPT and similar technologies inevitably evolve and improve, they will undoubtedly find a meaningful place in education. The goal, therefore, is not to resist these tools but to integrate them wisely, preserving academic integrity and fostering authentic learning.
After all, the true promise of education lies not in shortcuts, but in nurturing critical thinking, innovation, and understanding—qualities that no AI can fully replicate, yet all can support.
