Perfect homework, blank stares: Why colleges are turning to oral exams to combat AI

[Coventina]

The assignment involves no laptop, no chatbot and no technology of any kind. In fact, there’s no pen or paper, either.

Instead, students in Chris Schaffer’s biomedical engineering class at Cornell University are required to speak directly to an instructor in what he calls an “oral defense.”

It’s a testing method as old as Socrates and making a comeback in the AI age. A growing number of college professors say they are turning to oral exams, and combining a variety of old-fashioned and cutting-edge techniques, to help address a crisis in higher education.

“You won’t be able to AI your way through an oral exam,” says Schaffer, who introduced the oral defense last semester.

Educators are no longer naively wondering if students will use generative AI to do their homework for them. A big question now is how to determine what students are actually learning.

College instructors across the U.S. are noticing troubling new trends as generative artificial intelligence becomes more sophisticated. Take-home essays and other written assignments are coming back perfect. But when students are asked to explain their work, they can’t. The long-term impact of AI use on critical thinking remains to be seen, but educators worry students increasingly see the hard work of thinking as optional.

https://triblive.com/news/world/perfect-homework-blank-stares-why-colleges-are-turning-to-oral-exams-to-combat-ai/

******************************************************************************************************************

I'm doing this currently in one of my courses.
I might expand it to all the others.

[SheltieLover]

1. Excellent!

[Coventina]

3. How is that any different from grading written assignments?

I know who all my students are.

[Coventina]

7. I have never encountered such a system in all my years of being a student or professor. n/t

[Coventina]

12. I'll take your word for it in regards to UC, but I'm pretty confident that's not the norm.

No writing assignments?

No in-class quizzes?

No research projects?

Seems pretty strange that all UC does is anonymous testing for their degrees.

I've been at TA and professor at both the community college and university level here in AZ and we've never had anonymous testing.

[Coventina]

16. OK, so that's law school. And only testing, not other forms of assignments.

Overall, a pretty small segment of academia in general.

[Coventina]

18. Please provide the link that says this applies to all undergrad programs. n/t

[Coventina]

21. I just did so and according to Google (which you recommended) it only applies to law schools

and a few other courses.

[Coventina]

25. So, it is used sporadically and is not mandatory. n/t

[Coventina]

31. All I can say is that your experience has been nothing like mine, either as a student or professor.

And nobody I know has had that experience either.

And why are you so accusatory that professors are out to unfairly judge students?

I love my discipline and my students. I want them all to get As, but they have to earn them fairly, not by cheating.

[Coventina]

39. Well, your assertions about what is "policy" is being disputed here by more posters

than just me.

[Coventina]

43. Ummmmm Okay.

[obamanut2012]

33. You didn't go through all teh campuses because most don't do this, and there aren't 30+

There are TEN UC campuses.

[obamanut2012]

32. Because they are incorrect

UCLA and a couple others do it, I know UCSB professors CAN do it if they want, but other UCs do not do it.

Feel free to DM me about questions about it, I don't feel comfortable answering more on the open forum.

[Coventina]

36. Thanks! A more informed voice is much appreciated here. nt

[PufPuf23]

28. That is not correct about the University of California system. nt

[obamanut2012]

34. Yup, it is not accurate

[wackadoo wabbit]

83. Absolutely not true

I attended UCLA for two years, then transferred to UCSC. All of my exams and papers had my name on them.

[Ms. Toad]

56. The vast majority of the grade for every university course I taught was anonymous.

It was law school. Anonymizing was done via the the administrative offices - each student was assigned an exam number, which they used for all of their classes. Once the papers were all graded, the administrative offices provided the key to convert the exam numbers to the faculty. At one point, faculty was not even proctoring their own exams in order to provide even further anonymity.

Assignments short of the midterm or final exam weren't anonymous - but most faculty didn't give any. I did, because iterative feedback was crucial. Those grades counted for around 25% of the semester grade.

I'm in undergrad at the same university now - no anonymizing, but I don't know if that is because it is in an area which is hard to anonymize because of the substantial time spent in class working on the projects.

I'm surprised you haven't encountered it. You might want to try it. I've been very surprised at some of the scores on anonymized papers. I don't think I would have scored them differently had I known the names - but I've had top students score at the bottom, and bottom students score at the top.

[Ms. Toad]

76. I'm pretty sure my undergrad and MS grades weren't anonymously graded.

Bit harder to be subjective in my fields though (Math/Physics undergrad, MS in Math), so less risk. JD was all anonymous both when I was in school in the late 90s and when I taught from 2013-2022.

[Ms. Toad]

81. As a professor, that wouldn't have worked with me.

I'd have known who he was from taking attendance in every class, flagged him for when I de-anonymized it to merge the exam score with the rest of the scores from the semester so I could appropriately dock his grade. Now, that wouldn't have worked during the brief period when professors weren't even allowed to proctor their own exams . . . since the proctor wouldn't necessarily have known who he was. But as long as I'm proctoring my own exam, his goose would have been cooked.

[progressoid]

24. No such thing in the performing or fine arts.

[obamanut2012]

30. Not one of mine did that -- either as a student ro instructor

[Happy Hoosier]

44. My wife has been a college professor for 30 years...

… she had never given an anonymous exam.

And she just caught an AI cheater by interviewing them.

[OC375]

13. Seems odd

It's been 3 decades, but back then anonymity wasn't even a consideration. In fact, no name = no grade.

[Torchlight]

19. Any objective research into how large your asserted problem is nationwide?

Seems more than relevant to me.

[Trueblue Texan]

51. I think a better approach would be a written exam, in class, with the questions delivered orally.

Why are they giving them take home exams anyway?

[OC375]

61. Isn't a "take home exam" just fancy talk for "homework"?

I'd have absolutely killed it in school if I could have taken my tests at home. Wow.

[OC375]

71. LOL. To each their own. :)

I'm a perfectionist and I'd have gladly taken the entire night if given the opportunity. I love a long runway to hammer on things until they're perfect.

[Lucky Luciano]

70. For more advanced courses, a 3 hour exam can't...

…test the material well. So they make take home exams which are far more difficult and comprehensive. I approved of this because it’s true that any 3 hour exam only tests superficial understanding, but AI does mean new methods are needed. Probably has to be the take home plus rigorous interviews on the submission….trying to figure out how the labor of grading this could be addressed. Probably it is only an interview without grading the written part so much to save time. Or AI does the interview LOL. I dunno…still unsatisfying…my field is math…it’s a helluva lot easier to understand a proof given to you than to use your own creativity to solve the problem. So having AI solve the problem kills your own creativity even if you labor to understand the solution AI gives.

[hlthe2b]

4. Count me incredibly unsurprised... And good on them for doing this...

As one who has had to face my share of oral exams and boards, well, good. Get some experience early--and show you actually learned something. Not to mention their instructors will soon see who can at least SPEAK in complete sentences, make coherent comments, and understand a verbal question--even if so damned many cannot do so by writing (even before AI's arrival).

[Mysterian]

5. Great idea

Time consuming but so is grading papers.

[Jacson6]

8. Just have them write essays and solve math problems by writing in a blue book.

Just make sure that they have NOT brought in any computer devices or smart glasses. We used the blue book 40 yrs ago when I was in college.

[orleans]

57. never heard of a blue book. can you give a bit more detail? i figure if i google it then i'll get a lot of links about

cars.

[Jacson6]

59. It was a multipage blank paper notebook with a blue cover.

You had to write out the essays, test questions and math problems by hand writing. No computers back then and no smart phones now.

[orleans]

62. thanks. that helps. nt

[fujiyamasan]

66. I may have been among the last to use a blue book

This was about 20 years ago.

[OC375]

9. Excellent Idea

Probably good training for real life as well. Beyond cheating, life is both written and verbal and my assumption that anyone graduating college is better than most at both. I've met far too many job applicants with great coursework, plenty of certs, great references, and yet absolutely no ability to explain it to someone in a way that's usable by the audience. Great personal achievement, but we can't use you.

[FakeNoose]

10. This is an effective way to defeat cheating via AI

However someone with a college degree should demonstrate writing skills and mastery of the English language. How can that be achieved when all the testing is done verbally?

Many college students are sadly deficient and they don't seem to understand the importance of composition skills. It goes back to "teaching to the test" days of the early-aughts. Colleges need to start offering remedial classes for incoming freshmen - make composition a requirement and no phones, tablets or laptops allowed in class.

[Coventina]

14. I've given up on trying to teach my students writing.

(Which I'm not supposed to have to do anyway. They are supposed to arrive to my classroom able to write).

All they do is cheat by putting the assignment in ChatGPT and turning in what it spits out.

[FakeNoose]

35. I completely agree, the remedial work needs to be done before they get to your classes

Maybe even summer school, or however it can fit in. Composition should be required for any bachelor's degree. The high schools are falling down on this.

[Torchlight]

22. Given the obstacles, it appears the most honest method

I'm pretty sure that had it been available, AI would have saved me long hours of study and research when I did university, but I wouldn't have really learned anything other than stubborn, meritless arguing and deleting past comments.

[synni]

26. This should have been done years before AI

Too many students have been paying other people to write their papers. So much cheating has been going on for so long, that this is pretty much the only way you can see what is actually being learned by the students.

It's a sad State of affairs.

[2naSalit]

27. I like it...

I had to do oral exams for my Master's because there wasn't enough faculty to address a written thesis and I wanted to be done with my degree sooner than later since I was already in my 40s. I think it's a good idea, especially when AI is taking over the writing of everything.

[Starry Messenger]

40. I am an art prof

Been at this for nearly 30 years and never did I think I'd have to pull my hair out about cheating AT ART. So demoralizing. I had to eliminate some of my fun and creative prompts and just do skill-building. Can't wait until this fad passes

[Gore1FL]

42. I contend that testing is pointless.

Grades should be based on projects and demonstrative understanding used in conpleting them,

If I can use AI or Google to answer any question I am supposed to learn in a course, why bother taking the class in the first place?

[Coventina]

45. That's the thing. I stopped giving tests years ago.

But I can't use writing assignments, because of ChatGPT.

So, that's why I'm moving to one-on-one discussions of course content.

I'm also moving to projects that don't involve writing, or use a writing component that is unique to the student, so they can't use ChatGPT.

[OC375]

69. Sad you have to outwit learners nowadays

That time could be better spent doing just about anything else, I'm sure. A student actually wanting help might have a crack at it if these losers didn't suck up resources. Fighting with clients isn't fun.

I don't get all that student debt, just to cheat on tests and walk away stupid and with a developed tolerance and penchant for cheating and lying? They're literally buying nothing but bad habits, a poor work ethic, and a pause from entering the work force. Older, dumber and in debt - great start to life.

I worked 2+ part time jobs and got my 4 year degree in 6 years like millions before and after me. I can't imagine spending all those hours of work and personal sacrifice just to spend my school hours screwing around like an 10 year old, and come out a cheat and waste of everyone's time.

I'd like to tell them that if you don't want to learn college material, just don't go to school there. Learn a trade, join the army, or start a hustle related to something you actually care about instead. The word is out on people who can't back up their degrees. We trust, but verify now.

[CrispyQ]

58. I'm confused. Students are accessing their phones during the test?

Otherwise, I would think in-class testing, especially with some essay questions, would demonstrate if they know the material.

[Gore1FL]

63. I research everyday for a living in my IT job.

Knowing how to discover information is infinitely more important than memorizing.

All tests should be open book.

[CrispyQ]

65. So open book is okay, but not Google or AI. Right? -nt

[Gore1FL]

75. I use Google regularly. I have used AI, but prefer Google.

I have 30+ years in IT. I don't have one certification; If I can find what I need online, I see no need to take a class or take a test.

[CrispyQ]

79. That's not what the discussion is about, but okay. -nt

[Gore1FL]

80. It was an answer to your question. If the answer is off-topic, that's on you. nt

[Jim__]

47. One on one discussions sound great. But aren't they time-consuming?

I'm really surprised that university professors would have time for one-on-one discussions with all of their students.

[Coventina]

48. Fortunately, I have fairly small classes.

And the talks are during my office hours, which I'm required to keep.

[Jim__]

49. That sounds great!

[kairos12]

50. I had to do one of these just to get my Bachelors

Degree. Covered all 4 years of my study.

[Raftergirl]

52. My kid had to write a thesis on a topic related to his major and defend it to graduate from his liberal arts college.

I had a zillion blue book exams back in the day.

[lapfog_1]

53. just a thought

technology will defeat this as well... you may have to do the exam one at a time in a TEMPEST room ( aka SCIF ).

It would be easy for people like the MIT backjack card counting ring to rig up something that transfers information to/from the student to an AI or outside help.

Of course, the effort taken to cheat on exams this way can be large, which is why some clever person will monetize it for the masses.

[AllaN01Bear]

54. i dont do well on written tests , so i always asked for oral tests , in fact,

when i took my codeless tec ham license , i asked for a oral tests and passed

[Pucks mom]

55. No Critical Thinking

When using AI. Was just talking to my youngest about this and he brought up the lack of critical thinking he saw in his peers.

I wonder if the kids will be alright

[highplainsdem]

74. AI has taken a wrecking ball to education:

https://www.democraticunderground.com/100221115812

[Raven123]

67. Long overdue.

[Lucky Luciano]

68. I approve this wholeheartedly.

I discussed something like this with my son’s 8th grade English teacher. She’s literally 80 years old with an education doctorate and she believes AI will end civilization basically. She doesn’t give any essays or writing homework bc her assumption is that the kids will use AI - “write an essay on the following topic, but make it look like a smart eighth grader wrote it.” She does give in class writing though.

I suggested something like random drug tests. Give the assignments and randomly sample kids to orally quiz them on the spot on what they wrote about. She said smart kids could still game that system and it would be an unsustainable burden anyway to conduct those interviews. She participates in some ongoing research at Northwestern University trying to find a solution. A solution is needed though. The toothpaste isn’t going back in the tube.

[gay texan]

78. I refuse to use it

AI takes all of the fun out of learning.

[hunter]

82. That's always been a major component of science fair judging.

Otherwise you don't know if the kid did the work and understands it or the parents did it all for them.

As I recall, most of my college exams were the blue book sort, even for classes like ecology and environmental chemistry. Grading those exams is, of course, a huge workload for the professors and/or teaching assistants compared to multiple choice exams.

I was always good at multiple choice tests which is one of the ways I got into college without finishing high school. This was before the GED, but I would have breezed my way through that too.

One of the more challenging courses I took in college was physics. The professor was an excellent teacher, nicest guy in the world, always available to answer questions but there was no way to pass his exams simply by memorizing stuff. If you didn't feel the math in your guts you didn't pass. Quite a few students who'd been straight A students since kindergarten floundered in that class.

I probably don't feel the math in my gut like I used to but at least I know what that's supposed to feel like. The kids who slide through school using AI and memorization, forgetting it all the day after the final, are denying themselves an actual education.

Riding 10K on a motorcycle is not the same as running 10K on foot.