A teacher I know says it is easy to determine if a student wrote their paper if you interview them about it. You’re right that automated methods are risky.
That’s it. As a teacher who has been dealing with this in the last 2-3 years, the only reliable way I have found is to do short interviews.
Students hand in their work, I grade it, then I ask them verbally a few easy questions about what they mean in specific sections of their work. How they score on these questions is used as a coefficient that I apply on the grade to get the final score.
So they can use LLMs, but they have to understand its output.
Hell, back in my day, teachers were even very picky about what kind of calculator you could use. And if it was a graphing calculator, you had to show them yourself wiping the memory at the beginning of the test.
(Except for one algerbra teacher, who was really cool about it. He’d allow custom programs to stay on the calculator if you programmed it yourself. On the theory that if you can write a computer program that reliably solves these math problems, then you must have a very good understanding of how to solve these math problems. And, yes, I was one of the few kids who actually did that. Ah, writing my own custom software for the TI-83 on the TI-83, because that seemed easier than actually doing the math problems by hand … good times.)
Before you can punish for using LLMs, you need to be able to reliably detect the use of LLMs, including guarding against false positives.
Current AI checkers are woefully inadequate and prone to errors.
A teacher I know says it is easy to determine if a student wrote their paper if you interview them about it. You’re right that automated methods are risky.
That’s it. As a teacher who has been dealing with this in the last 2-3 years, the only reliable way I have found is to do short interviews.
Students hand in their work, I grade it, then I ask them verbally a few easy questions about what they mean in specific sections of their work. How they score on these questions is used as a coefficient that I apply on the grade to get the final score.
So they can use LLMs, but they have to understand its output.
You can tell they’re using an LLM if they have a computer out during the pen-and-paper test.
How is that allowed?
Hell, back in my day, teachers were even very picky about what kind of calculator you could use. And if it was a graphing calculator, you had to show them yourself wiping the memory at the beginning of the test.
(Except for one algerbra teacher, who was really cool about it. He’d allow custom programs to stay on the calculator if you programmed it yourself. On the theory that if you can write a computer program that reliably solves these math problems, then you must have a very good understanding of how to solve these math problems. And, yes, I was one of the few kids who actually did that. Ah, writing my own custom software for the TI-83 on the TI-83, because that seemed easier than actually doing the math problems by hand … good times.)
Not US, but there’s a tendency of focusing more on the work during the semester than in the exam itself
LLMs are going to be a massive headache for me when they get older