Determining Levels of Acceptable GenAI Use
Use a framework to decide what level of GenAI use to permit in your course.
By Gwenna Moss Centre for Teaching and LearningMany instructors are contemplating what level of GenAI (e.g., ChatGPT) use is acceptable for students when completing their assessments. Instructors who have tried the tools have seen how well they can generate content in response to a prompt or request. It concerns them that they will not be able to tell when a student has completed an assessment with or without this kind of assistance and the validity of assessment will become uncertain.
Students are gaining more experience with these tools and looking for explicit guidance from their instructors so that they can meet expectations and avoid academic misconduct.
The table below was shared by educational consultant Leon Furze (see his blog post on the “Artificial Intelligence Assessment Scale”), and is elaborated in Perkins et al “Navigating the Generative AI Era” (see paper here) The purpose is to help instructors define the level of acceptable GenAI use.
Use this table to think about the permitted and restricted uses that would apply in your courses or to specific assessments, depending on what those assessments are designed for. You could even use this table and the explanation provided by the authors to show students what you mean by levels of assistance or support and what “too much” reliance on GenAI would look like.
After reviewing this table, note important cautions below about placing a ban on GenAI (Level 1) and permitting full-on use of GenAi (Level 5).
Image Source: The AI Assessment Scale: Version 2 – Leon Furze
Caution about Level 1
Consider that “Level 1 = No use of AI” means you have to set a clear restriction but that this is likely to be the most difficult or administratively burdensome to enforce because of the monitoring and control it will require.
- Use of invigilated assessments are also likely to require accommodations, in addition to other costs associated with holding in-person assessments (e.g. invigilators, appropriate classroom space, time limits)
- If the assessment is not invigilated, effort will be needed to clearly identify unpermitted use.
- Detection tools are not currently approved for use at USask
- There are many methods to obscure use of GenAI, and information about these are widely available (video example)
For these reasons associated with instructor workload as well as validity and authenticity of assessments, bans on use are not recommended in most cases. Instead, redesign of assessment to include and acknowledge appropriate use is recommended, especially according to Levels 2, 3, and 4 in the above table.
Caution about Level 5
Consider that “Level 5 = Full AI” means students are not required to acknowledge their use of GenAI tools, according to this table.
- In the professional futures of some of our graduates, use of GenAI may be permitted and co-writing using GenAI may be expected in most, if not every, case.
- Legal decisions about areas of copyright and notions of authorship are pending in North American contexts.
Until responsible use matters are settled in professional or legal contexts, it is advisable that there be some type of acknowledgement with any use of GenAI at this time.
Title image credit: Noelle Otto on Pexels