Artificial Intelligence at UW

Limitations of generative artificial intelligence

There are limitations to genAI tools, which provide a response based on a prompt. For example, the free version of ChatGPT uses information found freely on the internet (up to 2021) to generate responses to prompts but is not a search engine. It “learns” through access to information curated by researchers, developers, and ongoing input from its users—which may contain errors, misconceptions, or bias (Wu, 2022). Of course, this field is developing rapidly, and at the time of publishing these guidelines, similar tools are being adopted by search engines like Google. Verification and triangulation of information is important if using ChatGPT, as it is unable to distinguish between important and unimportant errors (Ramponi, 2022). While it can – if asked – provide references for content found, they will often appear plausible but be incorrect (Montti, 2022).   

Ethical considerations and bias

The responses generated by genAI can be incorrect and may include bias (Wu, 2022) inherent to the database on which it was trained and/or due to the biases of those reviewing and selecting the information to include in the database. One writing specialist tested ChatGPT’s response to a prompt and found that it reinforced rather than complicated a simplistic ideological stance – unlike Wikipedia or even Google searches. The specific phrasing of prompts impacts how the AI responds, including the degree of bias in the response. GenAI chatbots such as Google’s Sparrow and Galactica were unsuccessful in their releases for this very reason (Wu, 2022). 

Privacy and security concerns

GenAI evolves through its interactions with humans in the form of prompts and chat interactions. As of February 2023, if users delete their accounts, OpenAI retains all the prompts they have added. As of February 2023, ChatGPT has not undergone an Information Risk Assessment at the University of Waterloo. OpenAI’s commonly asked questions page has more information on the company’s own policies.

Copyright concerns

GenAI and related technologies are subject to existing laws and regulations in Canada, such as intellectual property, copyright and privacy laws, among others. The legal status (e.g., copyright legislation and case law) of GenAI services is currently unsettled in Canada. More information is available from Waterloo's Copyright Advisory Committee. 

Explicit communication with students

It is important for instructors to be explicit about whether artificial intelligence or tools may be used to complete assignments, tests or exams. If they are allowed, they need to be explicit about the extent to which they are allowed, along with citation guidelines. A student who does not comply with the instructor’s rules about the use of such tools will be subject to Policy 71 and an investigation into academic misconduct.

• View the University of Waterloo's wording suggestions for course outlines. 
• View the Centre for Teaching Excellence's tip sheet on conversations with students about genAI.

Detecting whether a student has used AI to work on an assignment

We do not recommend controlling the use of AI using surveillance or detection technology.

Waterloo supports Turnitin's suit of tools and is currently evaluating the AI detection tool for accuracy. The usual Turnitin language will be deemed to cover any originality reports thus generated as well.

Reducing the risk of student cheating with AI

Evidence-based assignments and assessments can help encourage students to complete their own work and make unapproved AI chatbot use easier to identify. When adopting any approach (e.g., visual mapping or oral presentation), keep accessibility and inclusion at the forefront of redesign.

Staff at the Centre for Teaching Excellence, the Centre for Extended Learning, the library, and the Writing and Communication Centre are available to consult on assessment redesign.

The Centre for Teaching Excellence has collaborated with other academic support units to develop resources for instructors.

Inspiration for assignment redesign: 

• Research-based assignments that require scholarly resources cited accurately, especially resources found behind a paywall through Library subscriptions 
• Assignments that show how a work evolved over time (e.g., requiring the submission of scaffolded assignment components, or drafts, or tracking changes) 
• Auditory or audio-visual presentations (e.g., live or asynchronous presentations) 
• Use of social annotation tools, like university-supported Perusall, that requires students to respond to content in concert with their classmates 
• Assignments or assessments that require content to be produced in multiple and accessible modes (e.g., create a visual or infographic and then write about it) 
• Assignments where students are asked to include real world or personal examples, or demonstrate how the answer ties with course content or a case study discussed in class 
• Assignments that require metacognitive skills like reflection on the content and process before, during, and after submission 
• Assignments that are about very recent news or developments in a field

Using AI tools effectively for teaching and learning

There may be opportunities to leverage AI to enhance teaching and learning either by teaching about AI or teaching with AI tools. Introducing AI through discipline-specific classroom conversations can encourage students to think critically about AI and its potential societal implications like accuracy, privacy and security, and bias. Activities or assessments that require learners to analyze, improve, or critically evaluate text or code generated by chatbots can help develop students’ higher order skills. 

Examples: 

• Provide a prompt and the resulting text, and ask students to improve on it using track changes 
• Ask students to critique and grade a properly referenced prompt and text, and then write an improved text collaboratively in class.  
• Generate two different texts and ask students explain the shortcomings of each or combine them in some way using track changes 

• Document code and test documentation accuracy with peer 
• Facilitate authentic learning: use AI to create personalized case studies for student groups, tailored to student interests. 
• Use ChatGPT to provide a starting summary of a debate or issue as a springboard for research and discussion – identify what it is missing.  

Requiring students to use AI for assessment

There are many possible uses of generative AI for assessment; ChatGPT is not fully accessible globally, and now has paid subscription models. If used in assessments or activities, plan alternatives. One option is to require students to use ChatGPT content provided by the instructor, instead of asking all students to sign up for this particular tool. 

Using AI to create or grade instructional materials

GenAI tools have functionality that may create efficiencies for planning instruction and producing content. . The University of Sydney has prepared advice about how AI can be used meaningfully by teachers and students in 2023.