Lora Giangregorio, Kinesiology and Health Sciences
Summary: Consider this assignment from KIN 429 which teaches students to use student-created and instructor-created AI prompts to identify errors or gaps in AI outputs within an authentic disciplinary context (discussing the risks and responsibilities involved in using AI for evaluating treatments like the GLA:D program, an evidence-based program for treatment and management of osteoarthritic symptoms). Marking criteria are included.
Instructional goal: Students learn how to critique AI outputs for the purpose of identifying when AI is useful versus risky for healthcare decision-making. Students develop critical thinking skills by evaluating AI outputs and observing how the output changes based on prompt architecture.
Process:
- In small groups, students write two to three prompts to ask AI about the GLA:D program for knee or hip osteoarthritis. They then read the output and observe how the prompt choices influence the completeness, depth, and accuracy of AI responses.
- Continuing in small groups, students enter instructor-created prompts into an AI tool. They discuss how the prompts change the AI’s output.
- Using evidence excerpts provided by the instructor, students identify which points or references from the excerpts appeared in the AI responses.
- Students submit a group summary that captures six insights that emerged from their discussions, including how prompt architecture influences output, evidence gaps, utility of AI in healthcare contexts, and considerations for clinicians evaluating treatment programs.
Marking Criteria
| Criterion | What We Are Looking For | Marks |
|---|---|---|
| Original Prompts & AI Outputs | Students provide at least two original prompts and complete AI outputs that show an attempt to meaningfully explore the GLA:D program | 4 |
| Six Insights | Students provide six clear insights demonstrating critical thinking about prompt architecture, AI limitations, evidence omissions, or considerations for using AI in evaluating treatments like GLA:D. | 6 |
| Clarity & Organization | The submission is organized, easy to follow, and demonstrates thoughtful engagement with all required components. | 2 |