Before reviewing Student Course Perceptions (SCP) scores, take a step back to think about context. Empirical research and consultations conducted at Waterloo and beyond indicates that scores can be affected by variables that do not reflect teaching effectiveness.
The following variables (and their potential associations with SCP scores) reflect both empirical research conducted at the University of Waterloo and the results of consultations with Waterloo stakeholders.
| Variable | Strength of association with pilot test results | Identified via consultation | Associated with a lower score | Associated with a higher score | Notes |
|---|---|---|---|---|---|
| Class size | HIGH | Yes | Large class | Small class | Larger classes (100-200 students) tend to receive lower scores than smaller classes. Pilot test results found this difference to be marginal but other U15 institutions found class size was a significant factor (0.05-0.13). |
| Expected grade | HIGH | Yes | Expecting lower grade | Expecting higher grade | Students who expected higher grades tended to give higher SCP scores (0.22 - 0.81 points higher for a grade >90). |
| Perception of workload | HIGH | Yes | Perception that workload is low | Perception that workload is high | Courses for which students rated the workload as “average” or “high” received higher SCP scores than courses perceived as having a “very low,” “low,” or “very high” workload (0.4 - 0.58). |
| Course format | HIGH | Yes | Online class | Face-to-face class | Online courses received lower scores compared to face-to-face classes. In-class courses received scores 0.1 - 0.28 points higher across SCP items. In practical terms this would be a difference between 4.3 and 4.6 on a survey item (0.1 - 0.28). |
| Instructor gender | LOW | Yes | Men | Women | Instructors at the University of Waterloo report that gender bias has a problematic impact on SCP scores, though the 2018 SCP pilot test suggested only marginal difference between male and female instructors overall and significant differences between male and female probationary instructors teaching large courses* (0.04 to 0.12). Male instructors scored lower in small classes (1-25 students) (0.1). This does not account for the possibility of interaction effects (e.g., gender/racialized status). *Interpret with caution: extremely small sample <5. |
| Instructor racialized identity | Not measured | Yes | Instructor racialized identity | Non-racialized identity | No data available |
| Course requirement | NEGLIGIBLE | Yes | Required course | Elective | Elective courses received marginally higher scores than required courses. An increase of 1% in the proportion of students taking the course as “required” resulted in a slight decrease in average score for some SCP items. |