Qualities of Effective Assessment

As instructors create or revise assignments, tests, and exams, it is important to surface the foundational principles of effective assessment. While definitions of effective assessment vary, overarching characteristics exist across different contexts and disciplines. This tip sheet outlines key qualities of effective assessment to consider as you engage in assessment (re)design. Ultimately, the qualities provide a starting point to reflect on questions ranging from the philosophical (“what role do assessments play in shaping students’ learning?”) to the practical (“do existing assessments actually measure student learning?”).

As you consider these principles, remember that course alignment is fundamental. For further guidance, refer to the Teaching Tip: Aligning Outcomes, Assessment, and Instruction.

Validity

When considering validity in assessments, reflect on if and how the assessment measures what it is supposed to measure in your course. Consider the level of your course, student demographics, and the intended learning outcomes (ILOs) within this context. Think about questions such as:

  • How would you know that each assessment measures the knowledge, skills, and competencies it is intended to measure? What is the evidence of student learning?
  • What ILOs does each assessment address? If there is misalignment between the assessment and ILOs, what additions and/or gaps need to be addressed?
  • How will you know that the students are completing the assessments they submit?

Transparency

Providing clarity in your assignments can help alleviate student anxiety and reduce instructor administrative burdens related to answering questions. When preparing the assignment, be sure that instructions for processes, documentation, GenAI, and marking criteria are as clear as possible. It can be helpful to adopt the student perspective and ask your TAs for feedback to identify any gaps, omissions, or assumptions in communication. Consider the following questions:

  • What do students need to demonstrate to be successful on the assessment?  
  • What methods are used to communicate assessment expectations to students ahead of time (e.g., course outline, assignment instructions in LEARN, posted marking criteria)?
  • What opportunities are provided for students to ask questions (e.g., class time, office hours, tutorials)?
  • Are there scaffolded opportunities for students to demonstrate their learning progress and receive feedback along the way?

Feasibility

Assessment (re)designs should always be considered alongside contextual factors. Some factors that can be used to evaluate feasibility and practicality of assessments are time, resources, and class size. A pedagogically sound assessment that does not account for these factors may lead to undesired challenges when implemented. Start by thinking about the following:

  • How do available resources, such as time, staffing, and tools, shape the design of the assessment?
  • What assessment options are you considering given the available resources?
  • What aspects of this assessment place the highest demands on students, instructors, and TAs? Consider grading schemes, workloads, prior knowledge, and additional training. Are these demands manageable?

Reliability

Reliability in effective assessments means that assessments are accurate, consistent, and repeatable. While some variability in how students perform on the assessment, and how TAs and instructors grade the assessment can be expected, it is important to create assessments that lead to dependable results. Reflect on the following questions:

  • If two people grade the same assessment, how confident are you that they would assign the same (or similar) grade and offer comparable feedback?
  • Are the marking criteria or rubrics clear, detailed, and unambiguous?
  • Is it possible for a student to achieve a high grade without providing convincing evidence of achievement of the relevant ILOs?

Fairness

An effective assessment prioritizes inclusion and accessibility. Remember that assessments can still have academic rigor or reasonable difficulty while weaving fairness throughout. Take time to reflect on the ways in which your assessment is fair, accessible, and non-discriminatory, as well as potential areas for change. As a starting point, refer to these questions:

  • What barriers might students encounter? How could these barriers be reduced without compromising academic rigor?
  • Do different groups of students perform differently on the assessment? If so, why? For example: What unstated prerequisite knowledge, if any, exists among majors and non-majors in the same course? How might contextual knowledge held by domestic versus international students play a role?
  • How might you use prior student and/or TA feedback on the assessment to inform potential changes?

For further reading: Review the “Designing Assessment and Learning Activities” and “Implementing Assessment and Learning Activities” sections on the Accessible Teaching website.

Educational Impact

It is helpful to think about the impact of your assessments on students’ learning and personal development both during and beyond the course. Considering educational impact means to reflect on how the assessment supports learning that is relevant and authentic at the course, department, and Faculty level. Educational impact can also be considered from the perspective of disciplines and the ways in which assessments can foster meaningful insights and applications for students as they move into their careers. Reflect on the following:

  • How are real-world contexts or authentic applications incorporated, and how are they meaningful to students?
  • What opportunities does the assessment create for students to take an active role in evaluating their own or others' learning? For example: Assessments that incorporate reflection and peer review can effectively support personal growth and perspective-taking.
  • How might students describe the value of this assessment for their learning, both in and beyond the course?  

Support

If you would like support applying these tips to your own teaching, staff members from Teaching Support and Innovation (formerly the Centre for Extended Learning and the Centre for Teaching Excellence) are here to help. View our support page to find the most relevant staff member to contact.

Resources

References

Creative Commons license

This Creative Commons license lets others remix, tweak, and build upon our work non-commercially, as long as they credit us and indicate if changes were made. Use this citation format: Qualities of Effective Assessments. Teaching Support and Innovation, University of Waterloo.