Evaluating LEARN Tools - Performance+
Project Goals/Deliverables
Project Team
Pam Fluttert, Director (Instructional Technology and Media Services)
Scott Anderson, Supervisor, Learning Environment (Instructional Technology and Media Services)
Project Summary
The University of Waterloo is currently developing initiatives to improve LEARN (D2L's Brightspace), our learning management system (LMS), based on feedback received in the LMS Review. The version of LEARN that we use at UW has many pedagogical features that are used frequently by instructors and to great effect. There are, however, additional features available that we have not yet licensed, nor have we investigated their potential efficacy for our institution. Performance+ provides tools and dashboards that unlock insights into course and learner data and effectiveness.
Throughout this pilot, we will be seeking individuals who are either actively engaged in using similar tools already, or individuals whose role supports instructors using LEARN to accomplish similar goals. Please watch for opportunities to participate or contact Pam Fluttert (fluttert@uwaterloo.ca) if interested.
What is Performance+?
Performance+ is an embedded analytical tool in the LEARN system that provides instructors insights into course and student learning analytics. Performance+ comprises of a variety of tools and dashboards that course instructors can use to gain insight into learner data, effectiveness, and key performance indicators. These analytics can be used to inform teaching and learning decisions within a class, department, program, and faculty.
Key features include:
- Adoption Dashboard: Provides a comprehensive understanding of course usage with visualization of login trends, course access, tool usage, and enrollments.
- Engagement Dashboard: Identifies success and at-risk students and groups through visualizations related to course access, assignment completions, and content engagement.
- Learner Engagement Dashboard: Provides instructors with metrics regarding individual learner engagement across the course.
- Assessment Quality Dashboard: Evaluates assessment quality with quiz and question statistics, including reliability and average grade.
- In-course Reporting Tools: Enables instructors to see a course overview related to class engagement through visual tools.
- Insights Report Builder: Instructors can create custom visualizations, reports, and alerts using course data for their course needs.
- Student Success System: Provides instructors with predictive analytics to identify at-risk students and provides actionable insights.
To learn more about Performance+, watch a demo of the tool by D2L from September 14, 2023.
Project Timeline
-
2023
-
Aug
-
Beta project approved for Teaching Innovation Incubator
-
Recruitment of faculty and staff to test Performance+ (first phase)
-
-
Oct
-
Initial testing of Performance+ wraps up
-
ITMS signs 5-year agreement with D2L with Performance+ feature
-
-
Nov
-
Feedback on Performance + collected, summarized, and shared with EdTech Advisory team
-
-
Dec
-
Received budget approval to do thorough pilot of Performance+
-
-
Aug
-
2024
-
Jan
-
ITMS reviews Performance+ functionality before winter 2024 pilot begins
-
-
Jan
Project Updates
Introduction to Creator+ Workshop
Sign up to join the Introduction to Creator+ in LEARN workshop for insight into how you can make your LEARN course more engaging for students.
Call for interested faculty, instructors and staff to pilot Creator+
Following the initial round of testing on the efficacy of the Creator+ and Performance+ tools, the project team received budget approval to proceed with a two-year pilot of both tools. We are seeking interested individuals from across the faculties to join the pilot.
Creator+ and Performance+ receive approval for a two-year pilot
Following the initial round of testing on the efficacy of the Creator+ and Performance+ tools, the project team received budget approval to proceed with a two-year pilot of both tools.
Creator+ will continue to be investigated in the winter 2024 term by a group of cross-disciplinary faculty and instructors who are teaching a course in spring 2024. Instructors will have the opportunity to design their courses throughout the winter term with Creator+ integrated and will receive documentation, resources and training.
Initial testing of Creator+ Performance+ wraps up
After a month of exploring the Creator+ and Performance+ tools in LEARN, the initial phase of testing has wrapped up. Instructors and staff involved in the pilot have submitted their feedback on the tools which will be shared with the EdTech Advisory team.