.

Insights

What is D2L Insights?

Insights provides different views, to faculty, on data and metrics, which highlights activity in their course. Different elements within Insights show learner engagement metrics to provide different views, charts, and dashboards in a user-friendly format. Charts showcase individual metrics and dashboards show complex metrics (combination of multiple data points).

Many charts are interactive, offering options to filter by whichever metrics is visualized. For example, a course instructor can select a grade range and then review the group of students collected and potentially communicate to all–or some–of this group.

Insights also acts as a hub of information between other tools, such as Assignments, Class Progress, Discussions, the Quiz tool, and the Grade tool.

The different Brightspace Insights (Learner Analytics) features:

  • The course overview widget is located on the course homepage. Once added, only faculty and course instructors can see and use this widget. This widget can provide information useful for credit and non-credit Brightspace course environments alike. Charts include class engagement / grade distribution, course access / day, tool access (activity within the course / tools used).
  • Engagement Dashboard A series of interactive charts which depict engagement based on course enrollment: Overdue assignments, Current Grade, Discussion Activity, Time in Content vs Grades, and Content Views
  • Assessment Quality Dashboard Related to quiz activity and the use of close ended question types. Metrics include reliability coefficient, low average score and overall quiz reliability
  • Learner Engagement Dashboard Learner Engagement is based on individual students not based on courses. Access to data is still restricted to course enrolment and user role resulting in instructors only accessing information for courses they are teaching.

The Course Overview widget vs Insights Dashboards

While related, the course overview widget and the various dashboards provide complementary information and are in different areas of Brightspace.

  • The course overview widget is located on your course homepage. This provides direct access to reports related to data based on that specific course. The class engagement report acts as a hub to access other tools within the course.
  • All Insights dashboards are accessed from the Saint Mary s University (SMU) Homepage and instructors can review data for a range of courses they teach or individual courses. Each dashboard provides a specific range of data, and typically includes interactive charts which visualize a combination of information metrics. One example of this would be the Time in Content vs Grades chart which showcases your students' grade relative to how long they have spent logged-in to the course.

The Course Overview Widget

The course overview widget is accessed via the course homepage. Only instructors within the courses can see this widget if it has been applied. Students cannot see the widget, nor can they access the reports. If it does not appear on any course (credit or non-credit) for which you are the course instructor, you can request to have this added. Course instructors can access the following reports on activity within their course:

Class Engagement depicts an interactive grade distribution chart and a snapshot on student engagement in Discussions (Posting and Replies). The Class Engagement (Course Overview widget) interacts with the class progress tool and the email tool.

Course Access depicts patterns where students are accessing the course over time.

Tool Access provides an overall distribution of engagement across the different tools used in your course.

There are options to filter to groups of students based on these metrics. These reports provide instructors with different course metrics. The Class Engagement (Course Overview widget) interacts with the class progress tool and the email tool.

How to use this feature:

Example 1: An instructor is looking to recognize and encourage those students who are performing well in the initial stages of the course. The instructor could follow these steps:

  1. The instructor would go to the Class Engagement area of the Course Overview widget.
  2. The instructor selects the grade ranges they wish to contact, which then filters a subset of the class. Check the square adjacent to Name to select the whole group. Or manually select the students you wish to contact. Once you click on the Email Class button an email pop-up will appear.

Example 2: An instructor is interested in reviewing those students who are at risk of low academic performance, they could follow these steps:

  1. The instructor would go to the Class Engagement area of the Course Overview widget.
  2. The instructor selects the grade ranges they wish to contact, which then filters to the target subset of the class.
  3. The instructor can then view the range of students. Each student's name is a link, click on this to access the Class Progress overview for that student. [Top Tip: Right click on name to open the student view in a new tab so you can easily move between those individuals you are looking to review].
  4. Use the email feature in Class Engagement to contact select students individually or in groups.

Important note: Even when a group of students has been selected. At any stage course instructors can select and deselect individual students as needed. It is recommended to review the list to ensure that each student who should receive communication has been selected and de-select those who don’t.

The system defaults to sending email as bcc to safeguard identity. It is recommended that you add your own email into either the to: or cc: field
.

Insights Dashboards

Access to the Insights dashboards is via Saint Mary’s Homepage. The dashboards are accessible at this location as they provide course instructors options to view data across several courses of their courses.

  • Note: access to information is restricted to courses you are enrolled in as an instructor.
  • To access the Insights dashboards, go to the SMU Brightspace Homepage (click on the Home Icon from any Brightspace page). Select Admin Tools on the Navigation Bar and click on Insights Portal.

Accessing Insights

Access Insights from Admin Tools in the Nav Bar from here you should see the following dashboards:

  • Engagement Dashboard.
  • Learner Engagement Dashboard.
  • Assessment Quality Dashboard.
Engagement Dashboard

The Engagement Dashboard contains visualizations that provide insight to instructors and advisers, how learners are engaging with their courses. By interacting with the different charts, course instructors and advisors can identify different groups of students based on engagement patterns. For more information click on this Link.

The dashboard is broken into the following sections:

  • Filters, which appear as dropdown menus for Org Unit and Semester. If you click a data point in a chart in the Summary View to further filter report content, those filters are also listed in this area.
  • The Summary View includes the Results summary, Discussion Activity pie chart, Overdue Assignments summary, System Access summary, Current Grade bar chart, Time in Content vs. Grade scatterplot, Course Access bar chart, and Content View bar chart.
  • The Results area that contains a dynamic user table of learners who meet the criteria applied to the dashboard. As you add filters to the summary data, the learners listed in the User Table automatically change to reflect the updated Summary view.
How to use the Engagement Dashboard
  1. Use the Current Grade tool to identify the different groups of students based on their performance at this stage of the term.
  2. Use the Course Access chart to identify students in one (or all) of your current courses who have yet to access the course and should have done so by now.
  3. Use the Time in Content vs Grades widget to filter students based on engagement and performance metrics.

The Time in Content vs Grades widget chart separates the class into four relational quadrants based on the degree of time spent on content cross relative to their grade at that stage of the term. When a quadrant is selected, that group of students which conform to those conditions will be filtered.

  • Note: The distinction between high grade to low grade and high time to low time is relative to what has been filtered and only includes information you have access to.

Each quadrant offers a view on the different levels of engagement in your class. While each course context will be unique the following are some ways to utilize this feature.

  • High performance with low time in course This group seems to be performing well relative to the rest of the class with less effort, although it's possible these students are accessing course content offline resulting in skewed metrics.
  • High performance with high time in course Is this group demonstrating exemplary effort or is their success the result of significantly more effort than their peers? If the latter, what barriers may be in place the students need to navigate.
  • Low performance with low time in course Would these students benefit from a nudge or a reminder on how to succeed in your course?
  • Low performance with high time in course When students spend above average time in the course, why is that effort not reflected in their performance? What barriers or issues may be in place for them? What supports might they benefit from accessing?

Each chart only details information available within Brightspace. Charts only show information available to the end user. Instructors can only access information from courses they are enrolled in as an instructor. Filters highlight specific courses and by nature remove some courses from view.


Learner Engagement Dashboard

The Learner Engagement Dashboard contains visualizations for engagement metrics, such as course activity, assignment status, and course history, for an individual learner across a range of courses. Instructors, however, will only see information for those courses which they are enrolled in as an instructor. Access the Learner Engagement dashboard to get a comprehensive view of an individual student.For more information, click on this Link.

The dashboard is broken into the following sections:

  • Filters, which appear as dropdown menus for Org Unit and Semester. If you click a data point in a chart in the Summary View to further filter report content, those filters are also listed in this area.
  • The Summary View includes the Number of Courses in View, Average Grade from the courses in view, Overdue Assignments summary, System Access summary, Grades Over time chart, Content Views Over Time chart, and Course Access over time chart.
  • The Active Courses area contains a dynamic table of courses who meet the criteria applied to the dashboard. As you add filters to the summary data, the courses listed in the table automatically change to reflect the updated Summary view.
How to use the Learner Engagement Dashboard:
  1. The Grades Over Time trend chart displays the learner's current grade for each week in the selected time frame as a line graph. Each course is represented by a color-coded line, and when you click on a line, the other lines become greyed out. Adjusted and calculated grades are included.
  2. The Content View Over Time trend chart displays the number of content topic views for the learner for each week in the selected time frame as a line graph.
  3. The Course Access Over Time trend chart displays the number of course accesses for the learner for each week in the selected time frame as a stacked area chart.

Each chart only details information available within Brightspace. Charts only show information available to the end user. Instructors can only access information from courses they are enrolled in as an instructor. Filters highlight specific courses and by nature remove some courses from view.


Assessment Quality Dashboard

This dashboard provides visualizations to help instructors understand the quality of their assessments. This dashboard provides different statistics and analytics of quiz questions including reliability, average grade, and correlation. In general, when using quiz and question statistics, it is important to keep in mind the sample size for the given quiz or question. Metrics increase in statistical relevance as the sample size increases and tend to support close ended questions. From this dashboard instructors can review all quizzes across their courses and preview the different questions or go directly to the quiz from the dashboard.

For more information on the Assessment Quality dashboard, including reliability calculation methods visit this documentation on the Assessment Quality dashboard on the Brightspace Community.