Release Notes (Mastery & Grading) 12 October, 2020
The latest release includes these improvements to the platform:
Organization and Course Level Settings
- Users with the privilege to edit organizational settings can set up Item Type weights for each item type (Pre-assessment, Self-Check, Post-Assessment, Summative, and Pilot) at the organizational and course level.
- Users with the "Edit Mastery & Grading" privilege can edit mastery and grading settings at the course level.
- Item type weights are inherited from the organization to the courses.
- These settings are "frozen" once an LTI connection between the Learning Path and the Canvas master is made. Any changes to the Mastery & Grading settings at either the course or organizational level will not be reflected in real-time in live sections. Changes will be reflected when a new LTI connection between the Learning Path and the Canvas master is established.
Concept and Content Level Updates
- All currently existing question items in production have been updated with a Bloom's Taxonomy Level "1".
- All currently existing Adaptive steps in the Learning Workflow in production have been updated with a Bloom's Taxonomy Level "1".
- When creating a new question item or editing an existing question item, users are required to select a Bloom's Taxonomy level before saving.
- On the Question Items page, a drop-down filter for Bloom's Taxonomy level has been added.
- In the Learning Workflow, the gradable toggle has been removed from the Static and Adaptive steps. To enable the gradable toggle, the setting "Only Gradable Steps" must be selected in the Mastery & Grading settings.
- When adding an Adaptive step to the learning workflow, users now choose content items based on multiple combinations of Item Type, Bloom's Taxonomy level, and number of questions.
- When adding a Static step to the learning workflow, users can filter question items by Bloom's Taxonomy level for ease of picking items.
- Any changes to the learning workflow or content items is done in real-time and will be reflected immediately in live sections.
Learning Path Level Updates
- For course and unit level diagnostics, the pool of question items is based on multiple combinations of Item Type, Bloom's Taxonomy level, and number of questions per concept.
- For End of Unit Assessments, the pool of question items is based on multiple combinations of Item Type, Bloom's Taxonomy level, and number of questions per concept in that unit.
Mastery Calculation
- Mastery calculation is applicable to each concept and executed at the end of the concept learning workflow.
- Mastery calculation for the concept is based on the weighted results of all items included in the concept learning workflow.
- Weighted results take into account each item's Item Type Weight inherited from the Organization or Course settings.
Grade Calculation
- Grade calculation will be the same and based on the Mastery calculation of each concept.
- Concept level grade: Grade calculation in this case will be the same as the Mastery calculation.
- For example, if mastery was 82% then the grade pushed to Canvas is 82%.
- Unit level grade: Grade calculation in this case will be the average of mastery across all concepts in the unit.
- For example, if mastery was 82%, 80%, 76%, and 74% across four concepts, then the grade for the unit would be 78%.
Diagnostic Calculation
- For both course and unit level diagnostics, users pick content items from the item pool of the concept based on multiple combinations of Item Type, Bloom's Taxonomy level, and number of questions.
- Mastery calculation of the diagnostic is based on the weighted results of all items delivered in the diagnostic.
- Only if a diagnostic is passed, then the grade for the respective concepts/units should be finalized. Otherwise, the grade is not finalized at the end of the diagnostic.
- Grade calculation for a passed diagnostic is the same as the mastery calculation.
- Concept level grade: Grade calculation will be the same as the mastery calculation i.e., 82% mastery = 82% grade (pushed to Canvas).
- Unit level grade: Grade calculation in this case will be the average of Mastery across all concepts the unit i.e., 82%, 80%, 76%, 74% mastery across four concepts =78% grade for the unit (pushed to Canvas).
Related Articles
Release Notes 30 August, 2021
The latest release includes these improvements to the Course Designer, Faculty, and Student UI: Course Designer Items can now be viewed in list form on both the Content page and in the Content Library. The learning path date slider has been updated ...
What is the difference between Mastery and Grading?
Mastery is the proficiency achieved by the student after going through an entire learning workflow (all the question items regardless of type) of a concept. Mastery can also be determined in a concept during the Initial Diagnostic based on student's ...
How do mastery and grading work in Learning Mode?
In the Learning Mode (not to be confused with the diagnostic mode), the student moves through the learning path (Unit > Concept) and completes learning one concept at a time in the sequence per the Learning Path. A student cannot move to the next ...
Release Notes (Student Reports) 13 April, 2021
The latest release includes the following improvements to the Student, Faculty, and Course Designer UI. Changes to the Student UI: Students are now able to review their previous answers, practice questions, and review feedback (without any impact to ...
Release Notes (Faculty Reports) - 8th May, 2021
The latest release includes the following improvements to the Faculty UI. There are two reports now available to Faculty: the Course Summary report and Student Performance report. The Course Summary report provides a quick summary of all courses ...