The defense calibration is a crucial component of the overall portfolio defense process. By calibrating all panelists for the defense, it ensures that panelists are on the same page around rubric scoring and expectations, thus validating the defense process and scores regardless of who is on the panel.
A thorough defense calibration session usually takes 60-90 minutes depending on the length of the student presentation. It is recommended that schools calibrate at least twice every school year to ensure consistent and fair scoring of student presentations. Often, the first calibration is a video calibration to familiarize panelists with the rubric and protocol. The second calibration can be a live student defense who is presenting their defense early.
As a best practice, only calibrated panelists should formally score a student's presentation. Although parents, students, and community members are welcomed on the panel or in the audience, their input should only count towards the student feedback and not the final evaluation.
The defense calibration and scoring process generally follows the protocol outlined below. The video provides a more detailed explanation of how this might look at the school site.
DEFENSE SCORING PROTOCOL
Gather evidence while watching the student's performance.
Score the student defense with the rubric.
Compare the panel's scores.
Calibrate on areas of disagreement.
Decide whether the student passes or should resubmit.