The Evaluation and Certificate
When and how does the GBEC evaluate the Candidates'' answers?
- The Board evaluates the GOE annually in February. A team of at least three people – generally one clergy person, one lay person and an Examining Chaplain – evaluates each GOE answer. Readers and Chaplains undergo extensive annual training in using the scales (see below), issues of fairness, etc. Examining Chaplains supervise reading teams. GOE answers with less satisfactory scores receive one or more additional reviews, in some cases by bishops. A minimum of three people, and as many as five, must agree on every score. Additionally, an editorial team and office staff review each evaluation.
Why is the Candidates' anonymity important?
- The GBEC ensures anonymity during its evaluation process to protect Candidates from bias or preference based on appearance, background, personality, or other circumstances. The evaluators are concerned only with the level of proficiency shown in an anonymously written answer. Their judgments provide honest and thoughtful appraisals for bishops, Commissions on Ministry and Candidates, themselves, to use for diagnosis. Once the Board makes evaluations available to Candidates, it releases results to bishops (and seminary deans if the Candidate is at an Episcopal seminary). The exam and its evaluation are intended as a part of the assessment of the whole person and all of his or her work.
How do the evaluations ensure fairness?
- The techniques used by the Educational Testing Services (ETS) in all advanced placement exams and by other national examining bodies include what the GBEC calls "scales." Evaluators apply general scales as well as scales specific to each question. These scales define the criteria necessary for each level of scoring. At least three people -- two Readers and an Examining Chaplain -- must concur with each score.
What scores does the GBEC use, and what do they mean?
- The GBEC uses four scores:
4 = Excellent (demonstrates substantial proficiency),
3 = Satisfactory (demonstrates proficiency),
2 = Problematic (suggests inadequate proficiency),
1 = Unsatisfactory (demonstrates inadequate proficiency).
Scores of 4 or 3 certify competency in a canonical area; scores of 2 or 1 carry recommendations that diocesan authorities further assess competency or re-examine the Candidate.
When and how does the GBEC make the scores and evaluations available?
- In mid-February the GBEC will make the scores, evaluations and certificates available on a secure part of its website to those entitled to access them.
What is a certificate?
- The certificate is just that: a certificate by which the GBEC certifies the Candidate's GOE scores.
Who receives the scores?
- The GBEC makes the GOE scores available to the Candidate as well as to his or her bishop and Commission on Ministry, and seminary dean.
Who receives the evaluation?
- The GBEC makes the GOE written evaluation available to the Candidate as well as to his or her bishop and Commission on Ministry.
How are the scores used?
- The purpose of the GOE is evaluative and advisory. The results are intended to help bishops and their Commissions on Ministry determine whether their Candidates "show proficiency" in the seven canonical areas. The GOE results offer help to diocesan authorities in determining their Candidates' readiness for ordination and provide valuable guidance in planning continuing education to the Candidate and to his or her mentors. Each diocesan bishop determines exactly how to use the results, and most use them diagnostically to determine areas that may need more work before or after ordination. Candidates should have a clear understanding with their bishops and Commissions on Ministry about how their dioceses use GOE evaluations/scores.
What happens if a Candidate does not demonstrate proficiency in part or all of the GOE?
- The GOE is intended to be diagnostic, and bishops and Commissions on Ministry make whatever use of the GOE results they deem appropriate. Unsatisfactory GOE results may or may not hinder ordination. Sometimes re-examination under different circumstances produces different results. Occasionally, a Candidate's problem may be in writing or language skills. The GOE serves as just one of many means of assessing preparation for ministry, to be weighed by diocesan authorities along with the Candidate's other data.