Assessment: Grading & Student Evaluation  Eddy White, Ph.D. Assessment Coordinator Center for English as a Second Language University of Arizona
The goal of assessment has to be, above all, to support the improvement of learning and teaching. (Fredrickson & Collins, 1989)
Contents Introduction: Assessment Words of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
definition:  Classroom   Assessment
Improving student learning implies improving the assessment system. Teachers often assume that it is their teaching that directs student learning.  In practice, assessment directs student learning, because it is the assessment system that defines what is worth learning.  (Havnes, 2004)
There is substantial evidence that assessment, rather than teaching, has the major influence on students’ learning . Assessment . . . directs attention to what is important, acts as an incentive for study, and has a powerful effect on student’s approaches to their work. (Boud & Falchikov, 2007) Rethinking Assessment in Higher Education
2010
Five key assessment principles Practicality Reliability Validity Authenticity Washback
Key  Assessment Principles 1 .  Validity  - Does the assessment measure what we really want to measure?  2. Reliability - Is all work being consistently marked to the same standard?  3. Practicality   - Is the procedure relatively easy to administer?  4. Washback  - Does the assessment have positive effects on learning and teaching?  5. Authenticity  - Are students asked to perform real-world tasks?
 
__________ is perhaps the most critical of all teaching skills.
Decision-making  is perhaps the most critical of all teaching skills.
(Anderson, 2003) Since the 1970’s, there has been a group of educators and researchers who have argued that  the key  to being a good teacher lies in the decisions that teachers make .
Good assessments  lie at the core of good decision making.
decision making
Contents Introduction: Assessment Words of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
Grading/Student Evaluation
Grading and Student Evaluation : Challenges, Choices, and Consequences
Sound assessment and grading practice  help teachers to improve their instruction, improve students motivation to learn, and increase students level of achievement. (Brookhart, 1999)
Roles of grading  (Walvoord, Anderson, 1998)   1 . Evaluation : the grade claims to be a valid, fair and trustworthy judgment about the quality of the students work 2. Communication : the grade communicates the teachers judgment of the students work 3. Motivation : because it affects the time and effort students spend, grading is a powerful part of the motivational structure of a course (for better and for worse) 4. Organization : a grade helps mark transitions, bring closure and focus efforts for both teachers and students
The teachers job is to render an informed and professional judgment to the best of their ability. Teachers need to : establish clear and thoughtful criteria and standards to student’s work, exercise that professional judgment within the context of their institution, department and the students they deal with.   Teachers and Grading Walvoord & Anderson, 1998)
Grading and teachers roles Grades matter greatly for teachers who often experience the tension of performing  two conflicting roles : 1. Coaches  - instructing, guiding student writing  2. Judges  - evaluating students work **  Teachers themselves are often judged by the grades they give.
Grading schemes for a course
Grading schemes -  the series of assessment tools  (exams, tasks, projects, etc.)  that are scored and used to arrive at a final grade for  students.
2010 MA TESOL Program San Francisco State University
(Brown & Abeywickrama, 2010) Standards for assigning grades are extraordinarily variable across teachers, subject matter, courses, programs, school systems, and even cultures.
Contents Introduction: Assessment Words of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
What should grades reflect? How should different objectives, tasks, and components of a course figure into a formula for calculating grades?
Grading Questionnaire
Grading criteria/weighting task Consider the course information provided  (teaching assignment next slide) Determine the criteria you will use to set up your grading scheme Determine the weighting of the items in your grading scheme (to total 100%)
Teaching Assignment Course title/level : 50 Writing (intermediate) 16 international students Course focus : writing effective essays Main learning outcome : Students will be able to write effective 5-paragraph essays of various types (e.g. argumentative, cause &effect, compare/contrast) Length : 8 Weeks
What factors should be included in deciding the final grade for a course?
Questionnaire responses In a recent administration of the questionnaire to teachers as the  American Language Institute  at San Francisco State University . . . the item on which most teachers agreed on was  item (a) which received percentage allocations from 50-75%.
Brown & Abeywickrama (2010) It is safe to assert that formal tests, quizzes, exercises, homework, essays, reports, presentations – all of which are marked in some way – are universally accepted as primary criteria for determining grades.
Responses-American Language Institute, SFSU Items (b) and (c)  also drew relatively strong support. A word of  caution : If intuitive, informal observations by the teacher figure into the final grade,  it is very important to inform students in advance  how these observations, and impressions will be recorded throughout the semester.
Responses-American Language Institute, SFSU On  items (d) through (h)  there was some disagreement and considerable discussion but all of these items received at least a few votes for inclusion.
How can these factors  (improvement, effort, motivation, etc.)  be systematically incorporated into a final grade ? Some educational assessment experts state definitely that  none  of these items should  ever  be a factor in grading.
(Gronlund & Waugh, 2008) Base grades on student achievement, and student achievement only.  Grades should represent the extent to which the learning outcomes were achieved by students. They should not be contaminated by student effort, tardiness, misbehavior or other extraneous factors . . .  If they are permitted to become part of the grade, the meaning of the grade as an indicator of achievement is lost.
Brown & Abeywickrama (2010) This is a  strongly empirical philosophy of grading . There are other points of view that consider other factors in assessing and grading (Grove, 1998; Marzano, 2006; Power 1998, etc)
Brown & Abeywickrama (2010) How many teachers do you know who are consistently impeccable in their objectivity as graders in the classroom?
If you are willing to include some  nonachievement factors  in your grading scheme, how do you incorporate them along with other more measureable factors?
Contents Introduction: Assessment Words of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
Guidelines
Guidelines for Selecting Grading Criteria (4) It is essential for all components of grading to be consistent with an institutional philosophy and/or regulations.  All components of a final grade need to be explicitly stated in writing to students at the beginning of a term of study with a designation of percentages or weighting figures for each component.
Guidelines for Selecting Grading Criteria (4) 3. If your grading system includes items (d) through (h) in the questionnaire, it is important for you to recognize their subjectivity and convert such factors into observable and measureable results (e.g. using checklists, note-taking systems, etc.). 4. Consider allocating relatively small weights to items (c) through (h) so that  a grade primarily reflects achievement .
Grading and Student Evaluation : Challenges, Choices, and Consequences
decision making
The goal of assessment has to be, above all, to support the improvement of learning and teaching. (Fredrickson & Collins, 1989)
Contents Introduction: Assessment Words of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
finally . . .
a story
A grandfather planting seeds in his garden was asked by his grandson, “How do you make the seeds grow?” The grandfather replied, “I can’t make the seeds grow, but I can provide the best conditions for them to grow.”
Effective classroom-based assessment can greatly contribute to the successful nurturing and development of our student’s language learning.
 
Assessment: Grading & Student Evaluation  (January, 2012) Eddy White, Ph.D. Assessment Coordinator Center for English as a Second Language University of Arizona

Assessment: Grading & Student Evaluation

  • 1.
    Assessment: Grading &Student Evaluation Eddy White, Ph.D. Assessment Coordinator Center for English as a Second Language University of Arizona
  • 2.
    The goal ofassessment has to be, above all, to support the improvement of learning and teaching. (Fredrickson & Collins, 1989)
  • 3.
    Contents Introduction: AssessmentWords of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
  • 6.
  • 9.
    Improving student learningimplies improving the assessment system. Teachers often assume that it is their teaching that directs student learning. In practice, assessment directs student learning, because it is the assessment system that defines what is worth learning. (Havnes, 2004)
  • 10.
    There is substantialevidence that assessment, rather than teaching, has the major influence on students’ learning . Assessment . . . directs attention to what is important, acts as an incentive for study, and has a powerful effect on student’s approaches to their work. (Boud & Falchikov, 2007) Rethinking Assessment in Higher Education
  • 13.
  • 14.
    Five key assessmentprinciples Practicality Reliability Validity Authenticity Washback
  • 15.
    Key AssessmentPrinciples 1 . Validity - Does the assessment measure what we really want to measure? 2. Reliability - Is all work being consistently marked to the same standard? 3. Practicality - Is the procedure relatively easy to administer? 4. Washback - Does the assessment have positive effects on learning and teaching? 5. Authenticity - Are students asked to perform real-world tasks?
  • 16.
  • 18.
    __________ is perhapsthe most critical of all teaching skills.
  • 19.
    Decision-making isperhaps the most critical of all teaching skills.
  • 20.
    (Anderson, 2003) Sincethe 1970’s, there has been a group of educators and researchers who have argued that the key to being a good teacher lies in the decisions that teachers make .
  • 21.
    Good assessments lie at the core of good decision making.
  • 22.
  • 23.
    Contents Introduction: AssessmentWords of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
  • 24.
  • 25.
    Grading and StudentEvaluation : Challenges, Choices, and Consequences
  • 26.
    Sound assessment andgrading practice help teachers to improve their instruction, improve students motivation to learn, and increase students level of achievement. (Brookhart, 1999)
  • 27.
    Roles of grading (Walvoord, Anderson, 1998) 1 . Evaluation : the grade claims to be a valid, fair and trustworthy judgment about the quality of the students work 2. Communication : the grade communicates the teachers judgment of the students work 3. Motivation : because it affects the time and effort students spend, grading is a powerful part of the motivational structure of a course (for better and for worse) 4. Organization : a grade helps mark transitions, bring closure and focus efforts for both teachers and students
  • 28.
    The teachers jobis to render an informed and professional judgment to the best of their ability. Teachers need to : establish clear and thoughtful criteria and standards to student’s work, exercise that professional judgment within the context of their institution, department and the students they deal with. Teachers and Grading Walvoord & Anderson, 1998)
  • 29.
    Grading and teachersroles Grades matter greatly for teachers who often experience the tension of performing two conflicting roles : 1. Coaches - instructing, guiding student writing 2. Judges - evaluating students work ** Teachers themselves are often judged by the grades they give.
  • 30.
  • 31.
    Grading schemes - the series of assessment tools (exams, tasks, projects, etc.) that are scored and used to arrive at a final grade for students.
  • 32.
    2010 MA TESOLProgram San Francisco State University
  • 33.
    (Brown & Abeywickrama,2010) Standards for assigning grades are extraordinarily variable across teachers, subject matter, courses, programs, school systems, and even cultures.
  • 34.
    Contents Introduction: AssessmentWords of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
  • 36.
    What should gradesreflect? How should different objectives, tasks, and components of a course figure into a formula for calculating grades?
  • 37.
  • 38.
    Grading criteria/weighting taskConsider the course information provided (teaching assignment next slide) Determine the criteria you will use to set up your grading scheme Determine the weighting of the items in your grading scheme (to total 100%)
  • 39.
    Teaching Assignment Coursetitle/level : 50 Writing (intermediate) 16 international students Course focus : writing effective essays Main learning outcome : Students will be able to write effective 5-paragraph essays of various types (e.g. argumentative, cause &effect, compare/contrast) Length : 8 Weeks
  • 41.
    What factors shouldbe included in deciding the final grade for a course?
  • 43.
    Questionnaire responses Ina recent administration of the questionnaire to teachers as the American Language Institute at San Francisco State University . . . the item on which most teachers agreed on was item (a) which received percentage allocations from 50-75%.
  • 44.
    Brown & Abeywickrama(2010) It is safe to assert that formal tests, quizzes, exercises, homework, essays, reports, presentations – all of which are marked in some way – are universally accepted as primary criteria for determining grades.
  • 45.
    Responses-American Language Institute,SFSU Items (b) and (c) also drew relatively strong support. A word of caution : If intuitive, informal observations by the teacher figure into the final grade, it is very important to inform students in advance how these observations, and impressions will be recorded throughout the semester.
  • 46.
    Responses-American Language Institute,SFSU On items (d) through (h) there was some disagreement and considerable discussion but all of these items received at least a few votes for inclusion.
  • 47.
    How can thesefactors (improvement, effort, motivation, etc.) be systematically incorporated into a final grade ? Some educational assessment experts state definitely that none of these items should ever be a factor in grading.
  • 49.
    (Gronlund & Waugh,2008) Base grades on student achievement, and student achievement only. Grades should represent the extent to which the learning outcomes were achieved by students. They should not be contaminated by student effort, tardiness, misbehavior or other extraneous factors . . . If they are permitted to become part of the grade, the meaning of the grade as an indicator of achievement is lost.
  • 50.
    Brown & Abeywickrama(2010) This is a strongly empirical philosophy of grading . There are other points of view that consider other factors in assessing and grading (Grove, 1998; Marzano, 2006; Power 1998, etc)
  • 51.
    Brown & Abeywickrama(2010) How many teachers do you know who are consistently impeccable in their objectivity as graders in the classroom?
  • 53.
    If you arewilling to include some nonachievement factors in your grading scheme, how do you incorporate them along with other more measureable factors?
  • 54.
    Contents Introduction: AssessmentWords of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
  • 55.
  • 56.
    Guidelines for SelectingGrading Criteria (4) It is essential for all components of grading to be consistent with an institutional philosophy and/or regulations. All components of a final grade need to be explicitly stated in writing to students at the beginning of a term of study with a designation of percentages or weighting figures for each component.
  • 57.
    Guidelines for SelectingGrading Criteria (4) 3. If your grading system includes items (d) through (h) in the questionnaire, it is important for you to recognize their subjectivity and convert such factors into observable and measureable results (e.g. using checklists, note-taking systems, etc.). 4. Consider allocating relatively small weights to items (c) through (h) so that a grade primarily reflects achievement .
  • 58.
    Grading and StudentEvaluation : Challenges, Choices, and Consequences
  • 59.
  • 61.
    The goal ofassessment has to be, above all, to support the improvement of learning and teaching. (Fredrickson & Collins, 1989)
  • 62.
    Contents Introduction: AssessmentWords of Wisdom Grading and Student Evaluation Grading Questionnaire task Grading Guidelines Conclusion – A Story
  • 63.
  • 64.
  • 65.
    A grandfather plantingseeds in his garden was asked by his grandson, “How do you make the seeds grow?” The grandfather replied, “I can’t make the seeds grow, but I can provide the best conditions for them to grow.”
  • 66.
    Effective classroom-based assessmentcan greatly contribute to the successful nurturing and development of our student’s language learning.
  • 67.
  • 69.
    Assessment: Grading &Student Evaluation (January, 2012) Eddy White, Ph.D. Assessment Coordinator Center for English as a Second Language University of Arizona