Chapter 11: Why is it difficult to generate discrimination indices for performance assessments consisting of only one or two fairly elaborate tasks?
It would be difficult to generate discrimination indices for performance assessments consisting of only one or two tasks because each task would represent one half of the total test. Since an item-discrimination index reflects the relationship between students’ responses for the total test and their responses to a particular test item, it would be hard to determine how one item compares to the overall test. Furthermore, if the two tasks require multiple steps or demand that students construct a response, there would be an added difficulty of grading. It seems that discrimination indices are useful on tests that consist of many selected-response items rather than few constructed response items.
Chapter 11: If you found there was a conflict between judgmental and empirical evidence regarding the merits of a particular item, which form of evidence would you be inclined to believe?
For me it would depend on the particular item. If the item was from a performance test consisting of constructed response questions or less objective type questions I would be more inclined to believe the judgmental evidence. Judgmental evidence brings in the “human” element, which I believe is a necessary component when judging test items. The human element helps to consider such things as student experience, background, biases, and how the information tested compared to the level of instruction that was provided. If the item were more objective I would probably first look at the empirical evidence. The empirical evidence would help to point me in the right direction for locating potential problems. I would then compare the empirical with the judgmental and most likely go with judgment.
Chapter 12: What strategies do you believe would be most effective in encouraging more teachers to adopt the formative-assessment process in their own classrooms?
One strategy that I believe would work would be to offer teachers in-service training at the beginning of the school year to provide education about what formative-assessment is and isn’t. Then, give teachers time to plan so that they can think about how to incorporate formative-assessment into their instruction. For example, let teachers plan with others in their content area so that they can create learning-progressions as a team. I also think it would be helpful to give teachers examples and ideas for what formative assessment would look like in their content area. I’m sure that many teachers are aware of the research that supports formative assessment and would like to include it as part of their practice. However, the challenge is often turning an idea into action. Therefore, I think the most effective strategy is to offer teachers training with “hands-on” type practice so that teachers can get familiar with formative-assessment and knowledgeable about how to infuse it into their teaching.
Chapter 12: The chapter was concluded with some speculation about why it is that formative assessment is not used more widely. If you had to choose the single most important impediment that prevents more teachers from employing formative assessment, what would this one impediment be? Do you think it is possible to remove this impediment?
I would say the single most important impediment that prevents more teachers from employing formative assessment is “teachers’ tendencies to resist altering their current conduct.” The reason I think this is because teachers have established their habits and have figured out methods that are efficient and effective. Limitations on time hinder a teachers’ ability to make major changes to their practice. During the school year teachers are too busy with day-to-day activities, forming relationships with students, communicating with parents, planning lessons for the next day, grading papers, etc. There simply isn’t the time to devote to adding something brand new to the mix. Thus, teachers resort to old habits that they have found effective.
Removing this impediment would require major adjustments. One strategy that could work is to give teachers a block of paid training and planning time at the beginning of the school year. During this time teachers would be educated on formative assessment and coached on how to create learning progressions. I think follow-up trainings should occur throughout the year to help answer questions and refine methods. Perhaps once every two or three months teachers could have an in-service training day to spend on planning and asking questions. In order to make big changes and bring in formative assessment there needs to be continual training and revisiting. Otherwise, teachers will simply forget about it and resort to what they know.
Popham, W.J. (2011). Classroom assessment: What teachers need to know (6th ed.). Boston, MA: Allyn & Bacon.