Let's make Judging Feedback work!

[Str0ngkatTh1rteen]

Thank you so much for your feedback and helpful insights, Foster! I ran a search on the VF for previous threads, and these are some of the ones I found (please lmk if there are any other resources I can look into for this, I’d so appreciate it):

Should the judges give feedback on your notebook

More discussion of this topic has taken place in various other threads, including these:

STEM Judges feedback for teams

It’s not that the judging process is flawed, but that opening up that process and giving teams rubrics or any other feedback will ultimately leave people with an incomplete picture of the process. People will then fill in the gaps with conjecture. Unlike a teacher who is giving feedback to a student so they can improve their work on a personal level, judges at these events are ranking teams over each other and there isn’t a one on one relationship, which is needed for constructive feedback. Pe…

Judges’ Comments to Teams

There is another thread going on about comments back from the judges to teams. Currently RECF has said to not return the rubrics to team since the point value is very subjective and that some teams will come argue the score with the judges. In Delmarva for 2018-19 I piloted the return of feedback to VIQ teams about their interview and notebook. The form had on it “These Judges comments are offered as a way that your team can improve.” The guidance to the judges was to give 2-5 comments back …

Why are judging rubrics not released?

Other threads where this has been discussed: and various others - a forum search for “rubric return” returned lots of results.

To address some of the issues mentioned in your post (to which I have directed my reply):

1. Too much work for the judges
   In the replies I’ve been getting, most people would be happy with a simple numerical rating out of 5 and some simple feedback for why that rating was given for each of the multiple categories in the rubric. I’m thinking of creating a draft feedback-oriented rubric form where the judges can simply annotate the score of team in that specific criteria, as well as any additional comments they may have.
   Doing this would reduce time for the judges, as they wouldn’t have to fill anything out additionally, and they could only do the feedback transfer for the teams who request to be given feedback. The rubrics used for judged award deliberations could be eliminated as per the REC Foundation policy-- or, we could change the REC Foundation policy to allow the rubrics to be returned to teams as-is with no extra transfer needed.

2. Criticism from teams/parents directed at EP and judges
   An effective feedback management system could solve this issue. By asking parents, teams, and volunteers to fill out a feedback form which could be managed regionally, the feedback could be collected and used to create positive change while saving the EP from undue criticisms. Teams could report judging bias, provide suggestions for improvement, and provide lots more useful feedback for the REC Foundation to collect and use.

3. Competitions with v.s. without judging feedback
   Could stating whether the event does or does not offer feedback be a possible solution? Additionally, offering a specific section of the judge guide which would include examples of good and bad feedback (“You scored a 3 because your notebook lacks detail in programming logs” versus “3 because it needs more detail but good job”). Any complaints could be handled through the solution for item 2, mentioned above.

Further Research I’m Looking Into
I’m looking into other education-oriented systems with judging feedback such as the National Speech and Debate Association to see how they do it. If there are any other organizations such as the NSDA which you think I should look into, please let me know and I’ll check them out as well.

Final Note
I’m really passionate about creating positive change in the VRC program. And, as NReese mentioned,

@NReese

Feedback from judges would REALLY enhance the learning opportunity in VEX.

Given that 98.3% of 58 responders to my poll so far have indicated that judging feedback is desired, the question is not if, but how! I’m confident that we can find a viable solution together as a community.