NH-DI Scoring, 2012

November 26, 2011 NH RCM Training Destination ImagiNation 1

Quick synopsis…

• Things are the same as last year!

• If you’re returning as an RCM… – This should be a review – Hope you thought it worked well last year – If you’d like to suggest changes, now’s the time • Please discuss here, or send to [email protected]

• If you’re new to the role… – Welcome aboard!

November 26, 2011 NH RCM Training Destination ImagiNation 2

Purpose of this Presentation

• Discuss what’s new in Scoring – Improved deduction handling • Review some points from last year – Deductions – Distribution of scores • Outline the “contract” between the score room and the challenge rooms – How we will work together • Go over

special

challenge items November 26, 2011 NH RCM Training Destination ImagiNation 3

Marking Score Sheets

• Appraisers like to mark their score sheets, to indicate which items they are not scoring • Please (

PLEASE!

) do not mark the sheets in the area used to record scores… • Mark in the title area, on the left… November 26, 2011 NH RCM Training Destination ImagiNation 4

Deductions

• • • Intended to make the competition fairer • Allows appraisers to remove the unfair benefit gained by an infraction – Deduction may not be for more than the score received.

– Two ways to do this: • By percentage – No need to average.

• By points - Need to average appraisers’ scores for this

Worksheets provided

– To be used when needed.

Must

give the reason for the deduction.

November 26, 2011 NH RCM Training Destination ImagiNation 5

Deductions (cont)

• By Points: – Enter the deduction in the 1-30 range … • We’ll scale it in the score room, just like scores • Don’t need to scale or total • By Percentage of the awarded score – Enter deduction as a percentage (up to 100%) • No need to actually know the score • Deductions for objective scores – Use with caution. Objectivity

is

… – Use scoring units (not 1-30) • e.g. pounds for weight held November 26, 2011 NH RCM Training Destination ImagiNation 6

Deductions Worksheet

November 26, 2011 NH RCM Training Destination ImagiNation Do not bother scaling the deductions.

We do that in the score room… This year’s sheet will (hopefully) have an indication for percentage or points 7

The Low End of the Score Range

• Subjective scores are scored 1-30 – With a range of 30 points, we don’t really need to award less than 1.00 • Zero subjective score is

special!

– Can only be awarded if the item didn’t exist or was an invalid solution November 26, 2011 NH RCM Training Destination ImagiNation 8

Distribution of Scores

• Work with the Rubrics!

• In past years we have seen some appraisers score all the teams as 29 or 30… – They’re not doing their job!

– They could just as well have stayed home; they didn’t affect team placement!

• The whole range is available for your use.

– If people use the entire ranges, there won’t be much need for fractional scores

1) Creativity of …….. 3.14159265358979

– But you can still use them… if you must!

November 26, 2011 NH RCM Training Destination ImagiNation 9

Score Room Liaison

• Ensures that – all forms are present – all (and

only

) the correct scores are filled in • Prepares the scores for transmission to the score room • Can manage your paperwork,

if you choose

– Talk with your liaison about your expectations / style; it makes both of your days easier and more fun November 26, 2011 NH RCM Training Destination ImagiNation 10

Score Room Liaison

• All score calculations are done in the score room,

except:

– Averaging Appraiser scores when determining an appropriate deduction – unless using % • The liaison handles ALL your paperwork at some point. Give him or her adequate

s-p-a-c-e!

November 26, 2011 NH RCM Training Destination ImagiNation 11

Start of the Day

• Fill in the Appraiser Assignment form and send to the score room as soon as possible – Have the Liaison bring it down –

before

the start of the competition schedule • Review the Printed Appraiser Assignment sheet that we return – Make sure that we got it right (yes, we make mistakes!) – Give to your Score Room Liaison.

This is his/her primary guidance to check all needed scores are on appraiser forms!

November 26, 2011 NH RCM Training Destination ImagiNation 12

Appraiser Assignment Form

November 26, 2011 NH RCM Training Destination ImagiNation 13

Paper Flow

• Send all scores to the score room, as expeditiously as possible – We are aiming for a runner per room • Scores computed, TM and HA score sheets are printed • Entire paperwork packet returned to the challenge room for conversation with the TM – Return packet to the score room for filing when done with presentation to the TM November 26, 2011 NH RCM Training Destination ImagiNation 14

Dave Barry View of the Process

• Packet comes in • Papers from wrong team • Packet goes back/comes back • 1 st computer notices disagreeing 0 subj score • Packet goes/comes • 2 nd computer sees missing explanation of deduction • Packet goes/comes • Cross check fails • Find mis-typed number • Print/send scores for HA/TM • HA changes score • Reprint/send • Finish challenge level • Print scores for announcing • HA comes in, asks for all scores • Changes all scores • Re-enter • Reprint… November 26, 2011 NH RCM Training Destination ImagiNation 15

Paper Flow Suggestion

• Appraising Teams like to hold the first three scores, but… • We find that changes as a result of holding the scores are, in fact, rare… • Give the scores to the Liaison after each team to check, sort and make ready for shipment… • But hold them in your room!

• Enables expediting their processing when your Appraisers are comfortable.

• Otherwise, your Liaison is immediately behind the 8-ball after the third team… November 26, 2011 NH RCM Training Destination ImagiNation 16

Returning a Packet for Corrections

• Most packets will have a

GREEN

hot-dot on them.

– They’re good-to-go—present to the TM.

• Some will have a

RED

hot-dot! – We have detected an error in the scores – There will be a printed sheet inside, describing the problem – Please correct and return ASAP • Your TM will be waiting for the results!

November 26, 2011 NH RCM Training Destination ImagiNation 17

Causes for Returns

(examples) • Missing paper • Missing scores • Illegible scores • Extra scores!

• Zero subjective scores with no explanation • Deductions with no explanation November 26, 2011 NH RCM Training Destination ImagiNation 18

To Inform the Score Room of a Change

• You will have a sheet of

RED

hot-dots • If you want to correct a score after presenting to the TM – Put a note in the packet in front of the other papers describing the change you desire,

and sign it

– Cover the

GREEN

dot with a

RED

one – Return the whole packet to the score room – We’ll make the change, and return the whole packet again to the challenge room • Complete with new TM and HA score sheets • We will remove and destroy the previous sheets November 26, 2011 NH RCM Training Destination ImagiNation 19

What Does the Score Room Need?

First thing in the morning

• Appraiser assignment sheets! (TC only) Throughout the day,

for each team, in a timely

manner…

• All their paperwork—in this order, please 1. Deductions worksheet

(Only if needed!)

2. Prep area sheet 3. Extra score sheets • Challenge A: Worksheet in the works. Stay tuned • Challenge E: weigh in (one or more), weight held 4. Each appraiser’s score sheet, in order by name 5. Anything else (it isn’t used in scoring) November 26, 2011 NH RCM Training Destination ImagiNation 20

What Does the Score Room Need?

(cont.) Throughout the day • An empty packet for no-show teams, with a note • Early notice of any score changing incidents that will be coming – e.g., probable DIalogue request • we will hold off printing that challenge level’s results until you give us the go-ahead • You MUST let us know about the resolution so we can print!

November 26, 2011 NH RCM Training Destination ImagiNation 21

At the end of the day

• You

must before

sign out with the score room dismissing your appraising team!

• Makes sure all your scores have been processed with no issues – Get your appraisers’ cell phone numbers, just in case!

November 26, 2011 NH RCM Training Destination ImagiNation 22

What the Score Room Can Do for You

• Come to your room on request to discuss any questions • We try to track teams that have not arrived – If you wonder about a team, ask • Print extra copies of tournament forms – Not IC, the village is on its own.

• Answer your questions – But we might have to make them up!

• Bring back score packets for teams that have competed, at your request November 26, 2011 NH RCM Training Destination ImagiNation 23

Special Challenge Items

Nothing major… Challenge A: No deductions on item 3, Order Completion due to side effects of multiplying item scores Score Sheets will have different wording than section D of the challenge description.

Challenge E: A similar multiplier side effect exists for # of golf balls held, but deductions will not be disabled. Be very aware of the scaling consequences.

Speak now… November 26, 2011 NH RCM Training Destination ImagiNation 24

What if ?

• I haven't seen a score runner in 45 minutes or more; I have lots of scores ready! What should I do?

• We need to discuss this team's score, and won't be sending the scores in until after lunch. What do I need to do?

• This team shouldn't go on. What deduction should be given to ensure that?

November 26, 2011 NH RCM Training Destination ImagiNation 25

Questions???

November 26, 2011 NH RCM Training Destination ImagiNation 26