Transcript Document
Site Visit Training
Learning Objectives:
•
Describe the purpose of each phase of the Site Visit process and the team’s deliverables.
Describe the major steps of each phase of the Site Visit process.
Clearly picture the team’s timeline and how it relates to each phase of the process.
The Baldrige Award Process
Independent Review Consensus Review Oct- Jan Jan-Feb Site Visit Review March
The Site Visit Process
What is the objective of the Site Visit Review?
Communicate Findings to Panel of Judges so that they may make award level determinations
Determine Most Relevant Feedback
Identify Role Model Practices
The Site Visit Process
What is the output of the Site Visit Review?
Site Visit Overview
• Congratulations to Applicant • Team Introductions • Team Organization • Team Conduct On-Site • On-Site Schedule • Schedule Changes • Exit Briefing Time
Post-Site Visit Overview
• Thanks to Applicant for Cooperation • Off-Site Activities • Completing the Site Visit Report • Return Materials to Contact • Team Recommendation • Judge’s Meeting • Announcements and Awards at Symposium • Feedback Report
Site Visit Review: Three Phases
PLANNING ON SITE POST SITE
Site Visit Review: Timeline
PREPARATION 35 HOURS ON SITE ON SITE 10 HOURS / DAY 6 HOURS / EVENING
TRAVEL
SUNDAY MEETING 5 HOURS POST SITE HOTEL 48 HOURS
TRAVEL
Planning Phase Overview
PLANNING ON SITE POST SITE What happens before the planning starts?
Site Visit Review Timeline
Review Planning Information Create the Plan Prepare for the Planning Call Develop Site Visit Issues (SVI) and Strategies Develop Site Visit Issue (SVI) Worksheets Review Team Member SVIs Steps in the Planning Phase
What do you investigate?
• Clarify all OFIs No “Not Clear” after SV • Verify significant Strengths
How do you investigate?
• Documentation • Group interviews/ meetings • Individual interviews • Walk around Questions
Code of Ethical Conduct
If you have already signed one you don’t need to sign another
On Site Phase Overview
PLANNING ON SITE POST SITE
Site Visit Review Timeline
DAY 1 Conduct Opening Meeting Meet with Applicant’s Category Leads Schedule Day 2 and 3 Activities and Interviews Steps in the On Site Phase DAYS 2 & 3 Conduct Follow Up Meetings/Interviews & Document Review DAY 4 Conduct Closing Meeting Each Day: Team Members Caucus Each Evening: Team Meets and Posts Work
Post Site Phase Overview
PLANNING ON SITE POST SITE
Walk the Wall Revise Key Factors, Key Themes, Item and Score Summary Worksheets Assemble and Sign the Scorebook Steps in the Post Site Phase
What’s happening before the planning starts?
The Applicant is selected by the Baldrige Panel of Judges. These Judges are charged with the responsibility of making Award recommendations to the WSQA Board of Directors WSQA notifies the Applicant of its selection.
A Team Leader and Back Up are selected by WSQA from a pool of Senior Examiners.
Teams of 5-10 examiners are finalized. Team members selected based on experience, industry knowledge and availability.
A WSQA mentor (PEPD member) is selected to join the team .
The Applicant’s “Official Contact Point” (OCP) is notified of the purpose and expectations of the site visit.
What’s happening behind the scenes during the
Planning
phase?
The Team Leader and Mentor coordinate planning calls, logistics for the team, mentoring by the Team Leader, and the Site Visit Schedule, including the travel schedule.
2 days in advance of the Site Visit the Team Leader sends the 1 st day interview schedule and documentation requirements to the Applicant’s Official Contact Point (OCP).
The Team Leader sets the agenda for the Sunday planning meeting, and drafts a schedule for the rest of the site visit.
What’s happening behind the scenes during the
On Site
phase?
The Team Lead or mentor meets with the Applicant’s 0fficial Contact Point (OCP) at the end of each day to debrief the day’s events.
The Mentor makes observations and recommends improvements to the site visit review process.
The Team Leader or mentor discusses with the OCP ongoing communication and interview scheduling needs.
The team lead coordinates with the OCP for visits to other sites and other work shifts as necessary.
The Mentor and Team Leader ensure that the team and the Applicant are satisfied with the process.
What’s happening behind the scenes during the
Post Site
phase?
The team consolidates all computer files.
The Team Leader and Mentor take an electronic copy of the Scorebook.
Shred unneeded documents The scorebook editor, Team Leader and mentor edits the Scorebook and performs other duties to prepare for the Judges meeting.
The Team Leader and mentor will participate in the Judges Meeting.
Chair of the Judges panel will notify the WSQA Board of their award Recommendations To close the process, WSQA will generate the Feedback Report and send to the Applicant and will notify the applicant of the award level
Timeline
PLANNING Sept / Oct PREPARATION 12 HOURS ON SITE Mon - Thurs 10 HOURS / DAY 6 HOURS / EVENING POST SITE Thurs - Sat HOTEL 48 HOURS TRAVEL SUNDAY MEETING 9 HOURS TRAVEL
Conduct- Professional
• Dress – professional on site attire • Safety rule adherence • NO SMOKING within 25 ft of building • NO SMOKING in the conference room • Respect the expense policy • Always travel in 2’s on site • Language professional (no cursing)
Documenting Your Work
Objectives
Upon completing this unit, Examiners new to site visit will be able to:
• Differentiate the 3 forms used to document their work by name and use • Identify Resource and Reference materials, their locations, and the additional details provided for completing each required form
Site Visit Issue Worksheet
• Worksheets help you plan • Ensure issue has been addressed • Document findings
Documenting Your Work
Item Worksheets Site Visit Issue Worksheets Site Visit Strategy Tool
Part One
ITEM WORKSHEET
Step 1 Gather the Completed CR Scorebook and the blank SV Scorebook
Completed CR Scorebook Blank SV Scorebook
Step 2 Create an Item Worksheet for each of your assigned Items
Step 3 List the Item references for each Consensus comment in the first column of the Item Worksheet Site Visit Item Worksheet Consensus Item Worksheet
Step 4 Copy and paste each Consensus comment into the second column of the SV Item Worksheet Consensus Worksheet Process Item Worksheet
Item Worksheet
-
Review
1. Gather your Consensus Scorebook and a blank Site Visit Scorebook.
2. Create an Item Worksheet for each of your assigned Items.
3. List the Item references for each Consensus comment in the first column of the Item Worksheet.
4. Copy and paste each Consensus comment into the second column of the Item Worksheet.
PART TWO
Developing Site Visit Issue Statements
Developing Site Visit Issue Statements from Consensus Comments Basic Requirements for Process Items
All bolded comments and all OFI comments must be verified (strength) or clarified (OFI’s). SVI’s should be developed at the key process level. Typically Examiners are able to verify or clarify 1 to 3 SVI’s per item.
Developing Issues at the Key Process Level
Several comments addressing multiple Criteria requirements within an Area to Address can be grouped in an SVI focused on an Area to Address using language from the Overall Criteria requirements.
Developing SV Issues at the Key Process Level
Item 1.1 Requirements Site Visit Issue Statements
• Write the Site Visit Issue at the Area to Address level • When your comments are written at the multiple requirement level
Drafting the SVI Statement
Site Visit Issue statements begin with the objective to:
Verify (an applicant response) or Clarify (an applicant response)
Complete the SVI Statement
Verify that the performance measurement system does exist and is operational. Clarify whether a learning process is in place.
Document the SV Issue statements on the Item Worksheet
Completing the Site Visit Issue Worksheet
Item Worksheet Site Visit Issue Worksheet
Part Three
DEVELOPING SITE VISIT ISSUE WORKSHEET
Developing the SV Issue Worksheet - Process
Process Item Worksheet Process Site Visit Issue Worksheet
Completing the SV Issue Worksheet – Process Items
1.
2.
3.
Copy and paste the Item Reference(s) from the Item Worksheet to the SV Issue Worksheet.
Copy and paste the SVI statement from the Item Worksheet.
Read through the entire Consensus Scorebook noting Item comments that could be impacted by your findings.
Identify the core questions that must be answered in order to draw conclusions about the accuracy of the Consensus comments
Part Four
Developing Core Questions
Analysis Required
The SVI Worksheet asks, “What core questions must be answered in order to draw conclusions about the accuracy of the comments affected?”
Principle
Questions for Process Items should be built around verifying or clarifying the references to Approach, Deployment, Learning, and Integration (ADLI) included in the Consensus comment . Questions for Results Items should be built around verifying or clarifying the references to Levels, Trends, Comparisons, and Integration (LeTCI).
A-D-L-I Le-T-C-I
Approach
Item Ref.
STRENGTHS 4.1a(1,3) The SLT is responsible for tracking overall organizational performance. As part of the SPP, the SLT chooses performance measures and ensures the measures address all principal success factors. The MAP data warehousing software is used to selecting data and information collect and manage the performance data for . All members of the workforce can access MAP and enter their own performance data directly , with some real-time data automatically uploaded and integrated into process scorecards . Routine performance reports are automatically generated from MAP, including supplier scorecards that are shared with key suppliers and partners. Twenty-two key operational and strategic performance measures, with associated performance goals and comparisons, are presented in the organizational scorecard (Figure 4.1-1). These measures are linked to the applicant’s strategic objectives, strategic advantages and challenges, and core values, and they provide the potential for the integration of strategic planning, operations, decisions, and actions.
Deployment
Item Ref.
STRENGTHS 4.1a(1,3) The SLT is responsible for selecting data and information for tracking overall organizational performance. As part of the SPP, the SLT chooses performance measures and ensures the measures address all principal success factors. The MAP data warehousing software is used to collect and manage the performance data. All members of the workforce can access MAP and enter their own performance data directly, with some real-time data automatically uploaded and integrated into process scorecards. Routine performance reports are automatically generated from MAP, including supplier scorecards that are shared with key suppliers and partners . Twenty-two key operational and strategic performance measures, with associated performance goals and comparisons, are presented in the organizational scorecard (Figure 4.1-1). These measures are linked to the applicant’s strategic objectives, strategic advantages and challenges, and core values, and they provide the potential for the integration of strategic planning, operations, decisions, and actions.
Learning
Item Ref.
STRENGTHS 4.1a(1,3) The SLT is responsible for selecting data and information for tracking overall organizational performance. As part of the SPP, the SLT chooses performance measures and ensures the measures address all principal success factors. The MAP data warehousing software is used to collect and manage the performance data. All members of the workforce can access MAP and enter their own performance data directly, with some real-time data automatically uploaded and integrated into process scorecards. Routine performance reports are automatically generated from MAP, including supplier scorecards that are shared with key suppliers and partners. Twenty-two key operational and strategic performance measures, with associated performance goals and comparisons, are presented in the organizational scorecard (Figure 4.1-1). These measures are linked to the applicant’s strategic objectives, strategic advantages and challenges, and core values, and they provide the potential for the integration of strategic planning, operations, decisions, and actions.
Alignment and Integration
4.1a(1,3) The SLT is responsible for selecting data and information for tracking overall organizational performance. As part of the SPP, the SLT chooses performance measures and ensures the measures address all principal success factors. The MAP data warehousing software is used to collect and manage the performance data. All members of the workforce can access MAP and enter their own performance data directly, with some real-time data automatically uploaded and integrated into process scorecards. Routine performance reports are automatically generated from MAP, including supplier scorecards that are shared with key suppliers and partners. Twenty-two key operational and strategic performance measures, with associated performance goals and comparisons, are presented in the organizational scorecard (Figure 4.1-1). challenges, and core values, These measures are linked to the applicant’s strategic objectives, strategic advantages and and they provide the potential for the integration of strategic planning, operations, decisions, and actions.
Quick Quiz – Core Questions
SVI Statement: Verify that the performance measurement system does exist and is operational. Verify the approach, deployment, and alignment described in the application. Clarify whether a learning process is in place. What question(s) do you need to answer in order to draw conclusions about the accuracy of the feedback you are providing to the applicant about its performance management system?
Quick Quiz – Core Questions
SVI Statement: Verify that the performance measurement system does exist and is operational. Verify the approach, deployment, and alignment described in the application. Clarify whether a learning process is in place. What question(s) do you need to answer in order to draw conclusions about the accuracy of the feedback you are providing to the applicant about its performance management system?
Process and Result Items Documentation Process Items Documentation
• Use the Consensus Scorebook and the Process Item Worksheet • Use the Process Issue Worksheet Site Visit – Calls for Item references – Use A-D-L-I evaluation factors.
• All bolded comments and all OFI comments (OFI) must be verified (strength) or clarified • Use the Site Visit Strategy Tool
Results Items Documentation
• Use the Consensus Scorebook and the Results Item Worksheet • Use the Results Issue Worksheet Site Visit – Calls for numbering the strength comments and the OFI comments – Use Le-T-C-I evaluation factors • All comments or clarified must be verified • Use the Site Visit Strategy Tool
Developing the Results Site Visit Issue Worksheet
• Place holder for CR Results Item Worksheet
Transfer the comment number and a brief description of the subject to the Column labeled Comment #.
Consensus Item Worksheet Results Item Worksheet
• Placeholder for CR Item 7.x worksheet
For each comment, list the figures associated with that comment.
Consensus Item Worksheet
• Placeholder for Consensus Results Comment
Results Item Worksheet
Summarize for the comment as a whole your relevant analysis in each of the Le-T C-I columns.
Levels Trends Comparisons Segmentation & Linkage
Part Five
SITE VISIT STRATEGIES
Developing SVI Strategies
Once you have developed your core questions, you will need to draft your strategy for answering the questions and closing your site visit issue.
Closing the site visit issue refers to having determined that the answer to your questions does or does not exist.
Completing the Site Visit Strategy Tool
Record the people you would like to interview and the questions you would like to ask. Record the documents you would like to review and the information you want to see in these documents. List your walk around questions. Identify the events, meetings, activities, or processes you would like to observe and what you would like to see. List the sites you would like to visit and the purpose of the visit, e.g. location for a scheduled meeting, a unique process to observe, or an opportunity to check deployment with a specific group of employees.
Completing the SV Issue Worksheet
Summarize the Evidence, Conclusion and the Impact on the Consensus Comment
Part Six
COMPLETING THE ITEM WORKSHEET
Completing the Item Worksheet – Process
Transfer a summary of your findings to the column labeled Summary of Conclusions and Impact on Comments. Revise the Consensus comments as appropriate and enter into the third column, Strength/OFI Comments After Site Visit.
Transfer your Evidence, Conclusion, and the Impact on the Comment to the Item Worksheet.
Revise and Record the Comment - Process
Completing the Item Worksheet Results
Results Item Worksheet
Complete the rows: New Data Found on Site & Newly Recognized Gaps Discovered on Site
Completing the Item Worksheet Results
Results Item Worksheet
Complete the Summary of Findings and Impact on Comments column
Part Seven
Wrapping Up
Summary of Documenting Your Work
Part One
demonstrated how to transfer information from the Consensus Worksheet to the Item Worksheet.
Part Two
described how to develop Site Visit Issue Statements.
Part Three
described how to fill in the SVI Worksheet.
Part Four
gave you practice in analyzing comments to form core ideas.
SV Tips from others
• Meetings -improve focus by including an open question at the end of the meeting -restate or summarize to ensure clear understanding and to reinforce that you were heard • Keep an open and friendly demeanor to help place the applicant at ease • Review key themes early – include in walk the wall • Have a fun coordinator to ensure there
SV Tips from Others
• Have a fun coordinator to ensure there are breaks, food, and some fun • Remember to treat your teammates with respect, even if you are tired. • Work as a team- ask for help and give help • Be kind and supportive • Be organized and prepared
Materials / Tools
• 1 st planning call –sent to mentors and lead • Manual • Slide set • Strategy Tool and sample • SV scorebook (process and results sample) • SV Quick start • Document Log • Interview log • Walk around Questions • Opening and Closing slides (mentor & lead)
Congratulations
You have completed this learning module and should be able to: Differentiate the three forms you will use Enter the appropriate information on each form Ensure the data remain consistent and accurate as you transfer them from one form to another