Transcript Slide 1
An Exciting Time in the Field of Testing ! Testing Industry Momentum Growth and Change $ Multi-Billion $ Testing Companies are Increasing in Size and in Number Paper & Pencil Volumes Worldwide are Continuing to Move to CBT This academic year more than one million P&P tests will move to CBT Tens of millions of tests still remain P&P New “service providers” are entering the field supporting all aspects of testing New test delivery vendors are emerging focusing on selected market niches Larger test delivery vendors are growing by buying smaller testing-related companies Even large test delivery vendors are being sold to other large test delivery vendors “Independent commercial” test centers are just starting to emerge around world promising to introduce a new dynamic into the traditional academic and corporate designations. Emerging technologies are introducing new paradigms for test delivery Continuing advances in reconciling psychometric opportunities with existing business restrictions So what’s going on in academia? Is there growth and change underway in the nations colleges that could enhance the value of college testing departments? In Academia: Assessment in general is more integrated into the institutional process then ever before Increased need for secure testing to support On-Line Learning Increased recognition of the importance of Placement Testing In Academia: Increasing demand for centralized make-up testing Increasing demand centralized testing for on-campus courses Increased value of test revenue in financially demanding times As our value to our colleges increases what do we find? reduced budgets increased work load reduced staffing increased expectations College administrators aren’t really sure about what they should do with us Student Affairs? Academic Affairs? Student Retention? Counseling? Institutional Assessment? Enrollment Management? College administrators aren’t really sure about who we are or what we do! College Testing Professional ? ? ? College Testing Professional Dedicated to established national standards & professional practices in the administration of testing programs and services Committed to fair and consistent testing maintaining the security and standardization demanded for the equitable and reliable administration of life impacting assessments. College Testing Professional Negotiate agreements with outside vendors UNIQUE ! Respond to changes in a commercial industry Provide services to individuals outside your college community College Testing Professional Establish Budgets Operate Multiple Software Systems Adapt to Multiple Outside Operational Protocols Purchasing & Invoicing Develop Publications Offer Services Daytime, Evenings, & Weekends Hire and Supervise Handle Revenue Oversee Inventory Maintain Web Page Content Work Directly with Local and National Vendors Provide Support to Both Academic & Student Affairs College Testing Professional It seems there is never enough time and nothing goes as planned!! College Testing Professional College Testing Professional College Testing Professional National Standards How-To Help Professional Colleagues Best Practices Resources & Guidance Professional Credibility Within Your Institution A Personal Perspective The College Testing Professional The Future and NCTA NCTA is at a Crossroad WHO SHOULD NCTA SERVE? “Duh”! Our name says it all. NCTA should serve only Colleges. WHO SHOULD NCTA SERVE? What about the testing professionals in the nations public elementary and secondary school districts? What about the thousands of testing professionals working in licensing agencies and certification bodies, and in non-profit organizations, and in State Departments of Education? WHO SHOULD NCTA SERVE? Let those other testing people do their own thing and we’ll do our thing ! ! These are not college people ! The Precedents for College Leadership The is a rich history of leadership by assessment and testing professionals within the nations colleges that has created the fields of psychometrics, assessment and testing. The College Entrance Examination Board published subject syllabi for schools to teach and colleges to test. Lewis Terman at Stanford created the Intelligence Quotient (IQ) by dividing mental age by chronological age. Edward L Thorndike applied the scientific method to the construction of tests that measure academic performance. The Stanford Achievement Tests were created to assess subject knowledge. First Scholastic Aptitude Test was introduced. The California Achievement Test was published. Researchers at University of Iowa developed the Iowa Test of Basic Skills. Universities and the College Board were operating their own commercial testing businesses These tests were delivered throughout the country The Universities were doing their own test development, delivery, scoring and reporting The Universities actually were the nation’s Testing Industry! The post WWII demand for college entrance testing led to the establishment of ETS in 1947. American Council on Education The Carnegie Foundation For-profit testing companies are a relatively new phenomenon in the field of testing. The Colleges historically led the way. Why should it be different now? NCTA is the only national organization dedicated to the development and promotion of professional standards and practices in testing. Here’s the NCTA Mission: “NCTA is dedicated to the promotion of professionalism and quality in the administration of testing services and programs, including issues relating to test administration, test development, test scoring and assessment.” It doesn’t say just for colleges! IT IS BETTER TO LEAD THAN TO FOLLOW . . . IF YOU ARE ALREADY THE LEADER NCTA SHOULD LEAD THE TESTING WORLD ! This Past Year in NCTA: Implemented the NCTA Board Grant Program Created a Volunteer Service Program Refocused the Professional Development Initiative Launched a Marketing Committee Initiative Launched a Recruitment Committee Initiative Completed the Phase-1 Pilot of the NCTA Test Center Certification Program Restructured the Conference Sponsorship Program Completed the first phase of the Web Site Redesign Restructured the Treasurer Role and Finances Launched Multiple Communications Initiatives Introduced a New Award Category for Service Completed Board Position Manuals Expanded Board Size and Extended Officer Terms The BOARD GRANT PROGRAM Brian Endicott Committee Chair NCTA BOARD GRANT PROGRAM Grant Committee Members Brian Endicott (Chair) The Ohio State University, Columbus Jill Carlson San Juan College, Farmington, NM Lea Brown East Tennessee State U, Johnson City Mike Davis Austin Community College, Austin Roberto Voci University of Oklahoma, Norman NCTA BOARD GRANT PROGRAM PURPOSE Support projects and activities that promote the Mission Support the formation of State testing organizations Encourage professional support activities for members Offer professional development opportunities for members NCTA BOARD GRANT PROGRAM ELIGIBILITY NCTA members and groups of members in good standing Other Groups and organizations supporting the Mission Award Recipients may not apply again for two years The NCTA Board may modify these Eligibilities in the future NCTA BOARD GRANT PROGRAM AWARDS Grants will initially range between $300 and $3,000 The NCTA Board will set the Award Pool total annually The Board set aside $12,000 for Grant Awards for FY10 FY10 Awards Granted total $10,400 Inaugural Year Grant Program Time Line Fall Semester Announcement, Application Submissions Spring Semester Application Evaluations, Award Decisions Summer Award Announcements at Conference Fall & Spring Implement Funded Project or Activity Summer Grantee Reports on Outcomes The timeline for FY11 Award cycle will be available at the breakout session and will be published on the NCTA website. FY10 AWARD RECIPIENTS $3,000 FACTA – Florida Association of College Test Administrators Support for the 2nd Annual FACTA Conference $3,000 Arizona College Testing Association Support to Launch the Organization and Hold a First Meeting $1,800 Kentucky College Testing Mini-Conference Support for a Statewide Meeting of KY College Testing Staff $1,400 Indiana University/Purdue University at Indianapolis Support for Expanding Testing Services Available to Faculty $1,200 Winthrop University at Rock Hill, SC Support for Staff Training and Professional Development Professional Development Committee Steve Saladin Committee Chair Professional Development Committee Steve Saladin, University of Idaho (Chair) Connie Lorrick, University of Texas, Arlington (Past Chair) Kay Alford, Coastal Carolina University Cristina Ariza, University of the Incarnate Word Cheryl Downey-Eber, Missouri U. of Science & Technology Alice A Mitchell, University of Maryland, College Park Shannon Siebler, Northwest Arkansas Community College Wendy Gruver, Texas A&M University, Commerce Professional Development Initiatives Conference Recordings – Podcasts with Synchronized Audio and PowerPoint Webinars - Topical trainings - Live / Interactive - Library of Recorded Trainings Standards & Guidelines for Testing Professionals Maximize the Professional Development Opportunities within the Certification Process Volunteer Service Program Sally Frazee Chair NCTA Volunteer Service Program Maximize volunteer service to the organization by actively recruiting volunteers Match NCTA positions and projects with members who volunteer to serve Initial Steps Taken & Completed Reviewed and identified areas in need of volunteer help Focused on key initiatives: Recruitment Committee, Marketing Committee, and Newsletter Reporters Developed a web page listing volunteer opportunities Sent out information on the mailing list Matched volunteers to open positions 2009-2010 Volunteer Highlights Committee Chairs Joseph Fenty – Recruitment Joleen Reynolds - Marketing Marketing & Recruitment Committee Members Kay Alford Regina Beach Cindy Bertalott Anastasia Brown Nancy Ness Susan Sistar BJ Stasek Linda Trevarthan Mary Vaughn Newsletter Reporters Tammy Duddy Michelle Rousseau Karen Shultz Other Committee Members Kimberly Moody Lea Brown Michiel Davis Roberto Voci • Make a point to talk to me over the next few days If you are even the slightest bit interested in joining the cause…. • Send me an e-mail when you get back to the office • Watch for mailing list announcements • Check the website for Volunteer Service opportunities Sally Frazee [email protected] NCTA Volunteer Service Program Marketing Committee Joleen Reynolds Committee Chair NCTA Marketing Committee Joleen Reynolds, (Chair) University of Texas - San Antonio Nancy Ness, Boise State University Theresa Scott, Florida Atlantic University Mary Vaughn, Mississippi State University NCTA Marketing Objectives Increase awareness of NCTA as Leader in the testing field Expand the awareness of the benefits of membership Promote the NCTA “brand” Promote increased member participation in NCTA Facilitate the development of State testing organizations Targeted NCTA Markets • Non-Members in Four-Year Colleges • Non-Members in Two-Year Colleges • Current NCTA members • National Certification Organizations • State Licensing Agencies • Assessment and Testing Related Corporations • Public School District Administrators • International Testing Professionals Initial Committee Activities Aligned the Objectives with the Targeted Markets Developed a List of Actions for Each Market Developed a List of Marketing Resources First: Market the CCTC to On-Line Learning Departments • Acquired a list of all major On-Line Learning Departments in domestic Colleges with contact names and e-mail addresses • Developed marketing-focused correspondence • Acquired a dedicated NCTA marketing e-mail address Immediate Next Steps Complete a comprehensive Marketing Plan Develop a variety of marketing resources Target the “low hanging fruit” next Establish a detailed Action Plan for each target Continue to push ahead ! [email protected] Recruitment Committee Joseph Fenty Committee Chair NCTA Recruitment Committee Joseph Fenty, (Chair) Washtenaw Community College Kay Alford, Coastal Carolina University Regina Beach, Morehead State University Cynthia Bertalott, University of Central Missouri Anastasia Brown, College of the Bahamas BJ Stasek, University of South Florida Linda Trevarthan, Michigan State University Recruitment Committee Activities Develop a State Liaison “Kit” to support founding and growing State Testing Organizations Reach out to non-member community colleges to attract new members (Conducted outreach in MI, FL & SC) Attract GED Test Centers into NCTA as Members (Conducted outreach in MI) Enlisted the help of NCTA State Liaison members to identify non-NCTA members in their States Motivate current collegiate members to actively recruit colleagues as members Recruitment Committee FY11 Objectives Collaborate with the Marketing Committee to develop recruitment tools, identify market segments and coordinate outreach. Collaborate with the State Liason Committee to benefit from the relationship they have established. Develop publications and other recruiting materials. Develop a comprehensive Member Recruitment Plan targeting potential Collegiate, Non-Collegiate and Corporate members Test Center Certification Project Certifying What ? Certify “Test Centers” - - - Not People “Testing Programs” Standards Procedures Resources Policies Facilities Staffing etc. Certifying that . . . ? Certifying that the Test Center meets established Professional Standards . . . “meets” = . . . has in place the facilities, resources, staffing, standards, policies, procedures, etc, as prescribed and published by NCTA Your State Department of Motor Vehicles “certifies” your car is road worthy. It does not certify how well you drive it! NCTA is not certifying how well staff are applying professional standards That would require an “Audit” An audit demands on-site observations and detailed analyses of the program’s performance and management. We are not implementing an Audit Program. YET . . . ? A Future NCTA Test Center Audit Program ? For Certification Program Information: Go to: www.NCTA-Testing.org Click on “About” Click on “Committees” Click on “Reference Documents” Scroll down to: “Certification . . .” http://www.ncta-testing.org/ncta/committees/files/index.php Certification Program Information: 2007-08 and 2008-09 Project Objectives.doc Cert Process Graph.doc Certfication Tasks & Standards.doc Certification-2008 Presentation Outline.doc Current Committee Members.doc Proposed Certification Standards.doc Standards NCTA Self St. 3-Column Criteria June 2003.doc Test Center Certification Presentation 2008 Conf.pps FY10 Test Center Certification http://www.ncta-testing.org/ncta/committees/files/index.php Certification Program Information: MEETING MINUTES Test Center Certification Committee Minutes from Sixty One Meetings from February 2008 to the Present http://www.ncta-testing.org/ncta/committees/files/index.php NCTA Test Center Certification Process Outline Certification Self-Study Certification Application Application Review Application Evaluation Certification Outcome Guide to the Certification Process Descriptive & Objective Data Collected Review for Completeness with “Advisor” Evaluate on NCTA Standards “Pending” Action or Data Still Needed Review and Evaluation Procedures Documents, Samples and Photos Forward Application for Evaluation Interact with Applicant as Needed “Provisional” Minor Change Needed Certification Help-Line Support Use Internal or External Verification Notify Applicant of Status Send to Board with Recommendation Certification “Awarded” http://www.ncta-testing.org/ncta/committees/files/index.php Test Center Certification Program Duane Goupell Committee Chair Test Center Certification Committee Duane Goupell, Chair U of Wisconsin - Oshkosh Vicki Black University of Memphis Kimberly Moody Temple University Steve Saladin University of Idaho Theresa Scott Florida Atlantic University Gayle Veltman Wichita State University Accomplishments for 2009-2010 • Developed Criteria for Evaluation • Developed Application and Other Forms • Developed Review Processes & Procedures • Completed Phase 1 of Pilot and Launched Phases 2 and 3 • Prepared Time-Line & Budget for Project Completion • First NCTA Test Center Certifications Awarded Goals for 2010-2011 Complete Phases 2 and 3 of Pilot Develop Q & A for Website Recruit Volunteers for Certification Review Committee Finalize all Forms, Policies and Procedures Establish Time Lines for Process Submit Final Project Report and Recommendations to Governing Board Launch Certification Program NCTA Certified Test Centers Florida Atlantic University, Boca Raton, FL Michigan State University, East Lansing, MI Washtenaw Community College, Ann Arbor, MI Just Ahead Moving the NCTA Test Center Certification Program from Pilot to Operation Will be Both Challenging and Demanding David Espinoza University of Oregon NCTA President Elect