Transcript Document
AMP Real Estate Broker Simulation Examination Derivation of Test Specifications Jeffrey A. Kelley, PhD Applied Measurement Professionals Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Simulation Overview • Simulations help assess skills based on realistic real estate issues • The intent is to test job-related aspects of real estate that cannot be tested with multiple-choice items Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Simulation Overview • Problems follow a transaction from start to finish (path) • Scenario • Information gathering • Decision making Scenari o IG DM DM DM DM IG DM & Close DM Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Simulation Scoring • Facilitative options may receive scores of +3, +2, or +1 • Uninformative, wasteful, or unnecessarily invasive or inappropriate options may receive scores of –1, –2, or –3 Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona The Simulation Experience… Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Job Analysis Survey • Sent to a sample of 12,337 real estate professionals – Received responses from 776 brokers and 427 salespersons • 166 real estate job tasks and 16 real estate major issues rated for significance – Task ratings used to develop multiple choice examinations – Issue ratings used to develop the simulation examination specifications Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona How significant are the following issues to your real estate practice? (use the following scale) 0 = Not performed 1 = Not significant 2 = Somewhat significant 3 = Quite significant 4 = Extremely significant Advertising Asset Management (commercial brokerage) Document Preparation Federal Laws/ Environmental Issues Agency/Non-Agency Relationships Disclosures (including stigmatized property) Ethics Finance Marketing of Services Property Management Risk Management Negotiation Property Representations Training/Supervision of Licensees Trust Accounts Valuation Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Inclusion Criteria • Issues with a mean significance rating below 2.15 were removed from consideration – asset management – property management Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Primary v. Secondary Issues • Each problem is classified by one primary issue • Each section within the problem is classified by a secondary issue, which may or may not be the same as the primary Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona National Broker Simulation Test Specifications – Effective 2006 Eight Scored Simulation Problems (+ 2 pretest problems) One issue is designated as the primary issue for the problem; one property type is also designated. Problems will address several issues, up to one issue for each section in the problem. Within the eight problems all 15 issues must be addressed at least once. Ethics must be addressed in at least four problems. The five bolded issues must be the primary issue for at least one problem per examination. The distribution by property types is as follows: Residential (3), Commercial (2), Property management (1), unspecified (2). Ethics Negotiation Document Preparation Fair Housing Environmental Issues Representation of Services Valuation Advertising Finance Agency/Non Agency Relationships Disclosures (including stigmatized property) Property Representations Trust Accounts Training/Supervision of Licensees Risk Management Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Modifications • Federal Laws/Environmental Issues split into separate issues – Federal Laws renamed as Fair Housing • The Advisory Board felt that Fair Housing was the pertinent legal issue and wanted to limit the scope • Environmental Issues were felt to be clearly distinct from Fair Housing, and warranted a separate issue – Marketing of Services renamed as Representation of Services Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Designation of Required Primary Issues • The consensus opinion of the advisory board was that most license law violations were related to these five issues Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Property Types Dimension • The Advisory Board wanted to ensure representation for all property types that licensees are allowed to deal in Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Next Steps • Pilot testing beginning in October • Implementation in Spring 2006 Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona Speaker Contact Information Jeff Kelley Applied Measurement Professionals 8310 Nieman Rd, Lenexa, KS 66214 Phone (913) 541-0400 Fax (913) 541-0156 [email protected] www.goamp.com Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona