Transcript Slide 1
CAPE TOWN HEAD OFFICE Scorecard Development with Model Builder for Predictive Analytics (MB4PA) Postal Address P.O. Box 2455 Cape Town 8000 South Africa Tel: +27 (0)21 680-6000 Fax: +27 (0)21 680-6003 JOHANNESBURG OFFICE Postal Address P.O. Box 3350 Parklands 2121 South Africa Tel: +27 (0)11 759-0300 Fax: +27 (0)11 880-0466 Email: www.PICSolutions.com Web: [email protected] Presented by: David Coleman [email protected] Contents Scoring Problem Formulation MB4PA Architecture KGB Scorecard Development Example Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Contents Scoring Problem Formulation MB4PA Architecture KGB Scorecard Development Example Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Scoring Problem Formulation General Formulation Non-linear Objective (Quadratic) min f w subject to ci w 0 i E ci w 0 i I Equality Constraints Inequality Constraints Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Scoring Problem Formulation Scoring Objective Function (Divergence) G w B w 2 f w # OF APPLICANTS 1 2 G w 2 B B w 2 G Bads Goods B B G G SCORE Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Scoring Problem Formulation Weight Restrictions w w1 , w 2 , w 3 , w 4 w4 Risk w1 w 2 w3 w2 w2 w3 w3 w4 w1 18-25 25-30 30-40 40+ Age Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Contents Scoring Problem Formulation MB4PA Architecture KGB Scorecard Development Example Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS MB4PA Architecture Fair Isaac product Java developed component-based Modelling Tools Data Access Data Preparation Data Analysis Model Training Java Customisation Performance Validation Deployment Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS MB4PA Architecture Data Processing Object Schemas Dataset Configurations Libraries Workspaces Configurations Executables Activities Processes Sequences Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS MB4PA Architecture Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Contents Scoring Problem Formulation MB4PA Architecture KGB Scorecard Development Example Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS KGB Scorecard Development “Known Good Bad - We’re not ex-Soviet spies” Source data with fielded data records Dataset Config TOTAL POPULATION Data Object Schema REJECTED ACCEPTED Data Access Sequence GOOD BAD Read Data Process Dataset Config Data Object Schema Data with generated variables KGB Model Sequence Binning Process Characteristic Library Model Training Process Training Reports Model Workspace Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Contents Scoring Problem Formulation MB4PA Architecture KGB Scorecard Development Example Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Example Role Current Business Environment Retail Credit Risk Manager Acceptance Rate 60% Bad Rate 20% Objectives Increase Acceptance Rate / Maintain Bad Rate Decrease Bad Rate / Maintain Acceptance Rate Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Example Cumulative Descending Score Range Current Accept 60% Bad Rate 20% Accepted Percent Odds Bad Rate 184.00 -< 185.00 21,733 79.45% 3.718 0.212 185.00 -< 186.00 21,345 78.04% 3.761 0.21 186.00 -< 187.00 20,920 76.48% 3.818 0.208 Growth Option 187.00 -< 188.00 20,493 74.92% 3.891 0.204 Accept 73.2% 188.00 -< 189.00 20,032 73.24% 3.967 0.201 Bad Rate ~20% 189.00 -< 190.00 19,569 71.54% 4.038 0.198 190.00 -< 191.00 19,110 69.86% 4.126 0.195 191.00 -< 192.00 18,602 68.01% 4.218 0.192 192.00 -< 193.00 18,118 66.24% 4.299 0.189 193.00 -< 194.00 17,632 64.46% 4.404 0.185 194.00 -< 195.00 17,090 62.48% 4.492 0.182 195.00 -< 196.00 16,513 60.37% 4.619 0.178 Conservative Option 196.00 -< 197.00 16,006 58.52% 4.686 0.176 Accept ~60% 197.00 -< 198.00 15,489 56.63% 4.747 0.174 Bad Rate 17.8% 198.00 -< 199.00 14,948 54.65% 4.862 0.171 199.00 -< 200.00 14,437 52.78% 4.961 0.168 200.00 -< 201.00 13,885 50.76% 5.053 0.165 Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Contents Scoring Problem Formulation MB4PA Architecture KGB Scorecard Development Example Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Websites Argone National Laboratory, Mathematics and Computer Science Division www-fp.mcs.anl.gov/otc/Guide/OptWeb/ Ascher, Uri M: Course Notes in Numerical Optimisation www.cs.ubc.ca/~ascher/542/chap11.pdf Fair Isaac: www.fairisaac.com Gockenbach, Mark S: Introduction to sequential quadratic programming www.math.mtu.edu/~msgocken/ma5630spring2003/lectures/sqp1/sqp1.pdf Padula, Anthony: Introduction to sequential quadratic programming www.caam.rice.edu/~adpadu/talks/sqp1.pdf PIC Solutions: www.picsolutions.com Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS Questions & Answers JOHANNESBURG OFFICE CAPE TOWN HEAD OFFICE Office Address PIC Solutions 5th Floor, JHI House 11 Cradock Avenue, Rosebank Johannesburg, 2196 South Africa Office Address PIC Solutions Birkdale I, Riverpark Liesbeek Parkway, Mowbray Cape Town, 8000 South Africa Postal Address P.O. Box 3350 Parklands 2121 South Africa Postal Address P.O. Box 2455 Cape Town 8000 South Africa Tel: +27 (0)11 759-0300 Fax: +27 (0)11 880-0466 Tel: +27 (0)21 680-6000 Fax: +27 (0)21 680-6003 Email: www.PICSolutions.com Web: [email protected] Powered by © Copyright PIC Solutions 2006 www.PICSolutions.com SOLUTIONS