Transcript Slide 1

CAPE TOWN HEAD OFFICE
Scorecard Development with
Model Builder for Predictive
Analytics (MB4PA)
Postal Address
P.O. Box 2455
Cape Town
8000
South Africa
Tel: +27 (0)21 680-6000
Fax: +27 (0)21 680-6003
JOHANNESBURG OFFICE
Postal Address
P.O. Box 3350
Parklands
2121
South Africa
Tel: +27 (0)11 759-0300
Fax: +27 (0)11 880-0466
Email: www.PICSolutions.com
Web: [email protected]
Presented by: David Coleman
[email protected]
Contents

Scoring Problem Formulation

MB4PA Architecture

KGB Scorecard Development

Example
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Contents

Scoring Problem Formulation

MB4PA Architecture

KGB Scorecard Development

Example
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Scoring Problem Formulation
General Formulation
Non-linear Objective
(Quadratic)
min
f w 
subject to
ci w   0
i E
ci w   0
i I
Equality Constraints
Inequality Constraints
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Scoring Problem Formulation
Scoring Objective Function (Divergence)
  G  w    B  w  2
f w  
# OF
APPLICANTS
1
2

G
w 
2
B
  B w 
2

G
Bads
Goods
B
B
G G
SCORE
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Scoring Problem Formulation
Weight Restrictions
w   w1 , w 2 , w 3 , w 4 
w4
Risk
w1  w 2
w3
w2
w2  w3
w3  w4
w1
18-25
25-30
30-40
40+
Age
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Contents

Scoring Problem Formulation

MB4PA Architecture

KGB Scorecard Development

Example
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
MB4PA Architecture

Fair Isaac product

Java developed component-based

Modelling Tools







Data Access
Data Preparation
Data Analysis
Model Training
Java Customisation
Performance Validation
Deployment
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
MB4PA Architecture

Data Processing






Object Schemas
Dataset Configurations
Libraries
Workspaces
Configurations
Executables



Activities
Processes
Sequences
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
MB4PA Architecture
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Contents

Scoring Problem Formulation

MB4PA Architecture

KGB Scorecard Development

Example
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
KGB Scorecard Development
“Known Good Bad - We’re not ex-Soviet spies”
Source
data with
fielded data
records
Dataset
Config
TOTAL
POPULATION
Data Object
Schema
REJECTED
ACCEPTED
Data Access Sequence
GOOD
BAD
Read Data Process
Dataset
Config
Data Object
Schema
Data with
generated
variables
KGB Model Sequence
Binning Process
Characteristic
Library
Model Training Process
Training
Reports
Model
Workspace
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Contents

Scoring Problem Formulation

MB4PA Architecture

KGB Scorecard Development

Example
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Example

Role


Current Business Environment



Retail Credit Risk Manager
Acceptance Rate 60%
Bad Rate 20%
Objectives


Increase Acceptance Rate / Maintain Bad Rate
Decrease Bad Rate / Maintain Acceptance Rate
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Example
Cumulative Descending
Score Range
Current
Accept 60%
Bad Rate 20%
Accepted
Percent
Odds
Bad Rate
184.00 -< 185.00
21,733
79.45%
3.718
0.212
185.00 -< 186.00
21,345
78.04%
3.761
0.21
186.00 -< 187.00
20,920
76.48%
3.818
0.208
Growth Option
187.00 -< 188.00
20,493
74.92%
3.891
0.204
Accept 73.2%
188.00 -< 189.00
20,032
73.24%
3.967
0.201
Bad Rate ~20%
189.00 -< 190.00
19,569
71.54%
4.038
0.198
190.00 -< 191.00
19,110
69.86%
4.126
0.195
191.00 -< 192.00
18,602
68.01%
4.218
0.192
192.00 -< 193.00
18,118
66.24%
4.299
0.189
193.00 -< 194.00
17,632
64.46%
4.404
0.185
194.00 -< 195.00
17,090
62.48%
4.492
0.182
195.00 -< 196.00
16,513
60.37%
4.619
0.178
Conservative Option
196.00 -< 197.00
16,006
58.52%
4.686
0.176
Accept ~60%
197.00 -< 198.00
15,489
56.63%
4.747
0.174
Bad Rate 17.8%
198.00 -< 199.00
14,948
54.65%
4.862
0.171
199.00 -< 200.00
14,437
52.78%
4.961
0.168
200.00 -< 201.00
13,885
50.76%
5.053
0.165
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Contents

Scoring Problem Formulation

MB4PA Architecture

KGB Scorecard Development

Example
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Websites






Argone National Laboratory, Mathematics and Computer Science Division
www-fp.mcs.anl.gov/otc/Guide/OptWeb/
Ascher, Uri M: Course Notes in Numerical Optimisation
www.cs.ubc.ca/~ascher/542/chap11.pdf
Fair Isaac:
www.fairisaac.com
Gockenbach, Mark S: Introduction to sequential quadratic programming
www.math.mtu.edu/~msgocken/ma5630spring2003/lectures/sqp1/sqp1.pdf
Padula, Anthony: Introduction to sequential quadratic programming
www.caam.rice.edu/~adpadu/talks/sqp1.pdf
PIC Solutions:
www.picsolutions.com
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS
Questions & Answers
JOHANNESBURG OFFICE
CAPE TOWN HEAD OFFICE
Office Address
PIC Solutions
5th Floor, JHI House
11 Cradock Avenue, Rosebank
Johannesburg, 2196
South Africa
Office Address
PIC Solutions
Birkdale I, Riverpark
Liesbeek Parkway, Mowbray
Cape Town, 8000
South Africa
Postal Address
P.O. Box 3350
Parklands
2121
South Africa
Postal Address
P.O. Box 2455
Cape Town
8000
South Africa
Tel: +27 (0)11 759-0300
Fax: +27 (0)11 880-0466
Tel: +27 (0)21 680-6000
Fax: +27 (0)21 680-6003
Email: www.PICSolutions.com
Web: [email protected]
Powered by
© Copyright PIC Solutions 2006
www.PICSolutions.com
SOLUTIONS