Transcript Software Inspection Process

Cost & Benefit Analysis
Executive Overview
David F. Rico
Table of Contents
•
•
•
•
•
•
•
•
Methodology
Breakeven Point Analysis
Actual Costs & Benefits
Normalized Costs & Benefits
Normalized Benefits
Category Costs & Benefits
Summary of Costs & Benefits
Conclusion
2
Methodology
Origin of Cost & Benefit Analysis
• Software Process Improvement (SPI) Study
– Using Cost Benefit Analyses to Develop a
Pluralistic Methodology for Selecting from
Multiple Prescriptive Software Process
Improvement (SPI) Strategies
– David F. Rico (April 30, 1999)
• Full text, graphics, data, spreadsheets, and
algorithms available online
– http://davidfrico.com
4
Analytical Methodology
Cost and Benefit
Model
Costs and Benefits
of Alternative 1
Costs and Benefits
of Alternative 2
Costs and Benefits
of Alternative n
Cost and Benefit
Data
Return-on-Investment
Model
Break Even Point
Model
Defect Removal
Model
5
Defect Removal Model
Inspection Cost
Testing Cost (10X)
Defects
Ad Hoc (100X)
Analysis
Design
Code
Unit
Test
Component
Test
System Test
Customer
Use
6
Return-on-Investment (ROI) Model
PSP
Software Size
Start Defects
Review Efficiency
Review Hours
Review Defects
Review Defects/Hour
Review Hours/Defect
Remaining Defects
Test Efficiency
Test Hours
Test Defects
Test Defects/Hour
Test Hours/Defect
Validation Defects
Released Defects
Maintenance Hours/Defect
Development Hours
Validation Hours
Maintenance Hours
Total Hours
QBreak Even/Ad Hoc
PBreak Even/Ad Hoc
PBreak Even/Test
PBreak Even/Inspection
Slope (Life Cycle Cost)
Y Intercept (w/Investment)
HBreak Even/Ad Hoc
HBreak Even/Test
HBreak Even/Inspection
ROI/Ad Hoc
ROI/Test
ROI/Inspection
sm
10,000
1,000
67%
97
667
6.86
0.15
333
100%
61
333
5.47
0.18
1,000
0
2
242
158
0
400
0.78
6.15
14.59
35.96
25.00
-2000.00
80.25
80.58
81.44
1,290:1
430:1
143:1
AT&T
Basic
BNR
Gilb
HP
Inspection Inspection Inspection Inspection Inspection
Test
Ad Hoc
10,000
1,000
67%
500
667
1.33
0.75
333
67%
1,667
222
0.13
7.50
889
111
75
5,088
2,167
8,333
15,588
6.67
1.65
4.79
10,000
1,000
67%
708
667
0.94
1.06
333
67%
2,361
222
0.09
10.63
889
111
106
5,088
3,069
11,806
19,963
6.67
1.72
5.38
10,000
1,000
67%
960
667
0.69
1.44
333
67%
3,200
222
0.07
14.40
889
111
144
5,088
4,160
16,000
25,248
6.67
1.81
6.33
10,000
1,000
67%
970
667
0.69
1.46
333
67%
3,233
222
0.07
14.55
889
111
146
5,088
4,203
16,167
25,458
6.67
1.81
6.38
10,000
1,000
67%
1,042
667
0.64
1.56
333
67%
3,472
222
0.06
15.63
889
111
156
5,088
4,514
17,361
26,963
6.67
1.84
6.72
10,000
1,000
0%
0
0
0
0
1,000
67%
8,360
667
0.08
12.54
667
333
125
5,088
8,360
41,800
55,248
66.67
10.37
10,000
1,000
0%
0
0
0
0
1,000
0%
0
0
0
0
0
1,000
125
5,088
0
125,400
130,488
0.64
-12.19
21.58
26.47
0.50
-9.52
22.43
29.75
0.40
-7.53
23.56
34.99
0.39
-7.46
23.61
35.24
0.37
-7.05
23.95
37.11
0.18
-14.12
135.27
0.08
234:1
67:1
160:1
42:1
114:1
27:1
113:1
26:1
104:1
23:1
10:1
Personal Software Process and PSP are service marks of Carnegie Mellon University.
7
Rico’s Inspection Cost Model
Hours
2.0
1.5
Inspection
Substage
1.0
Overview
Substage
0.5
Planning
Substage
0.5 * M
+
1.0 * P
Preparation
Substage
+
1.0 * I
Rework
Substage
+
2.0 * P
+
1.0 * C
Followup
Substage
+
0.5 * M
Hours = Product Size / ( Inspection Rate * 2 ) * ( Team Size * 4 + 1)
10,000 Lines
120 SLOC
Per Hour
100,000 Lines
180 SLOC
Per Hour
60 SLOC
Per Hour
120 SLOC
Per Hour
1,000,000 Lines
People
60 SLOC
Per Hour
180 SLOC
Per Hour
60 SLOC
Per Hour
120 SLOC
Per Hour
180 SLOC
Per Hour
4
1,417
708
472
14,167
7,083
4,722
141,667
70,833
47,222
5
1,750
875
583
17,500
8,750
5,833
175,000
87,500
58,333
6
2,083
1,042
694
20,833
10,417
6,944
208,333
104,167
69,444
7
2,417
1,208
806
24,167
12,083
8,056
241,667
120,833
80,556
8
PSP & Inspection Cost Models
Method
Software Cost Model
Author
Source
PSP
SLOC / 25
Rico (1998)
Hays (1997)
Inspection
SLOC / (Rate * 2) * (Team Size * 4 + 1)
Rico (1993)
Russell (1991)
SLOC / (Rate * 2) * 25
Grady (1994)
Hewlett Packard
50 * KSLOC
Barnard (1994)
AT&T
3 * KSLOC * 4 * 8
Russell (1991)
Bell Northern
SLOC / (Rate * 2) * (5.76 * Team Size)
Gilb (1993)
Fagan (1976)
9
Software Cost Models
Software Cost Model
Author
Source
Form
Output
SLOC / 25
Rico (1998)
Hays (1997)
Linear
Hours
3 * KSLOC ^ 1.12
McGibbon (1997)
Boehm
Log-Linear
Months
5.2 * KSLOC ^ 0.91
McGibbon (1997)
Walston/Felix
Log-Linear
Months
5.5 + 0.73 * KSLOC ^ 1.15
McGibbon (1997)
Bailey/Basili
Log-Linear
Months
5.288 * KSLOC ^ 1.047
McGibbon (1997)
Doty
Log-Linear
Months
10
Rico’s Breakeven Point Model
SP
IM
eth
od
Software Productivity
Break Even Point = Investment / Productivity Difference * Productivity Product
Investment
ethod
SPI M
Break Even Point
Software Effort
11
Breakeven Point Analysis
Breakeven Point Models
Method
Life Cycle Cost *
Life Cycle Cost **
Ad Hoc
SLOC / 0.08
Test
SLOC / 0.18
(SLOC + 14.12) / 0.18
HP Inspection
SLOC / 0.37
(SLOC + 07.05) / 0.37
Gilb Inspection
SLOC / 0.39
(SLOC + 07.46) / 0.39
BNR Inspection
SLOC / 0.40
(SLOC + 07.53) / 0.40
Basic Inspection
SLOC / 0.50
(SLOC + 09.52) / 0.50
AT&T Inspection
SLOC / 0.64
(SLOC + 12.19) / 0.64
PSP
SLOC / 25.0
(SLOC + 2000) / 25.0
* Yields effort in hours
** Yields effort in hours (includes initial investment effort)
13
Source Lines of Code (SLOC)
Test vs. Ad Hoc
10.80
10.60
10.40
Test
Ad Hoc
10.20
10.00
9.80
9.60
9.40
9.20
Effort = 135.27
SLOC =
10.37
9.00
8.80
8.60
130
131
132
133
134
135
136
137
Effort in Hours
14
Inspection vs. Ad Hoc
Source Lines of Code (SLOC)
3.00
Inspection
2.50
Ad Hoc
2.00
1.50
1.00
Effort =
23.02
SLOC =
1.85
0.50
0.00
22
23
24
25
Effort in Hours
15
PSP vs. Ad Hoc
Source Lines of Code (SLOC)
30.00
PSP
25.00
Ad Hoc
20.00
15.00
Effort =
80.25
SLOC =
6.15
10.00
5.00
0.00
80
81
Effort in Hours
16
Inspection vs. Test
Source Lines of Code (SLOC)
7.00
6.00
5.00
4.00
Effort =
32.71
SLOC =
5.92
3.00
Inspection
Test
2.00
1.00
0.00
31
32
33
34
Effort in Hours
17
PSP vs. Test
Source Lines of Code (SLOC)
30.00
25.00
PSP
Test
20.00
15.00
10.00
5.00
Effort =
80.58
SLOC =
14.59
0.00
80
81
Effort in Hours
18
PSP vs. Inspection
Source Lines of Code (SLOC)
60.00
PSP
50.00
Inspection
40.00
30.00
20.00
Effort =
81.44
SLOC =
35.96
10.00
0.00
80
81
82
Effort in Hours
19
Actual Costs & Benefits
Overall
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
Average
80
80
$7,456
400
164.03x
109.49x
253.62x
1,290:1
53
201
$8,089
3,245
3.53x
4.27x
42.22x
27:1
8,320
3,316
$298,440
16,212
3.69x
2.70x
4.33x
3:1
527
31
$5,467
2,100
1.69x
1.88x
4.77x
75:1
7
19
$1,794
836
5.47x
5.47x
9.00x
133:1
3,517
78
$13,863
37,510
6.15x
6.15x
5.75x
9:1
10,021
227
$12,668
94,417
2.99x
2.92x
4.55x
6:1
4,973
64
$9,475
53,800
1.14x
1.13x
12.44x
4:1
3,437
502
$44,656
26,065
23.58x
16.75x
42.09x
193:1
® Capability Maturity Model and CMM are registered in the U.S. Patent and Trademark Office.
21
Personal Software Process (PSP)
Rico
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
CMU
AIS
Motorola
Webb
Hays
SEI
80.25
80
$13,917
$995
400
326.22x
326.22x
1,000.00x
1,290:1
1.85x
1.07x
4.47x
1.19x
1.62x
8.40x
Average
80.25
80
$7,456
400
164.03x
109.49x
253.62x
1,290:1
22
Clean Room Methodology
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
McGibbon
Kaplan
42
318
$12,398
3,245
3.53x
3.53x
100.00x
33:1
64
84
$3,780
Prowell
CSR
5.00x
10.00x
16.67x
20:1
Average
53
201
$8,089
3,245
3.53x
4.27x
42.22x
27:1
23
Software Reuse
McGibbon
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
NEC
Lim
Raytheon
DEC
Reifer
22,115
6.70x
2.80x
4:1
3.33x
1.84x
5.49x
5.00x
2.00x
10.00x
HP
HP
Average
4,160
450
$40,500
9,360
1.71x
1.57x
2.05x
4:1
12,480
6,182
$556,380
17,160
4.70x
1.40x
1.31x
2:1
8,320
3,316
$298,440
16,212
3.69x
2.70x
4.33x
3:1
24
Software Defect Prevention
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Kaplan
Gilb
Mays
1,560
12
$900
4,680
10
11
1,625
2.00x
7:1
1,747
2.00x
2.00x
2.17x
Humphrey
Grady
Kajihara
Latino
Latino
40
$7,500
40
$8,000
347
7.00x
40:1
3.67x
179:1
1.37x
4.55x
4.00x
1.76x
10.00x
Average
527
31
$5,467
2,100
1.69x
1.88x
4.77x
75:1
25
Software Inspection Process
McGibbon
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
12
$468
1.55x
1.55x
72:1
Fagan
AT&T
Rico
BNR
Gilb
HP
Average
7
7
7
7
500
8.37x
8.37x
9.00x
234:1
708
6.54x
6.54x
9.00x
160:1
960
5.17x
5.17x
9.00x
114:1
7
20
$2,114
970
5.13x
5.13x
9.00x
113:1
7
19
$1,794
836
5.47x
5.47x
9.00x
133:1
24
$2,800
6.67x
6.67x
1,042
4.84x
4.84x
9.00x
104:1
26
Software Testing
ROI Model
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Farren
Rice
Yamaura
Graham
135
84
$16,800
8,360
2.36x
2.36x
3.00x
10:1
5.00x
5.00x
2.00x
5:1
Ehrlick
Asada
Average
5,400
5,017
54,000
10.00x
10.00x
9.00x
10:1
50,170
10.00x
10.00x
9.00x
10:1
3,517
78
$13,863
37,510
6.15x
6.15x
5.75x
9:1
72
$10,926
3.37x
3.37x
27
Capability Maturity Model (CMM)
Herbsleb
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Years to SEI Level 3
2,318
64
$9,820
23,184
1.85x
2.89x
3.21x
5:1
3.50
Putnam
Haskell
Vu
Diaz
345
1,092
3,450
10,920
2.70x
0.80x
2.17x
4:1
3.00
7.46x
7.46x
8.25x
1.75x
2.22x
5.00x
7.00
5.00
Haley
2.90x
2.90x
3.00x
8:1
7.00
Jones
Average
36,330
389
$15,516
363,298
1.26x
1.26x
5.68x
10,021
227
$12,668
94,417
2.99x
2.92x
4.55x
6:1
4.84
3.56
28
ISO 9000
Roberson
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Years to ISO 9001
Hewlett
Armstrong
Russo
4,160
88
$8,775
Kaplan
Haskell
10,400
360
80
$7,000
3,600
24
$12,650
104,000
1.14x
1.14x
1.22x
1.11x
1.11x
Garver
El Emam
Average
2.14
4,973
64
$9,475
53,800
1.14x
1.13x
12.44x
4:1
1.57
35.00x
1:1
7:1
1.00
29
Normalized Costs & Benefits
Normalized Costs & Benefits
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
Average
9.97
9.80
9.79
9.98
8.69
8.17
7.53
8.34
72.28
9.98
9.50
9.77
9.84
0.19
0.32
1.25
0.17
41.03
6.97
1.74
1.65
9.22
0.20
0.20
0.13
0.02
20.13
9.81
9.92
9.85
9.90
0.09
0.14
0.14
0.49
40.34
10.00
9.95
9.95
9.96
0.29
0.41
0.27
0.86
41.68
8.72
9.81
9.61
8.20
0.33
0.46
0.17
0.06
37.35
6.36
9.44
9.65
5.47
0.16
0.22
0.14
0.04
31.46
8.19
9.84
9.73
7.42
0.06
0.08
0.37
0.03
35.73
8.75
8.75
8.75
8.75
1.25
1.25
1.25
1.25
31
Normalized Costs & Benefits
12.00
Normalized/Unweighted Scores
10.00
Breakeven Hours
8.00
Training Hours/Person
Training Cost/Person
6.00
Effort (Hours)
Cycle Time Reduction
4.00
Productivity Increase
Quality Increase
Return-on-Investment
2.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
32
Breakeven Hours (Normalized/Unweighted)
Breakeven Hours
12.00
10.00
8.00
6.00
4.00
2.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
33
Training Hours/Person
12.00
Trainiing Hours/Person
(Normalized/Unweighted)
10.00
8.00
6.00
4.00
2.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
34
Training Cost/Person
12.00
Training Cost/Person
(Normalized/Unweighted)
10.00
8.00
6.00
4.00
2.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
35
Effort (Hours)
Effort (Hours) (Normalized/
Unweighted)
12.00
10.00
8.00
6.00
4.00
2.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
36
Cycle Time Reduction
10.00
Cycle Time Reduction
(Normalized/Unweighted)
9.00
8.00
7.00
6.00
5.00
4.00
3.00
2.00
1.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
37
Productivity Increase
9.00
Productivity Increase
(Normalized/Unweighted)
8.00
7.00
6.00
5.00
4.00
3.00
2.00
1.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
38
Quality Increase
Quality Increase (Normalized/Unweighted)
8.00
7.00
6.00
5.00
4.00
3.00
2.00
1.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
39
Return-on-Investment (ROI)
9.00
Return-on-Investment
(Normalized/Unweighted)
8.00
7.00
6.00
5.00
4.00
3.00
2.00
1.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
40
Normalized Benefits
Normalized Benefits
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
Average
8.69
8.17
7.53
8.34
32.74
0.19
0.32
1.25
0.17
1.93
0.20
0.20
0.13
0.02
0.55
0.09
0.14
0.14
0.49
0.86
0.29
0.41
0.27
0.86
1.82
0.33
0.46
0.17
0.06
1.01
0.16
0.22
0.14
0.04
0.55
0.06
0.08
0.37
0.03
0.54
1.25
1.25
1.25
1.25
42
Normalized Benefits
10.00
Cycle Time Reduction
Normalized/Unweighted Scores
9.00
Productivity Increase
8.00
Quality Increase
7.00
Return-on-Investment
6.00
5.00
4.00
3.00
2.00
1.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
43
Average Benefits
Cumulative/Normalized/Unweighted Scores
35.00
30.00
25.00
20.00
15.00
10.00
5.00
0.00
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
44
Worst Normalized Benefits
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Cleanroom
Reuse
Prevent
Inspect
Test
CMM
ISO
Average
1.43
1.74
5.08
1.03
9.29
1.50
1.10
0.52
0.13
3.25
0.68
0.77
0.57
2.94
4.97
2.22
2.23
1.08
5.18
10.71
2.49
2.51
0.69
0.34
6.04
1.21
1.19
0.55
0.22
3.17
0.46
0.46
1.50
0.15
2.57
1.43
1.25
1.25
1.25
45
Worst Normalized Benefits
6.00
Normalized/Unweighted Scores
Cycle Time Reduction
5.00
Productivity Increase
Quality Increase
4.00
Return-on-Investment
3.00
2.00
1.00
0.00
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
46
Cumulative/Normalized/Unweighted Scores
Worst Average Benefits
12.00
10.00
8.00
6.00
4.00
2.00
0.00
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
47
Poorest Normalized Benefits
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Reuse
Prevent
Test
CMM
ISO
Average
2.36
1.83
1.36
0.34
5.88
1.08
1.27
1.50
7.78
11.62
3.93
4.16
1.81
0.90
10.80
1.91
1.98
1.43
0.58
5.90
0.73
0.76
3.91
0.40
5.80
2.00
2.00
2.00
2.00
48
Poorest Normalized Benefits
9.00
Normalized/Unweighted Scores
8.00
7.00
6.00
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
5.00
4.00
3.00
2.00
1.00
0.00
Reuse
Prevent
Test
CMM
ISO
49
Poorest Average Benefits
Cumulative/Normalized/Unweighted Scores
14.00
12.00
10.00
8.00
6.00
4.00
2.00
0.00
Reuse
Prevent
Test
CM M
ISO
50
Category Costs & Benefits
Actual Costs & Benefits
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Vertical Life
Cycle
Vertical
Process
Indefinite
2,818
1,199
$104,662
6,619
57.08x
38.82x
100.06x
440:1
1,350
42
$7,041
13,482
4.43x
4.50x
6.51x
72:1
7,497
145
$11,072
74,108
2.06x
2.02x
8.50x
5:1
52
Normalized Costs & Benefits
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Vertical Life
Cycle
Vertical
Process
Indefinite
7.58
1.35
1.48
9.30
8.98
8.56
8.70
8.51
54.46
8.84
9.69
9.43
8.57
0.70
0.99
0.57
1.40
40.18
3.57
8.95
9.10
2.13
0.32
0.45
0.74
0.09
25.36
53
Normalized Costs & Benefits
12.00
Normalized/Unweighted Scores
10.00
Breakeven Hours
Training Hours/Person
8.00
Training Cost/Person
Effort (Hours)
6.00
Cycle Time Reduction
Productivity Increase
4.00
Quality Increase
Return-on-Investment
2.00
0.00
Vertical Life Cycle
Vertical Process
Indefinite
54
Average Costs & Benefits
Cumulative/Normalized/Unweighted Scores
60.00
50.00
40.00
30.00
20.00
10.00
0.00
Vertical Life Cycle
Vertical Process
Indefinite
55
Normalized Benefits
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Vertical Life
Cycle
Vertical
Process
Indefinite
8.98
8.56
8.70
8.51
34.75
0.70
0.99
0.57
1.40
3.65
0.32
0.45
0.74
0.09
1.60
56
Normalized Benefits
Normalized/Unweighted Scores
10.00
9.00
Cycle Time Reduction
8.00
Productivity Increase
Quality Increase
7.00
Return-on-Investment
6.00
5.00
4.00
3.00
2.00
1.00
0.00
Vertical Life Cycle
Vertical Process
Indefinite
57
Average Benefits
Cumulative/Normalized/Unweighted Scores
40.00
35.00
30.00
25.00
20.00
15.00
10.00
5.00
0.00
Vertical Life Cycle
Vertical P rocess
Indefinite
58
Worst Normalized Benefits
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Vertical
Process
Indefinite
6.82
6.90
4.34
9.38
27.44
3.18
3.10
5.66
0.62
12.56
59
Worst Normalized Benefits
10.00
Cycle Time Reduction
Normalized/Unweighted Scores
9.00
Productivity Increase
8.00
Quality Increase
7.00
Return-on-Investment
6.00
5.00
4.00
3.00
2.00
1.00
0.00
Vertical Process
Indefinite
60
Worst Average Benefits
Cumulative/Normalized/Unweighted Scores
30.00
25.00
20.00
15.00
10.00
5.00
0.00
Vertical Process
Indefinite
61
Summary of Costs & Benefits
Summary of Alternatives
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
PSP
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
Good
Good
Good
Good
Good
Good
Good
Good
Good
Good
Good
Good
Poor
Poor
Poor
Poor
Good
Poor
Poor
Good
Poor
Poor
Poor
Poor
Good
Good
Good
Good
Poor
Poor
Poor
Poor
Good
Good
Good
Good
Poor
Poor
Poor
Poor
Good
Good
Good
Good
Poor
Poor
Poor
Poor
Average
Good
Good
Average
Poor
Poor
Poor
Poor
Good
Good
Good
Good
Poor
Poor
Poor
Poor
63
Summary of Worst Alternatives
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Cleanroom
Reuse
Prevent
Inspect
Test
CM M
ISO
Poor
Average
Good
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Average
Average
Average
Poor
Good
Average
Average
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Poor
64
Summary of Poorest Alternatives
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Reuse
Prevent
Test
CM M
ISO
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Good
Average
Average
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Poor
Average
Poor
65
Summary of Categories
Breakeven Hours
Training Hours/Person
Training Cost/Person
Effort (Hours)
Cycle Time Reduction
Productivity Increase
Quality Increase
Return-on-Investment
Vertical
Life Cycle
Vertical
Process
Indefinite
Good
Average
Average
Good
Good
Good
Good
Good
Good
Good
Good
Good
Poor
Poor
Average
Average
Poor
Good
Good
Poor
Poor
Poor
Average
Average
66
Conclusion
PSP Surpasses Competition
• PSP exhibits astonishing benefits
–
–
–
–
–
82:1 cycle time reduction over CMM and ISO 9000
55:1 productivity increase over CMM and ISO 9000
30:1 quality increase over CMM and ISO 9000
258:1 return on investment over CMM and ISO 9000
1,290:1 return on investment over ordinary approaches
• CMM and ISO 9000 among worst software
process improvement (SPI) approaches
• CMMi and ISO 9000-2000 may perform worse
than the Software CMM v1.1 or ISO 9000-1995
68