Transcript The State of the BSMIS Program

IS 553
Advanced Systems
Development Practices
James Nowotarski
11 May 2004
Course Map
Week
1
2
3
4
5
6
7
8
9
10
11
Underpinnings
. Introduction
. Essentials
Content
. Rational Unified Process
. Agile
Implementation
. Metrics
. CMM
. Distributed development
. Tools & training
Briefings (Term Papers)
Assignments
Quizzes
2
(RUP)
(Agile) (CMM) (Distr. Dev.)
Today’s Objectives

Understand Capability Maturity Model
Objectives
 Components
 Relationship to Other Frameworks
 Results to Date
 Latest Thinking

3
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
4
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
5
What is CMM
Overview




CMM = Capability Maturity Model
Developed in1991 by Software Engineering
Institute (SEI) to assess the software
engineering capability of government
contractors
A framework for software process
improvement (SPI) that has gained wide
acceptance in the industry
A roadmap of effective practices that build
on one another in a logical progression


coherent
ordered set of incremental improvements
6
What is CMM
Benefits
Practical
 Structured
 Proven
 Reputation
 Quantitative benefits:

productivity:
 time to market:
 post-release defects:
 business value ratio:

9-67%
15-23%
10-94%
4.0-8.8:1
7
What is CMM
Overview

Different capability maturity models
Software CMM (SW-CMM)
 People CMM
 Systems Engineering CMM
 Software Acquisition CMM
 Integrated Product Development CMM
 Team Software Process
 Personal Software Process

8
What is SEI
Overview

SEI = Software Engineering Institute






Federally funded research & development
center
Sponsored by Department of Defense
Affiliated with Carnegie Mellon University in
Pittsburgh
Established in 1984
Research and publications oriented
Mission is to improve the state of the
practice of software engineering
9
CMM Levels
Optimized
(5)
Managed
(4)
Defined
(3)
Repeatable
(2)
Initial
(1)
10
Key process areas (KPAs)
Maturity levels
Indicate
Contain
Process capability
Key process areas
Achieve
Goals
Contain
Key practices
11
Key process areas (KPAs)

Key Process Areas


Identify the issues that must be addressed to
achieve a maturity level
Key Practice

Activities and infrastructure that contribute the
most to the effective implementation of the KPA
12
Key process areas (KPAs)
Maturity level
Level 2: Repeatable
Key Process Area
Process capability
Disciplined process
Software project
planning
Key Practice
Goal
A plan is developed that
appropriately and realistically covers
the software activities and commitments
Estimates for the size
of software products are
derived according
to a documented
procedure
13
CMM Appraisal Method
Team
Selection
Maturity
Questionnaire
Response
Analysis
3
2
1
KPA
Profile
On-site visit
Interviews &
document
reviews
4
Findings
based on the
CMM
5
6
14
Appraisal Methods

Software Process Assessments (SPA)




Performed in open, collaborative
environment
Focuses on improving the organization’s
software process
Now called CMM-Based Appraisal for
Internal Process Improvement (CBA-IPI)
Software Capability Evaluations (SCE)



Performed in a more audit-oriented
environment
Focuses on identifying risks associated with
a contractor
Team’s recommendation will help select
contractors or set fees
15
Level 1: Initial




Instability
Dependence on “heroes”
Inability to meet targets
Key process areas:

none
16
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
17
Class Activity

Summarize and explain to the rest of the class:


Maturity levels 2-5
The 18 key process areas
18
Level 2: Repeatable

19
Level 3: Defined

20
Level 4: Managed

21
Level 5: Optimizing

22
As maturity increases



Less prone to miss targets
Less variation around the target goals
Better, faster, cheaper development
23
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
24
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
25
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
26
CMM Issues in the Real-World
“Level envy”
 Areas not addressed

Business strategy and linkage to IT
 Operations, help desk, support
 Management of the IT human
resource
 Application portfolio
 Tools


Many question whether it is worth the
effort to pursue levels 4 and 5
27
CMM Maturity Profile
1998 thru August 2002
100%
90%
% of Organizations
80%
70%
60%
43.2%
50%
40%
23.4%
30%
19.3%
20%
7.3%
6.8%
10%
0%
Initial
Repeatable
Defined
Managed
Based on assessments from 1998-2002 of 1124 organizations
Optimized
28
CMM Maturity Profile
April 2002 – October 2003
100%
90%
% of Organizations
80%
70%
60%
50%
33.3%
40%
26.4%
23.0%
30%
20%
11.5%
5.7%
10%
0%
Initial
Repeatable
Defined
Managed
Optimized
Based on assessments from 2002-3 of 87 organizations
29
USA and Offshore Profiles
1998 thru August 2002
100%
90%
% of Organizations
80%
70%
60%
50%
47.4%
37.6%
40%
25.3%
30%
20%
23.3%
22.0%
14.0%
13.2%
10.0%
10%
5.3%
2.0%
0%
Initial
Repeatable
Defined
USA
Managed
Optimized
Offshore
30
Based on 645 U.S. organizations and 479 offshore organizations
USA and Offshore Profiles
April 2002 – October 2003
100%
90%
% of Organizations
80%
70%
54.5%
60%
50%
40%
29.6%
27.8%
30%
14.8%
20%
10%
21.2%
20.4%
15.2%
7.4%
6.1%
3.0%
0%
Initial
Repeatable
Defined
USA
Managed
Optimized
Offshore
31
Based on 33 U.S. organizations and 54 offshore organizations
Time to Move Up
# of months
to move to
next level
75
50
Largest observed value that
is not an outlier
28
Recommended time
between appraisals
(18-30 mos)
23
25
75th percentile
22
17
Median (50th percentile)
25th percentile
Smallest observed value that
is not an outlier
0
1 to 2
2 to 3
3 to 4
4 to 5
32
CMM Market Pressure
As of late 2002, approximately 50 of the 70 or so
publicly-acknowledged Level 5 CMM-certified
organizations were in India


Marketing tool to win clients, who are based
predominantly in US and Europe
Clients using Indian service providers should
have certain key processes in place:




service level agreements
identifying business requirements
scoping requirements
managing changes
33
CMM-based Software Process
Improvement (SPI)

Time and cost often exceed expectations





Difficult KPAs


18-24 months to advance 1 level
Can cost $2K per software engineer per year
1-2% full-time resources (e.g., 5-10 in a 500-person
organization)
2-4% of rest of organization’s time
Planning and tracking
Key success factors





Senior management is engaged
Participation and buy-in at all levels, including middle
management and technical staff
Clearly stated, well understood SPI goals
Clear assignment of responsibility
SEPG staffed by highly respected people
34
Software Process Improvement
Models
A number of models enable software development
organizations to compare their practices to a set of
“best practices”
IT specific models



ISO 15504
ISO 9000-3
TickIT
General models
• Total Quality Management (TQM)
• Six Sigma
35
Software Process Improvement
Models
ISO 15504



International collaborative effort (including SEI)
Sparked by an investigative study sponsored by
the U.K. Ministry of Defense (MOD)
Objective: To develop a standard in the area of
software process assessment


establish a common framework for expressing the
process capability ratings resulting from a 15504conformant assessment
provide a migration path for existing assessment
models and methods wishing to become 15504conformant
36
Software Process Improvement
Models

The Integrated CMM (CMMI) has emerged as the latest thinking
from SEI
Over time, proliferation of CMMs:








Capability Maturity Model for Software (SW-CMM®)
Systems Engineering Capability Model (SECM) (may or may not include
software)
Integrated Product Development Capability Maturity Model (IPD-CMM)
Software acquisition
Many organizations wish to integrate improvement efforts
across disciplines
Differences among these multiple models made integration
difficult
SEI developed common framework to support integration of
current and future discipline-specific maturity models
The common framework is called the Integrated CMM
(CMMI)

“Each CMMI model is designed to be used in concert with other CMMI models,
making it easier for organizations to pursue enterprise-wide process
improvement at their own pace”
37
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
38
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper - Open
30 minutes
39
CMMI
CMMI integrates process improvement models for
product and service development and maintenance



Incorporates and extends:
 Capability Maturity Model for Software (SWCMM®)
 Systems Engineering Capability Model (SECM)
 Integrated Product Development Capability
Maturity Model (IPD-CMM)
 Supplier sourcing
CMMI-SW model released August 2002
SW-CMM® now sunsetted
40
CMMI

What’s different about CMMI-SW:







New process areas
Modern best practices added
Generic goal added to each process area
Continuous and staged representations
Stronger linkage to business objectives and customer
needs
Greater alignment with relevant ISO standards
Standard CMMI Appraisal Method for Process
Improvement (SCAMPISM) V1.1 as a replacement for
CMM-Based Appraisal for Internal Process
Improvement (CBA IPI) and Software Capability
Evaluation (SCESM)
41
CMMI

What’s different about CMMI-SW (cont.)
 Still outside scope of CMMI:
• People CMM (P-CMM)
• Software Acquisition CMM (SA-CMM)

New names for maturity levels
42
CMMI

New names for maturity levels:
Level
Old
New
1
Initial
Initial
2
Repeatable
Managed
3
Defined
Defined
4
Managed
Quantitatively Managed
5
Optimizing
Optimizing
43
SW-CMM v1.1 vs. CMMI Process Areas
Level 5
Optimized
Defect Prevention
Technology Change Management
Process Change Management
Causal Analysis & Resolution
Organizational Innovation & Deployment
Level 4
Managed
Quantitative Process Management
Software Quality Management
Organizational Process Performance
Quantitative Project Management
Organization Process Focus
Organization Process Definition
Training Program
Integrated Software Management
Organization Process Focus
Organization Process Definition
Organizational Training
Integrated Project Management
Risk Management
Requirements Development
Technical Solution
Product Integration
Verification
Validation
Decision Analysis & Resolution
Requirements Management
Project Planning
Project Monitoring & Control
Supplier Agreement Management
Product & Process Quality Assurance
44
Configuration Management
Measurement & Analysis
Level 3
Defined
Software Product Engineering
Intergroup Coordination
Peer Reviews
Level 2
Repeatable
Requirements Management
Software Project Planning
Software Project Tracking & Oversight
Software Subcontractor Management
Software Quality Assurance
Software Configuration Management
For more information
CMM

http://www.sei.cmu.edu/cmm/cmm.articles.
html
CMMI

http://www.sei.cmu.edu/publications/docu
ments/02.reports/02tr029.html (600+ page
pdf)
45
Today’s Agenda
Topic
Duration

CMM Overview
30 minutes

CMM Activity
30 minutes
*** Break
15 minutes

Current Event Reports
20 minutes

CMM Overview (cont.)
20 minutes

CMM Jeopardy
40 minutes

CMMI
10 minutes

Term Paper – Open
30 minutes
46
Term Paper Topics
Scrum (3)
Offshore/Outsourcing (2)
RFID (2)
Security (2)
Build vs. Buy vs. Open Source
Collaborative tools/Groove
Embedded testing/training
ERP
Model-driven architecture
Services-oriented architecture
Web services
47
Timing of Presentations
June 1
June 8
48