Transcript PhD Candidacy Oral Presentation

Software Release Planning for
Evolving Systems
PhD Candidacy Oral Examination
by
Omolade Saliu
Supervisor: Dr. Guenther Ruhe
Friday, November 25, 2005
Agenda
 Introduction
 Problems
& Related work
 Proposed Solution
 Summary
 Future Plans
Introduction Problem
Solution
Summary Future Plans
2/16
Background…
Set of features
Customer
requirements
DECISION-MAKING
Prioritization,
selection &
assignment of
features to releases
requires
Decision support
system
Human
Intelligence
Evolving system
Component 3
Component 2
Produces
Technical
requirements
Resource
estimation
Computational
intelligence
Release 1
Component 4
Release 2
Component 1
Release K
Introduction Problem
Solution
Summary Future Plans
3/16
Related Research
Existing RP Approaches
Intuition-Based
Formal Model-Based
XP
Other models
Optimization models
IFM - Denne & Cleland-Huang 04
COVAP - Karlsson & Ryan 97
OVAC - Jung et al. 98
Provotype - Carlshamre 02
PSERM - Greer 04
NRP - Bagnall et al. 01
ENFEM - Penny 02
FRP - Akker et al. 05
Intuition + Formal Model
EVOLVE* - Ruhe & Ngo-The 04
Analysis
 Problem 1: No defined process
 Problem 2: No consideration for evolving systems
Introduction Problem
Solution
Summary Future Plans
4/16
Related Research- Characterization &
Impact Analysis
Related Research
Mining Change Data
Architecture Evaluation
Code Decay/Growth
Eick et al. 2001
Lehman, M. 1980
Belady & Lehman 1976
Metric-based
Questioning
Svahnberg et al. 2003
SAAM – Kazman et al 1994
Al-Naeem et al. 2005
ATAM – Kazman et al. 98
Change Pattern/Fault proneness
Gall et al. 97, 98; Ohlsson et al. 01
CBAM – Kazman et al 01
Hassan et al. 04; Ying et al. 2004;
ALMA – Bengtsson et al . 02
Zimmermann et al. 2005
ARID – Bengtsson & Bosch
Impact Analysis
Bohner & Arnold 1996
 No release planning consideration
 Evaluation based on imagined scenarios
 Characterization scheme not generalizable
Introduction Problem
Solution
Summary Future Plans
5/16
Research Objectives
 Flexible process model that facilitates
decision-making
 Develop characterization and assessment
scheme for evolving system components
 Model effects of system constraints in features
assignment decisions – involve impact analysis
 Extending ReleasePlanner® tool to support RP
for evolving systems
 Empirical evaluation of results
Introduction Problem
Solution
Summary Future Plans
6/16
Decision-centric
process
model
Project Manager
Other Stakeholders
Support Environment
Project Manager
Other Stakeholders
Support Environment
Group of features
P1: Feature elicitation
Group
of features
Objectives
& constraints
Feature elicitation
P2: P1:
Problem
specification
P2: Problem
identified
P3: Stakeholders
voting
Priorities
assigned
Objectives
& to
features by stakeholders
constraints identified
specification
Difficulty of modification for
Priorities
assigned to
all components
P4: Component modifiability assessment
P3: Stakeholders
voting
features by
stakeholders
Impacted
components
P5: Feature-driven impact analysis
& extent of modification
Resource estimates
P4: Resource estimation
System constraints
based on impact
P5: Release plan
P7: Resource estimation
P6: Evaluation of
P8: Release plan
generation
Release
plan
plan alternatives
alternatives
P9: Evaluation of
plan alternatives
Release plan
alternatives
Most appropriate release
Scenarios for reScenarios
for replanning
Most appropriate
plans release
plans
planning
New/evolving features
Resource generation
estimates
New/evolving features
of resources
Shortage
of resources
Shortage
P6: Impact quantification
Implementation
Implementation
Introduction Problem
Solution
Summary Future Plans
7/16
S-EVOLVE*: Components characterization
and Assessment
Components
Size
Expert 1
(DoM)
Difficulty of Modification
DoM Factors
Complexity
COMP-1
Health
COMP-2
…
Understandability
Criticality
Expert 2
COMP-M
Functionality
Expert Q
Introduction Problem
Solution
Summary Future Plans
8/16
S-EVOLVE*: System constraints using
impact information
 Perform expert-based impact analysis
 Determine eXtent of Modification (XoM)
Features f(i)
C(1)
Impact
C(3)
C(M)
C(4)
C(2)
C(5)
System constraint = function(DoM and XoM)
Introduction Problem
Solution
Summary Future Plans
9/16
S-EVOLVE*:
Empirical validation
Questionnaires on current practices
 Initial case study investigating feasibility of
our approach

– Participants: ReleasePlanner® Technical Team
– Feasibility subjectively assessed based on
observation & feedback (ease of use & intuitiveness)
– Experimented with an extension of EVOLVE* to
study effects of system constraints
Introduction Problem
Solution
Summary Future Plans
10/16
Expected Contributions
Following Mary Shaw[ICSE’03] classification of research
contributions in Software engineering:

Method:


Method for Analysis and Evaluation:


Expert-based systematic evaluation of system
components
Generalization:


The S-EVOLVE* method
Extending the scope of release planning to evolving
systems
Feasibility Study:

Empirical studies for validation & improvement
Introduction Problem
Solution
Summary Future Plans
11/16
Future Plans

The decision-centric process
model is completed
Research
Objectives
ReleasePlanner®
Extension
Empirical
evaluation
Introduction Problem
Solution
Summary Future Plans
12/16
Future Plans

Refine and improve the
assessment scheme based on
case studies results
(Apr-Sept 2006)
Research
Objectives
– How to account for new components due
to feature implementation
– Investigate effect of change type
• Focus on developing taxonomy scheme
for features
ReleasePlanner®
Extension
Empirical
evaluation
Introduction Problem
Solution
Summary Future Plans
13/16
Future Plans

Research
Objectives
Investigate other ways to
incorporate system constraint
in RP decision model
(Jan – Sept 2006)
ReleasePlanner®
Extension
Empirical
evaluation
Introduction Problem
Solution
Summary Future Plans
14/16
Future Plans
Empirical validation (8 months):

Research
Objectives
Stage 1: ReleasePlanner® Team
– Sample Goal: Investigate DoM attributes for
completeness
– Sample Goal: Investigate the utility of S-EVOLVE*
over regular RP
– Sample Goal: Investigate DoM assessment for
consistency
– Period: Jan – Apr 2006 (4 months)

ReleasePlanner®
Extension
Stage 2: Fraunhofer-Centre, Maryland
(FC-MD)
– Sample Goal: Investigate DoM attribute for
completeness
– Sample Goal: Investigate DoM assessment for
applicability
– Period: Apr- Aug 2006 (3-4 months)
Empirical
evaluation

Stage 3: Industrial case study – Chartwell ???
Introduction Problem
Solution
Summary Future Plans
15/16
Future Plans

Research
Objectives
Implement further extended
components to augment
ReleasePlanner® based on
improvements in modeling
(Apr – Sept 2006)
ReleasePlanner®
Extension
Empirical
evaluation
Introduction Problem
Solution
Summary Future Plans
16/16
List of Related Publications…
Journal Publications:
1.
Saliu, O. and Ruhe, G., (2005) “Software Release Planning for Evolving Systems”, Innovations in
Systems and Software Engineering: a NASA Journal, 1(2), September, pp. 189-204.
2.
Ruhe, G. and Saliu, M. O., (2005) “The Art and Science of Software Release Planning", IEEE Software,
26(6), November/December, pp. 47-53.
Refereed Conferences:
3.
Saliu, O. and Ruhe, G. (2005) "Supporting Software Release Planning Decisions for Evolving
Systems", 29th IEEE/NASA Software Eng. Workshop (SEW-29), Greenbelt, USA, Apr 6-7, pp. 14-26.
4.
Ngo-The, A. and Saliu, M. O., (2005) "Measuring Dependency Constraint Satisfaction in Software
Release Planning using Dissimilarity of Fuzzy Graphs", 4th IEEE International Conference on
Cognitive Informatics (ICCI'05), Irvine, California, USA, Aug. 8-10, pp. 301-307.
5.
Ngo-The, A. and Saliu, M. O., (2005) "Fuzzy Structural Dependency Constraints in Software Release
Planning", IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2005), Reno, NV, USA, May
22-25, pp. 442-447.
6.
Ruhe, G., Saliu, O., Bhawnani, P., Momoh, J. and Ngo-The, A. (2005) "Decision Support for Software
Release Planning - Methods, Tools, and Practical Experience", (Tutorial) 29th IEEE/NASA Software
Engineering Workshop (SEW-29), Greenbelt, MD, USA, April 3 & 8, pp. 217-250.
Book Chapter:
7.
Maurice, S., Ruhe, G., Saliu, O., Ngo-The, A., and Brassard, R., (2005) "Decision Support for ValueBased Software Release Planning", in: S. Biffl, A. Aurum, B. Boehm, H. Erdogmus, P. Grünbacher
(Eds.), Value-Based Software Engineering Management, Springer, September.
Poster:
8.
Saliu, O. (2005) "S-EVOLVE* - A Decision Support Method for Planning Releases of Evolving
Software Systems", Students Poster Competition, Informatics Circle of Research Excellence (iCORE)
Summit, Banff, Canada, Aug 31 - Sep 2.
In-preparation Conference Paper:
9.
Saliu, O., (2006) “A Systematic Approach for Assessing Components and Planning Releases of
Evolving Software Systems” (Doctoral Symposium) 28th International Conference on Software
Engineering (ICSE 2006), Shanghai, China, May 20-28 (submitted).
Questions
???