Testing activities at CISS

Download Report

Transcript Testing activities at CISS

UPPAAL
The Long Road from Theory
to
Industrial Impact
Frits Vaandrager
[email protected]
Overview
Informationsteknologi







What is Model Checking?
History & Impact
Early Days
Engine
Scheduling & Planning
Current Projects
Conclusions
Informationsteknologi
Turing Award 2007 for
Model Checking!!!
Ed Clarke
Allen Emerson
Joseph Sifakis
Informationsteknologi
What is Model Checking?
System Description
Automata A
Yes!
Model Checker
A sat F
Requirement
Specification F
89
90
93
94
95
No!
Diagnostic Information
97
98
99
Informationsteknologi
Example: Gossiping Girls Problem
Six girls all have a
gossip of their own.
They call each other
over the phone.
Whenever two girls talk
they exchange all
gossips they know.
How many calls are
needed before every girl
knows every gossip?
Informationsteknologi
Transition System
Informationsteknologi
Temporal Logic
Informationsteknologi
Solution Model Checker
Informationsteknologi
Hybrid & Real Time Systems
Computer Science
Control Theory
sensors
actuators
Plant
Continuous
Eg.:
Pump Control
Air Bags
Robots
Cruise Control
ABS
CD Players
Production Lines
Task
Task
Task
Task
Controller Program
Discrete
Real Time System
A system where correctness not only
depends on the logical order of events
but also on their timing!!
History of UPPAAL
Informationsteknologi
TAU
CCS & Modal Transition Systems
Refinements
Modal Mu-Calculus
Explicit State Representation
Prolog
1989
1993
1995
UPPPAAL
Timed Automata
TCTL
Zones
C & Java
EPSILON
TCCS
Timed Refinements
Timed Mu-Calculus
Regions
Prolog
Contributors
Informationsteknologi
@UPPsala







Wang Yi
Paul Pettersson
John Håkansson
Anders Hessel
Pavel Krcal
Leonid Mokrushin
Shi Xiaochun
@AALborg








Kim G Larsen
Gerd Behrman
Arne Skou
Brian Nielsen
Alexandre David
Jacob I. Rasmussen
Marius Mikucionis
Thomas Chatain
@Elsewhere

Emmanuel Fleury, Didier Lime, Johan Bengtsson, Fredrik Larsson, Kåre J
Kristoffersen, Tobias Amnell, Thomas Hune, Oliver Möller, Elena Fersman,
Carsten Weise, David Griffioen, Ansgar Fehnker, Frits Vaandrager, Theo Ruys,
Pedro D’Argenio, J-P Katoen, Jan Tretmans, Judi Romijn, Ed Brinksma,
Martijn Hendriks, Klaus Havelund, Franck Cassez, Magnus Lindahl, Francois
Laroussinie, Patricia Bouyer, Augusto Burgueno, H. Bowman, D. Latella, M.
Massink, G. Faconti, Kristina Lundqvist, Lars Asplund, Justin Pearson...
Informationsteknologi
UPPAAL 4.0
GUI
• Unlimited undo and redo
• Syntax and bracket highlighting
• Rectangular selection
• Customization of colors
• Tooltip
• Hiding of information
• Improved help menu with search
component
Language
• User defined functions (C-like)
• New types (records, type
declarations, meta variables,
scalars)
• Partial instantiation of templates
• Select clauses on edges
• Forall and exist quantifiers
Informationsteknologi
UPPAAL 4.0
Graphical Simulator
• visualization
•
•
•
•
and recording
inexpensive fault detection
inspection of error traces
Message Sequence Charts
(Gannt Charts)
Informationsteknologi
UPPAAL 4.0
Verifier
• Exhaustive & automatic
checking of requirements
• .. including validating, safety, liveness,
bounded liveness and
response properties
• .. generation of debugging information
for visualisation in simulator.
• Optimal scheduling for cost models
Impact
UPPAAL downloads
25000
2
Informationsteknologi
20000
15000
10000
5000
0
99
07
99
11
00
03
00
07
00
11
01
03
01
07
01
11
02
03
02
07
02
11
03
03
03
07
03
11
04
03
04
07
04
11
05
03
05
07
05
11
06
03
06
07
Total number of Dowloads
y = 3,236x - 13,841x + 582,21
UPPAAL:
SPIN Verifier:
nuSMV:
UPPAAL downloads
700
600
Downloads per month
Google:
Date
134.000
242.000
57.700
500
> 1.500
Google Scholar Citations
(Rhapsody/Esterel < 3.500)
400
300
200
100
0
1999
2000
2001
2002
2003
Year
2004
2005
2006
Impact
Informationsteknologi
Company Downloads
Mecel
Jet
Symantec
SRI
Relogic
Realwork
NASA
Verified Systems
Microsoft
ABB
Airbus
PSA
Saab
Siemens
Volvo
Lucent Technologies
Informationsteknologi
UPPAAL Branches
TIGA
CORA
TRON
CLASSIC
CLASSIC
Verification
& The Early Days
A good beginning is
useful …
First official UPPAAL presentation
Informationsteknologi
Wang Yi, TACAS, Aarhus, April 1995
Johan Bengtsson
Kim Larsen
Fredrik Larsson
Paul Pettersson
Wang Yi
Application
Informationsteknologi
The Philips Audio Protocol
with collision
David Griffioen and some
Scandinavian friends.
Informationsteknologi
Application
Bounded Retransmission Protocol
Pedro D’Argenio
Joost-Pieter Katoen
Theo Ruys
Jan Tretmans
Application
Informationsteknologi
Scheduling wafer production at ASML
Martijn Hendriks
in Cyprus
Informationsteknologi
Some UPPAAL Groupies
Jan Friso Groote
Frits Vaandrager
Leslie Lamport
The Engine
Datastructures for Zones
Informationsteknologi


DBM package
Minimal Constraint
Form
[RTSS97]
-4
x1
x2
4
3
3
-2
Clock Difference
AlexandreDiagrams
David
+
[CAV99]
Johan Bengtsson,
Fredrik Larsson

PW List
[SPIN03]
2
2 bindings for
Elegant RUBY
x0
x3
1
easy implementations
5

-2
Informationsteknologi
To Store or Not To Store
Behrmann, Larsen,
Pelanek 2003
117 statestotal
!
81 statesentrypoint
!
9 states
Time OH
less than 10%
Audio Protocol
Symmetry Reduction
Informationsteknologi


Exploitation of full
symmetry may give
factorial reduction
Computation of
canonical state
representative
Martijn Hendriks
[Formats 2003]
D-UPPAAL
Informationsteknologi
Gerd Behrmann, Thomas Hune,
Frits Vaandrager




Distributed implementation of
UPPAAL on PC-cluster [CAV'00,
PDMC'02, STTT'03].
Applications

Synthesis of Dynamic Voltage
Scaling strategies (CISS).

Ad-hoc mobile real-time protocol
(Leslie Lamport) - 25GB in 3 min!
Running on NorduGrid.
Local cluster: 50 CPUs and 50GB of
RAM
To be used as inspiration for
verification GRID platform within
ARTIST2 NoE.
Informationsteknologi
UPPAAL 1995 - 2001
Every 9 month
10 times better
performance!
Dec’96
Sep’98
3.x
CORA
Optimal Scheduling
SIDMAR Steel Production Plant
Crane A
Informationsteknologi




A. Fehnker [RTCSA99],
T. Hune, K. G. Larsen,
P. Pettersson [DSV00]
Machine 4
Case study of Esprit-LTR
project 26270 VHS
Physical plant of SIDMAR
located in Gent, Belgium
Part between blast furnace and Crane B
Machine 1
Machine 2
Machine 3
Machine 5
Lane 2
Buffer
hot rolling mill
Storage Place
Objective: model the
plant, obtain schedule and
control program for plant
Continuos
Casting Machine
Lane 1
Informationsteknologi
Ametist
2002-2005
Priced Timed Automata
Timed Automata + COST variable
Behrmann,
Fehnker, et all (HSCC’01)
Priced
Zone
CAV’01
Alur, Torre, Pappas (HSCC’01)
l2
l1
0·y ·4
c’=4
x:=0
TRACES
(l1,x=y=0)
(3)
12
(2.5)
(l1,x=y=0)
(l1,x=y=0)
10
1
x·2
3·y
c’=2
x:=0
c+=1
cost rate
Informationsteknologi
Informationsteknologi
Informationsteknologi
Priced Timed Automata
(l1,x=y=3)
(l1,x=y=2.5)
(l2,x=0,y=0)
c+=4
1
6
Z

2
cost update
y·4
4
(.5)
(l2,x=0,y=2.5)
(3)
y
4
(l2,x=0,y=3)
1
l3
(l2,x=3,y=3)
1
0
(l3,_,_)
x
 c=17
(l2,x=0.5,y=3)
(l2,x=0,y=3)
-1
4
4
(l3,_,_)
 c=16
(l3,_,_)
 c=11
Cost( x, y )  2y  x  2
Behrmann, Brinksma, Fehnker, Hune, Larsen, Pettersson,
Romijn, Vaandrager … Rasmussen .. Bouyer, Cassez, Nicolas …
Informationsteknologi
Example: Aircraft Landing
cost
d+l*(t-T)
e*(T-t)
E
T
Planes have to keep
separation distance to avoid
turbulences caused by
preceding planes
L
t
E earliest landing time
T target time
L latest time
e cost rate for being early
l cost rate for being late
d fixed cost for being late
Informationsteknologi
Example: Aircraft Landing
x >= 4
land!
x <= 5
cost’=3
x=5
x <= 5
x=5
cost+=2
x <= 9
cost’=1
land!
Planes have to keep
separation distance to avoid
turbulences caused by
preceding planes
4
5
9
3
1
2
earliest landing time
target time
latest time
cost rate for being early
cost rate for being late
fixed cost for being late
Informationsteknologi
Using Heuristics
Try to schedule planes in the order of
their preferred landing times
runways
Informationsteknologi
Aircraft Landing Problem
AXXOM Case study
Informationsteknologi



Laquer Production Scheduling
3 types of recipes


for uni/metallic/bronce
use of resources,
processing times,
timing
29 (73, 219) orders:

start time, due date,
recipe
extensions:


delay cost,
storage cost,
setup cost
weekend, nights
Behrmann, Brinksma, Hendriks, Mader
16th IFAC World Congress
Resources
Informationsteknologi









2 mixing vessels for
uni lacquers
3 mixing vessels for
metallic/bronce
2 dose spinners
1 dose spinner bronce
1 disperging line
1 predisperser
1 bronce mixer
2 filling lines
lab (unlimitted)
Axxom
Informationsteknologi
Recipes
UPPAAL template
for metal
Axxom
Informationsteknologi
Instantiated Model
State Space
Explosion
Heuristics
!!
Guiding & Pruning
Axxom
Results Extended Case
Axxom
Informationsteknologi
storage, delay and setup costs, working hours
#jobs
29
29
29
work
hrs
heuristic
-
es, no, nl
Competitive
- with es, no, g
Orion-pi
avail.
results es, no, nl
max.
min. cost
orders of magnitude
Order
found in 60 s
faster than
- GAMS/CPLEX
530,771
MILP,
-
647,410
-
1,714,875
29
avail.
es, no, g
-
2,263,496
29
expl.
no
4
192,881,129
Current Projects
Towards industrial use
…
Informationsteknologi
Compositional Abstraction
Jasper Berendsen, Biniam
Gebremichael, Miaomiao Zhang, FV
Compositional Abstraction
Informationsteknologi

weakening guards & invariants
x≤3

chaos abstraction
Host 1
Host 2
Host 3
Host n
Compositional Abstraction
Informationsteknologi

weakening guards & invariants
x≤3

chaos abstraction
Chaos
Host 1
Host 2
Host 3
Host n
Use of Uppaal in the Classroom
Informationsteknologi
Roelof Hamberg, FV
c+10.l upperbound on waiting time for
entering critical section in Peterson's
mutual exclusion algorithm with 2 processes
strengthening of c+O(l) bound of Lynch
Use of Uppaal in the Classroom
Informationsteknologi
Roelof Hamberg, FV
c+10.l upperbound on waiting time for
entering critical section in Peterson's
mutual exclusion algorithm with 2 processes
strengthening of c+O(l) bound of Lynch
ESI Octopus Project with Oce
Informationsteknologi
Georgeta Igna, FV
Design of adaptive data
Path in Copiers/Printers
Challenges: problem size, hybrid phenomena, timed games,..
Informationsteknologi
FP7 Quasimodo Project
Analysis of Wireless Sensor
Networks of Chess
David Jansen,
Faranek Heydarian,
Julien Schmaltz, FV
Challenges: probabilities, hundreds of nodes, dynamic network,..
NWO Project ARTS
Informationsteknologi
Faranek Heydarian, FV
Abstraction Refinement for
Timed Systems
Challenge: Counterexample guided abstraction refinement
Informationsteknologi
Gerd Behrmann
Informationsteknologi
Conclusion





Process Algebra
Industry
Tools indispensable for
transfer
Tools are only first steps
Tools must fit industrial
 State space explosion
tool chain and
remains major
challenge
development process
(UML, Matlab/Simulink,
 Collaborate with
Rhapsody, visualSTATE,
researchers closer to
Scade)
end-users than you:
 Control
Involve
several academic
Centers
of Competence
forTheory
:
 Hardware
teams!
 Expand scope of
Collaborate with endtechnology:
users!
 Verification  Testing
:
 Verification 
Optimization
CISS, ESI, ..