Transcript Automated Model Based Testing From Theory via Tools to

TorX : A Test Generation Tool
Ed Brinksma
Course 2004
Formal Testing with Transition
Systems
s  LTS
ioco
der : LTS 
(TTS)
Ts  TTS
pass
iIUT IOTS
obs : TTS
 IOTS 
(traces)
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
traces
2
t:
(traces)
{fail,pass}
fail
Test Generation Tools
for Reactive Systems
 TestGen (Stirling)
 TestGen (INT)
 TestComposer
 TGV
 TorX
 Tveda
 ......
 Agatha
 Autolink
 Cooper
 Gotcha
 Phact/The Kit
 RT-Tester
 SaMsTaG
 Statemate MAGNUM ATG
 STG
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
3
Test Generation Tools for ioco
 TVEDA (CNET - France Telecom)
 derives TTCN tests from single process SDL specification
 developed from practical experiences
 implementation relation R1  ioco
 TGV (IRISA - Rennes)
 derives tests in TTCN from LOTOS or SDL
 uses test purposes to guide test derivation
 implementation relation: unfair extension of ioco
 TestComposer
 Combination of TVEDA and TGV in ObjectGeode
 TestGen (Stirling)
 Test generation for hardware validation
 TorX (Côte de Resyste)
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
4
A Test Tool : TorX
 On-the-fly test generation and test execution
 Implementation relation: ioco
 Specification languages: LOTOS, Promela, FSP, Automata
user:
manual
automatic
next
input
specification
check
output
offer
input
TorX
observe
output
pass
fail
inconclusive
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
5
IUT
TorX Tool Architecture
spec.
explorer
specification
specification
text
© Ed Brinksma/Jan Tretmans
primer
states
transitions
TorX
driver
adapter
abstract
actions
TT 2004, TorX
abstract
actions
6
IUT
concrete
actions
IUT
On-the-Fly  Batch Testing
on the fly
spec.
explorer
batch test generation
© Ed Brinksma/Jan Tretmans
primer
driver
adapter
TTCN
test
taal
TT 2004, TorX
7
IUT
batch test execution
c.
On-the-Fly Testing
New
New
menu
Newmenu
menu
Concreteaction
action
Action
Choice
!! xCheck
Action
Choice
Concrete
action
(x
Check
Abstractaction
actionConcrete
!xx(x
(x<< 0)
<0)
0)
Abstract
action
Abstract
Concrete
action
!(quiescence)
93
00001001
!! 3
-1
!! x?
? ?(quiescence)
9
?!?!11111111
(timeout)
00000011
(x
>=>=0)
0)
?(x
3>=
?
(quiescence)
!xx(x
0)
?! -1
explorer
states
primer
transitions
driver
transition
abstract
actions
adapter
specification
bits
bytes
IUT
implementation
? x (x < 0)
? x (x < 0)
? x (x >= 0)
? x (x >= 0)
! x
! x
! -x
?x
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
8
TorX : Test Purposes, Selection,
……
primer
combinator
spec.
explorer
explorer
test
purpose
explorer
probalistic
primer
selector
driver
primer’
test
TTCN
log
inverse
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
9
ad
TorX
© Ed Brinksma/Jan Tretmans
TT 2004, TorX
10