Transcript Kein Folientitel

SYST
TOOL
System Test Tools
1 Test atorTool Categories
13 Execution of an Integration Test System
2 Tools for SystemTest Management
14 Sample of an embedded Test System
3 Tools for System Test Operations
15 Sample of a Web-Service Test System
4 Test Plan Editing Tool (TESTPLAN)
16 Mercury Test Director
5 Test Case Specification Tool (TESTSPEC)
17 Mercury WinRunner Capture/Replay System
6 Test Documentation Tool (TESTDOC)
18 Imbus TestBench Architecture
7 Test Data Generator (TESTDATA)
19 Imbus TestBench User Interface
8 Test Procedure Generator (TESTPROC)
20 Empirix E-Test Suite
9 Capture/Replay Systems
21 Empirix E-Tester GUI
10 File Comparators
22 DataTest User Interface
11 Program Instrumentors
23 DataTest Test Result Validation
12 Architecture of an Integration Test System
24 TestDoc Test Measurement
25 TestDoc Test Case Documentation
SYST
TOOL-1
System Test Tool Categories
System Test Tools
Management
Test Tools
Planning
Specification
Operational
Test Tools
Documentation
Construction
Execution
Evaluation
SYST
TOOL-2
Tools for SystemTest Management
SystemTest Management
Test Planer
Test Case
Specifier
Test Reporter
Test Plan
Test Case
Specification
Test Reports
Test
Documentor
Test Documents
SYST
TOOL-3
Tools for System Test Operations
System Test Operations
Test Data
Generator
Original
Test Data
Test Data
Editor
Edited
Test Data
Test Frame
Generator
Test
Frame
Test
Monitor
Test
Execution
Paths
Test
Coverage
analyzer
Test
Coverage
Reports
Test
Result
Validator
Test Data
Validator
Test Result Comparison
Reports
Reports
Capture/
Replay
Terminal
Inputs/
Outputs
SYST
TOOL-4
Test Plan Edit Tools (TESTPLAN)
Test Planer
Testplan
Template
TESTPLAN Tool
System
Test Plan
Document Frame
according to ANSIStandard 829
Sample
Testplan
Contents
Knowledge Base
(Test Plan fragments from
previous projects)
SYST
TOOL-5
Test Case Specification Tool (TESTSPEC)
Bedingung
A = B
X = Y
C =
Regeln = Testfälle
J J J J N N N N
J N J N J N J N
1 1 2 2 3 3 4 4
TESTSPEC
Test Case
Specifier
Testfalltabelle
Conditions
A = B
X = Y
C =
Rules = Test Cases
Y Y Y Y N N N N
Y N Y N Y N Y N
1 1 2 2 3 3 4 4
Decision Table
TC PreCondition PostCondition
1
2
3
A
X
C
A
X
C
A
X
C
=
<
=
=
<
=
=
=
=
B
Y
1
B
Y
1
B
Y
2
&
&
Z = 4
Test Procedure
&
&
Z = 0
&
&
Z = 2
Test Data
Generator
PreConditions
Input
Data
PostConditions
Test Object
Output
Data
SYST
TOOL-6
Test Documentation Tool (TESTDOC)
Database
Validator
Database
States
Dynamic
Analyzer
Execution
Paths
Output
Validator
Soll/Ist
Deviations
Import Interface
TESTDOC Tool
Test
Reports
Multiple Views of Test Results
SYST
TOOL-7
Test Data Generators
Database
Schema
Feldwerte
DBD
DL/1
DDL
SQL
Test Data Generator
CSV
File
Comma separated
Value File
DB
Load
Utility
Test
Database
hierarchical,
networked or
relational Database
Database
Attribute Values
(Pre Conditions)
SYST
TOOL-8
Test Procedure Generator (TESTPROC)
Test Cases
Data type
descriptions
Pre Conditions
Data value
domains
TESTPROC Tool
Testscript
Test Procedure for
Test Driver
SYST
TOOL-9
Capture/Replay Systems
Tester
GUI
Input Data
Replay
Buffer
System
under Test
Database
Capture
Output Data
Stored
Procedures
SYST
TOOL-10
File Comparators
Test Cases
Post
Conditions
PreProcessor
Expected
Values
Error rate is computed
Test
File
Comparator
Deviation
Report
Actual
Values
Non-matching data is recorded
for Tester to check out
SYST
TOOL-11
Program Instrumentors
Source Code
Params
Instrumentor
Instrumented
Source Code
Compile &
Link
Test Object
Test Frame
Trace
Table
PostProcessor
Coverage
Report
C,C++,C#
COBOL, PL/I
JAVA
Protocol
SYST
TOOL-12
Architecture of an IntegrationTest System
SOFTINT
DB Test
File/DB
Generator
File/DB
Documentator
DC Test
File/DB
Validator
Map
Generator
Program
under Test
Instrumentor
TestMonitor
System
Auditor
Terminal
Simulator
Map
Validator
SYST
TOOL-13
Execution of an Integration Test System
In/Out
Asserts
Source
In/Out
Asserts
Before the Test
During the Test
Map
Generator
BatchTerminal
Simulator
Instrumentor
File/DB
Generator
LOG
Input
Maps
Instr.
Source
Test
Monitor
File or DB
After the Test
Output
Maps
Map
Validator
Trace
Tables
Execution
Path
Auditor
Map
Validation
Report
SystemCoverage
Report
File/DB
Comparator
File/DB
Comparison
Report
File/DB
Documentor
File/DB
Content
Protocol
SYST
TOOL-14
Sample of an Embedded Test System
SPECIFICATION
INPUT Assertions
PRE
Assertions
VERIFICATION
OUTPUT Assertions
INPUT Assertions
Test Station
TE ST E VALUATI O N
Test
Script
Output
protocol
Validation
Report
Test
Result
Validator
Test
Compiler
Testmonitor
Test
Result
Database
Test
Database
Input
Signal
Generator
Input
Cache
Device
under
Test
Output
Cache
Output
Signal
Aggregator
SYST
TOOL-15
Sample of a Web Service Test System
Web Services
Port
Port
Port
Post Conditions
Pre Conditions
Assertion
Script
WDSL
Data
Generator
WSDL
Schema
Interface Structure
Request
WSDL
Requests
Response
Test
Driver
Web-Service Test Driver
Sendet test requests und
Empfängt test reponses
WDSL
WSDL
Responses
Assertion
Script
Result
Validator
Validation
Report
Exceptions
SYST
TOOL-16
Mercury Test Director
Mercury Quality Center
Dashboard
Testdirektor
AnforderungsManagement
Testplan
Testlabor
Funktionstest
Quicktest Professional
Winrunner
FehlerManagement
Business Process
Testing
Foundation
Gemeinsam genutztes
Datenrepository
Zentrale
Verwaltung
Workflows
Offene API‘s
Delivery-Optionen
Mercury Managed
Services
Best Practices
Unternehmensinterne
Bereitstellung
SYST
TOOL-17
GUI Map Editor
WinRunner
Mercury WinRunner Testautomat
Window/Objects:
learn
Flight Reservation
„#32770“
Button
„Class“
„Date of Flight“
FLIGHT
modify
add
delete
show
find
{
Class: window,
MSW_class“!Afx,“,
Label: „Flight Reservation“
}
Activate GUI file:
verify
win_activate („Flight Reservation“);
set_window („Flight Reservation“, 10);
edit_set(„Date of Flight“;“02/27/98“);
list_seleted_item(„Fly from“, „San Francisco“);
set_window („Flight Reservation“, 10);
button_press(„OK“);
SYST
TOOL-18
IMBUS TestBench Architecture
Test Plan
Users
Test Design
Navigation Design
Test Cluster
Navigation Scripts
Managers
Protocols
QA/Auditors
Testautomat
Developers
Target System
SYST
TOOL-19
IMBUS TestBench User Interface
Testthemensicht von Car Configurator (Beispiel)
Testthemenbaum
Spezifikation Externe Automatisierung Durchführung
Aktuelle Ansicht
1 Datenbank konfigurieren
2 Preisberechnung
2.1 einfache Interaktionen
Testthemenbaum
Aktuelle Ansicht
Interaktionen
Car_config_close
Car_config_start
Fahrzeug konfigurieren
Preis prüfen
Verantwortlicher
Theo Tester
Status
durchgeführt
Geplante Durchf. Aktuelle Durchf.
Fahrzeugnr.
Fälligkeitsdatum 27.02.06
Priorität
Hoch
Testfälle
Fehler
Fehler ID
Titel
Entdecker
Status
SYST
TOOL-20
Empirix E-Test Suite
QA
OneScript
Test Plan & Defects
Load Console
E-Management Enterprise
E-Tester
E-Load Agent
Application under Test
Server
Stats
SYST
Empirix E-Tester User Interface
TOOL-21
Load from File (WSDL)
open
Method Name
Web Service Name
add
Loaded Methods
findEmployee
addEmployee
Method to Add to Script:
ok
test all
reset
Test
Move up
Properties for specified Web Service Method
Method Arguments
First Name
Last Name
EmployeeID
Address
City
Apply Changes
Restor Arguments
Move Do.
cancel
SYST
TOOL-22
DATATEST User Interface
SYST
TOOL-23
DATATEST Result Validation
Old Data
Missing in
the New
Data Validation
New Data
A
1
10
0
A
1
10
0
B
2
20
0
B
2
21
0
C
3
30
0
C
3
30
0
D
4
40
0
D
4
40
0
E
5
50
0
E
5
50
0
F
6
60
0
G
7
70
0
G
7
70
0
H
8
80
0
Compare
if objects
are present
and equal
Validate one set of data against another
by checking existence and matching content
Doesn‘t
Match
Missing in
the Old
SYST
TESTDOC Test Measurement
TOOL-24
Original
Source
Code
Test Trace
Report
Code
Instrumentierung
Tester stößt
Instrumentierung an
Tester
stößt Test an
Instrumented
Source Code
Compile &
Build
Testfälle
System
Under
Test
Testfall
Protokoll
Start
&
End
Zeiten
Testfall
Zuordnung
Trace
File
Test
Coverage
Messung
Test
Coverage
Report
SYST
TESTDOC Test Case Documentation
+----------------------------------------------------------------------+
|
T E S T A N A L T E S T C A S E
A U D I T O R
|
|
D A T A
O B J E C T
R E P O R T
|
|
TESTPROC: FAHRZEUG
DATE: 28.04.06
|
|
SYSTEM:
BAWKFZ
PAGE:
1
|
+----------------------------------+-----------+-----------------------+
| Data Object Name
| tested by | TestCase Name
|
+----------------------------------+-----------+-----------------------+
| Jahr
| TcNr:0317 | FAHRZEUG0317
|
|
| TcNr:0321 | FAHRZEUG0321
|
|
| TcNr:0322 | FAHRZEUG0322
|
|
| TcNr:0355 | FAHRZEUG0355
|
+----------------------------------+-----------+-----------------------+
| Jahresanfang
| TcNr:0351 | FAHRZEUG0351
|
+----------------------------------+-----------+-----------------------+
| Jahreswagen
| TcNr:0000 | Testcase is missing! |
+----------------------------------+-----------+-----------------------+
| Jahreszahl
| TcNr:0484 | FAHRZEUG0484
|
|
| TcNr:0486 | FAHRZEUG0486
|
+----------------------------------+-----------+-----------------------+
| Kapitel
| TcNr:0520 | FAHRZEUG0520
|
|
| TcNr:0531 | FAHRZEUG0531
|
+----------------------------------+-----------+-----------------------+
| Karteikarten
| TcNr:0000 | Testcase is missing! |
+----------------------------------+-----------+-----------------------+
| Kategorien
| TcNr:0002 | FAHRZEUG0002
|
+----------------------------------+-----------+-----------------------+
| Kennzeichen
| TcNr:0152 | FAHRZEUG0152
|
|
| TcNr:0154 | FAHRZEUG0154
|
|
| TcNr:0154 | FAHRZEUG0154
|
|
| TcNr:0157 | FAHRZEUG0157
|
+----------------------------------+-----------+-----------------------+
| Kennzeichenvorschlag
| TcNr:0000 | Testcase is missing! |
+----------------------------------+-----------+-----------------------+
| Kleinwasserfahrzeuge
| TcNr:0004 | FAHRZEUG0004
|
|
| TcNr:0005 | FAHRZEUG0005
|
+----------------------------------+-----------+-----------------------+
|
Number of Data Objects to be tested
=
382
|
|
Number of Data Objects with a Test Case
=
314
|
|
Number of Data Objects without a Test Case =
52
|
|
Degree of Data Objects Coverage
=
0.82
|
+----------------------------------------------------------------------+
TOOL-25