Transcript What is tested? - OPC Foundation

Unified Architecture Training
Compliance Test Tool (UACTT)
Introduction to the UA CTT
for Server Testing
Press SPACE to advance through the slides.
UACTT Training - Server
Contents
•
Introduction
•
Familiarization of User Interface
•
Finding Help
•
Test Tool Configuration
•
Testing & Debugging
•
Script Customization and Advanced Debugging
•
Next Steps
UACTT Training - Server
Introduction (1 of 3)
What is it?
A specialized UA Client designed to test a UA Server
for compliance.
Where is it?
http://www.opcfoundation.org/ua/ctt
Who can get it?
OPC Foundation Corporate Members
What is tested?
UA Servers and/or UA Clients
Coverage?
Many base/core services.
Your UA
Server
UACTT
Several UA profiles, with more in-development
Extensible?
Easy to use?
4/19/2012
Yes, you can add your own tests.
Yes, once you’ve learned the basics.
© 2012 OPC Foundation
You
3
UACTT Training - Server
Introduction (2 of 3)
How it works:
Each Service is tested by invoking specific calls that:
a. are expected to pass and/or return specific results
b. are expected to fail and/or return specific results
c. multiple parameter combinations to check behavior
d. validates behavior matches the UA specifications
Test authors?
Compliance Working Group (cmpwg)
Developers?
Compliance Working Group
Can I help?
Absolutely! We always need help creating test-cases
and test-scripts, and for testing.
Contact [email protected]
4/19/2012
© 2012 OPC Foundation
4
UACTT Training - Server
Introduction (3 of 3)
How do I pass?
Your product must pass all tests in all selected profiles
and/or conformance units.
Am I Certified?
Passing the UACTT does not mean you are certified by
the OPC Foundation. It means that your product is
ready for certification in a Test Lab.
CTT used in Lab? Yes, test-labs use the current release version(s).
Use CTT When?
The best time is during product development. All UA
products must pass the UACTT prior to release.
Additional Help:
Complete help-documentation is provided with the
UACTT. Test-case documentation is also provided.
4/19/2012
© 2012 OPC Foundation
5
UACTT Training - Server
Launching UACTT (1 of 1)
Windows Vista/7:
Start >
All Programs >
OPC Foundation >
Unified Architecture >
Compliance Test Tool >
Compliance Test Tool (CTT)
Windows 8:
Start >
Compliance Test Tool (CTT)
6
4/19/2012
© 2012 OPC Foundation
UACTT Training - Server
Familiarization (1 of 3)
There are (by default) 3 “widgets” to the right:
• Help: quick access to documentation
• Objects: simple listing of UA object names
• Object Properties: simple listing of properties and methods of the currently
selected object.
4/19/2012
© 2012 OPC Foundation
7
UACTT Training - Server
Familiarization (2 of 3)
There are (by default) 3 “widgets” to the left:
• Profiles: A list of all UA Profiles.
• Conformance Units: A list of all Conformance Units and of all test-scripts.
• Library: An area where reusable script components are stored.
4/19/2012
© 2012 OPC Foundation
8
UACTT Training - Server
Familiarization (3 of 3)
There are (by default) 3 “widgets” at the bottom:
• Results: a hierarchical audit-log of test activities and results.
• Script Output: a verbose trace of test-script activity.
• Trace: a generalized trace of UACTT activity.
4/19/2012
© 2012 OPC Foundation
9
UACTT Training - Server
Finding Help (1 of 2)
Complete documentation is available from the Contents option in the Help menu.
Documentation includes a user-guide and other useful testing tips.
4/19/2012
© 2012 OPC Foundation
10
UACTT Training - Server
Finding Help (2 of 2)
All test-cases used by the Lab are exported into HTML pages that are available with the
UACTT. Test-case documentation can be launched from the main documentation or
from the Help widget.
4/19/2012
© 2012 OPC Foundation
11
UACTT Training - Server
Test Tool Configuration (1 of 4)
After launching the UACTT you must create a new Project. You must choose a Server or
Client project type, and then specify the project name and save-location.
4/19/2012
© 2012 OPC Foundation
12
UACTT Training - Server
Test Tool Configuration (2 of 4)
We must configure the CTT to connect to the UA Server.
Open the Settings and configure as shown above….
Step 1. Enter the
EndPoint URL for the
UA Server you will test.
Step 2. Click the Apply
button.
Note: The Advanced folder
contains settings that can be
ignored.
4/19/2012
© 2012 OPC Foundation
13
UACTT Training - Server
Test Tool Configuration (3 of 4)
The first time you connect to your Server you will need to accept/trust the Application
Certificate. It’s recommended to permanently trust the certificate.
Once trusted, you can browse the server address-space.
Click Accept Permanently
to trust the application
4/19/2012
© 2012 OPC Foundation
14
UACTT Training - Server
Test Tool Configuration (4 of 4)
The UACTT [currently] requires manual configuration by specifying which UA Nodes to
test against…
Drag-n-drop the Nodes from
the browser (right) to the
setting (left)
Each Folder contains
settings for you to configure
the NodeIds to be used
during testing
4/19/2012
© 2012 OPC Foundation
Click the References tab to
view forward/inverse
references
15
UACTT Training - Server
Testing & Debugging (1 of 3)
First, test the connection to the UA Server by using a test-script…
Step 2. Click “Execute
Current Script”.
Step 1. Double-click 001.js in
the Attribute Read/Test
Cases folder.
The script will open in a tab.
Step 3. Check the Script
Output tab to make sure the
connection/test was
successful.
4/19/2012
© 2012 OPC Foundation
16
UACTT Training - Server
Testing & Debugging (2 of 3)
Second, run a compliance test for conformance units and/or profiles…
Step 2. Click Start
Debug Run
Step 1. Choose the tests to run…
You can use either tab: Conformance
Units and/or Profiles.
Use checkboxes to select an
entire Conformance Unit, or
Conformance Group.
4/19/2012
Use checkboxes to select one or
more Profiles, which
automatically checks the
applicable Conformance Units.
© 2012 OPC Foundation
17
UACTT Training - Server
Testing & Debugging (3 of 3)
Perhaps you might test using a secure connection, or a session based on a login…
Step 1. Perhaps change the session
settings by changing the
UserAuthenticationPolicy etc.
Step 2. Perhaps change the SecureChannel
configuration. Always start with None (no
security) because troubleshooting is simpler.
4/19/2012
© 2012 OPC Foundation
18
UACTT Training - Server
Debugging (1 of 2)
After a test-run, the Results widget contains a hierarchical audit trail of results…
Results Tab provides an audit-log of testing
activities. The example above shows an entry which
states that an incorrect error code was received.
4/19/2012
© 2012 OPC Foundation
19
UACTT Training - Server
Debugging (2 of 2)
Use the integrated debugger to step-through a test-script…
Standard debugging tools: step
into, step over, step out etc.
View the code in the
interactive code-display tab.
Powerful watch
window.
Open a script in the
editor, and then click
Start current script in
debugger
View output from the debugconsole, console, and error-log.
4/19/2012
© 2012 OPC Foundation
Access to call-stack,
breakpoints, and a list of
loaded-scripts etc.
20
UACTT Training - Server
Script Customization
Add your own scripts to a conformance unit…
4/19/2012
© 2012 OPC Foundation
21
UACTT Training - Server
Advanced Debugging (1 of 3)
What is it?
An ability to use a 2nd CTT to neutrally observe the 1st.
Why?
The UA calls can be easily seen & filtered.
The trace output can be saved & opened later.
What’s needed? 2 UA CTT instances running:
a. Your Server CTT project
b. A Client CTT project
Coverage?
This method requires an insecure channel between
the 1st UA CTT and your downstream UA Server.
All OPC UA calls can be traced.
More Info?
4/19/2012
See the Client Test presentation.
© 2012 OPC Foundation
22
UACTT Training - Server
Advanced Debugging (2 of 3)
Open 2 CTTs side-by-side; 1x Server test mode and 1x Client test mode.
UA Server
CTT Project
UA Client
CTT Project
UA Server
(downstream)
opc.tcp://localhost:4841
4/19/2012
© 2012 OPC Foundation
23
UACTT Training - Server
Advanced Debugging (3 of 3)
Execute a test-script in the Server-CTT; observe results in Client-CTT…
UA Server
CTT Project
UA Client
CTT Project
UA Server
(downstream)
opc.tcp://localhost:4841
Observe ALL request &
response parameters
of a service call
Select a test-script and
then run it.
4/19/2012
Observe the calls in the
2nd CTT (client test mode).
© 2012 OPC Foundation
24
UACTT Training - Server
Next Steps…
Once your UA Server passes all applicable CTT tests:
• Conduct Interoperability Testing
• Conduct Behavior Testing
This information
is available in the
CTT Test-Cases
help pages.
• Conduct Resource-efficiency Testing
• Request Certification in the Test Lab:
http://www.opcfoundation.org/Compliance-Certification/A1-Application.pdf
4/19/2012
© 2012 OPC Foundation
25
UACTT Training - Server
The End!
Download: www.opcfoundation.org/ua/ctt
Certification: www.opcfoundation.org/certification
Lab Testing: http://www.opcfoundation.org/lab/signup
Bug Tracker: www.opcfoundation.org/mantis
Contact: [email protected]