UCAIug - Testing and Quality Assurance

Download Report

Transcript UCAIug - Testing and Quality Assurance

Testing Subcommittee
Report
UCAI Users Group Meeting
Charlotte, Nc, USA
November 9-10, 2009
Bruce Muschlitz
Committee co-chair
www.ucaiug.org
November 9-10, 2009
UCA IUG Testing Subcommittee Report
Testing Subcommittee
Charter
•
•
•
•
Maintain certified product list
Maintain certified tester list
Maintain test procedures
Assist users and vendors in application of
test procedures
• Interpret test procedures
November 9-10, 2009
UCA IUG Testing Subcommittee Report
2
Group Interactions
Testing Subcommittee
61850
Testing
OpenSG
Conformity
CIM
Testing
Conformance Test
Procedures
November 9-10, 2009
UCA IUG Testing Subcommittee Report
3
Testing Subcommittee/
Working Group Membership
•
•
•
•
Open to all UCAI User Group Members
Have academic, utility, vendor, testers
Each member has equal voice
Please consider joining one of the Working
Groups
November 9-10, 2009
UCA IUG Testing Subcommittee Report
4
2009 Meeting summary
(since 02/2009)
• 61850 Meetings
– Met 1 time face-to-face (Pittsburgh, USA)
– Met 4 times by teleconference
– 3 “informal” single-issue meetings
• Distributech 2009
• IEC TC57/WG10 Grenoble
• IEC TC57/WG10 Bilbao
• OpenSG Conformity – met once
• CIM Testing – meeting this week
November 9-10, 2009
UCA IUG Testing Subcommittee Report
5
2009 Work Items
• Client Test procedure updated to v1.1
– Embeds PIXIT for immediate use!
•
•
•
•
•
•
Merging Unit testing extensively discussed
Templates for PICS/MICS/PIXIT/TICS
GOOSE functionality/performance testing
TCPL (TISSUEs list for test procedures)
Integrating OpenSG Conformity group
Integration CIM Testing group
November 9-10, 2009
UCA IUG Testing Subcommittee Report
6
Ongoing Work
•
•
•
•
•
Merging Unit Test coordination with TC37
Product Mark (if still desired by users)
Testing of User tools (ex, configuration)
Remote testing (over Internet)
Application notes outlines
November 9-10, 2009
UCA IUG Testing Subcommittee Report
7
Future Work
• Fully Integrate CIM testing group
• New IED types
– Gateways
– Ethernet Switch
•
•
•
•
•
Software tool (SCL) testing
Add performance testing
Consider Interoperability testing
Revise tests for 61850 Edition 2
Generate FAQs
November 9-10, 2009
UCA IUG Testing Subcommittee Report
8
User Questions
Inter-Operability testing expectations for 61850
• Do we need it?
• Should this be only between pairs of devices?
• How do we define the functions to be tested?
• Should we expect “no manual configuration”?
(is “tweaking to pass the test” allowed?)
• Should we test peer-to-peer communication?
November 9-10, 2009
UCA IUG Testing Subcommittee Report
9
User Questions (2)
Product Mark (logo for “approved” devices)
• Do we need it?
• Will it affect your purchasing decisions?
• Should vendors pay for it?
• Should tester pay for it?
November 9-10, 2009
UCA IUG Testing Subcommittee Report
10
User Questions (3)
Integration issue feedback
• Has there really never been integration
problems?
• Testing Committee is awaiting the first
submission
• Should we offer a prize for this?
November 9-10, 2009
UCA IUG Testing Subcommittee Report
11
Questions?
November 9-10, 2009
UCA IUG Testing Subcommittee Report
12