Transcript Document

The B2B Plugtests event in
2008 – Sophia Antipolis
Réunion Architectures techniques
TIC PME 2010
Francois FISCHER
Philippe COUSIN
Footer text (edit in View : Header and Footer)
World Class Standards
ETSI is…
 A non-profit organization, Recognized Standards
Development Organization
 Based in Sophia Antipolis, south of France
 688 members from 55 countries
 http://www.etsi.org/
 ETSI are:
 Manufacturers, network operators,
 Service providers, administrations
 Research bodies and users
2
World Class Standards
Plugtests is a professional ETSI service
 Created in 1999, specialized in the organization of
test events
 Cost neutral
 Skilled ETSI Staff managing test events
 Experts from ETSI and other technical communities
 Neutral and open to all organisations
 Synergy Conformance & Interoperability in close
cooperation with ETSI Committees and PTCC
 >60 events in 5 years, 3000 engineers, 900 Companies
 1600 participants surveyed ranked usefulness at 4.3/5
and Service satisfaction 4.35/5
3
World Class Standards
Who attends Plugtests events?
 Our events are open to all sorts of companies (big and
small) as well as engineers developing a product,
 Participants do NOT have to be ETSI members
 Plugtests are addressed to any
company developing a product such as
operators, vendors or equipment
manufacturers, content providers or
application providers
 Standardization bodies, Fora
or interest groups may also attend
4
World Class Standards
During a Plugtests event, engineers can
“Come & Test” !
Also known as bake-off (at IETF), plugfests and interop
Plugtests :
 Provides useful feedback to the standardization process
 Gives a unique opportunity to meet partners and
competitors
 Helps to ensure end users’ satisfaction
 Improves both quality and features of implementations
 Allows for networking with the market key players
 Accelerates time to market via quick product debugging
COST & TIME SAVING !
5
World Class Standards
PlugtestsTM :Your Fully Customizable Service
Technical
Management
Event
Management
Communication
Management
Sponsorship
Opportunities
Customized test bed, test cases setup with experts, tests slots
schedule…
Website, registration on-line, hosting
site, legal aspects..
Event promotional kit development,
event presentation at key
conferences, dissemination by
internal/international press…
Sponsor us! Your value…
www.etsi.org/plugtests/sponsorus
6
World Class Standards
Areas of interest
 SERVICES & APPLICATIONS
 Mobile Applications, OSA-PARLAY, Triple-Play (over
DSL, Powerline..), Human Factors
 TELECOM
 Wimax, UWB, DSL, RFID, SMS/MMS, NGN, Speech
Quality, Powerline, Smart Card, Lawfull Interception,..
 IP
 IPv6 and Mobile IPv6, MPLS, SIGTRAN, SIP
 HOT TOPICS
 Grid Computing, WLAN/WMAN, ITS, Security, RF-ID,
ebXML
7
World Class Standards
Summary of the 2004 event
 Test methodology:
 Interoperability does not guarantee conformance:
• Two implementations that interoperate do not necessarily
comply with the specifications
• Two implementations may pass conformance without being
able to interoperate.
 Perform conformance testing prior to interoperability
testing:
• Changing implementation in the middle of interoperability
testing (to resolve interoperability issues) may invalidate
previous result
• Recommend passing first Conformance testing, preferably
before the event.
8
World Class Standards
Summary of the 2004 event (cont.)
 Conformance test suite:
 Conformance test suite to verify implementation compliance to ebMS
2.0.
 Driven by the Korbit test center.
 OASIS - IIC Test suite – Test framework 1.0
 Checking only critical and non-redundant test cases: 35 from 117.
 Interoperability
 To check combination of messaging and configuration features
between two MSH.
 Interoperability testing framework implemented in Korbit test bed.
 Test specification from OASIS - IIC
9
World Class Standards
Summary of the 2004 event (cont.)
 Test event feedbacks
 Raised issues:
• Interpretation of the ebMS2 specifications.
• Test cases
• Test cases interpretation
 Korbit test bed
• Improvements to reduce interface integration effort
 Participants:
• Successful event
• Ensuring specification compliance and interoperability
10
World Class Standards
The 2008 Plugtests event




Not only focusing on ebXML
Rather a B2B event.
ebXML and Web services platforms
The infrastructure base will support:
 ebXML (messaging, process, CPA, registry-rep, Core Components)
 application components published as Web services
 Keeping it open and flexible :
 Independence from Business Document standards (XML, EDI…)
 Switching between messaging alternatives (e.g. with a gateway model, such
as AS2/ebMS2 Hermes OSS).
 Accessing Web services either using an ebMS3 gateway or directly.
11
World Class Standards
Improved Test tools
 Korbit proposing:
 Enhanced conformance testing: ebMS 3.0, RAMP profile W/S,
 Document, Transaction and Infrastructure testing.
 NIST testing capabilities:
 Application information mapping
 With test specification process
 Driven by test bed tooling
 Both test capabilities above to discover inter-operability issues
before inter-operability testing .
12
World Class Standards
End-to-End Interoperability across the eBusiness Stack
 Not just at messaging infrastructure level
 But:
Business
Transaction
Business
Process
Business
Document
Application
Semantics
and Services
Messaging
13
World Class Standards
Solution-oriented PlugTest
 From Infrastructure-focused to Solution-focused
 PlugTest must allow participants to assess and demonstrate
Interoperability from an End-user Perspective:
 Adequacy: are the messaging functions supported by this
infrastructure/standard, adequate for my specific eBusiness needs?
 Maturity: is the software product offering (commercial, OSS) mature
enough for my deployments? Do they interoperate well?
 Integration: do products offer the integration capabilities my backend applications need?
 Concept validation: what would an end-to-end Solution look like, for
my problem?
14
World Class Standards
The PlugTest Participants
 eB/eG Application Domain Experts (Public sector, Industry
sectors, Health, Retail…)
 Product Providers
 Commercial
 Open Source
 eB/eG Test Experts
 Testbed engineers
 Test suite developers
Support
team
 ebXML/WS experts
15
World Class Standards
Application Domain Teams
Support
Team
Standards
Experts
(ebXML, WS)
Application
Domain
“Health Care”
Team
Application
Domain
“Invoicing”
Team
Application
Domain
“eGov”
Team
assist
assist
Software
providers
Testbed
team
16
World Class Standards
Interoperability Test Plan
 Step 1: Every Application Domain (AD) team defines an
Interoperability Objective
 Based on a real business use case
 Bus docs, transactions, messaging QoS
 Step 2: Standards Expert team review, advise
 Step 3: software providers advise on architecture of
POC
 Step 4: implementation of the Use Case
 Step 5: testing, and iterate again over previous steps as
many times as necessary
17
The Korbit test bed
Footer text (edit in View : Header and Footer)
World Class Standards
KorBIT::Coverage & Vision
SUT Type
Current Supports
Future Supports
Messaging
ebMS 2.0/3.0
RAMP profile W/S
Generic W/S
Document
Schema design quality
Content validation
Information mapping
Semantics mapping
Transaction
(Process)
N/A
ebBPSS
WS-BPEL
Infrastructure
N/A
ebReg/Rep
UDDI
19
World Class Standards
KorBIT::Test Framework (ATF)
Test Execution Model
Service call
TVI
TRI
Test
Service
TSE
Test
Report
WS-BPEL
TMC
Message out
MEI
TCE
Extractor
ETSL
Test Case
Message in
Interface
Non-stationary
Component
Stationary
Component
Internal
invocation
Dynamic
invocation
Document
20
World Class Standards
KorBIT::Test Case Generation
Test Metadata
User Environments
Standard Specification
Derived from
Derived from
User Requirement
Test Requirement
Referred
to
Implement
Abstract Test Case
Abstract Test Suite
Based on
Test Procedure
Test Assertions
Configurations
Transform to
Executable Test Suite
Executable Test Case
Composed of
Verification
Script
Test Harness
Test Sequence
Test Data
21
World Class Standards
KorBIT::Test Orchestration
App. A
App. B
Test case
Initiate Test
(2) Mediate
Receive Message (A)
(Notify & Transfer)
(3) Notify
(1) Initiate
Transfer Message
(4) Validate
Receive Message (B)
Test
Driver
Message
validator
Verify App. A & B
Intermediary Testbed
22
The NIST test bed
Footer text (edit in View : Header and Footer)
World Class Standards
Testing Capability: Application Information Mapping Test
Bed
 Purpose: Verify the mapping between the application’s internal
representation and the data exchange specification (i.e., an XMLbased business document specifications)
APP
STEP
XML Message
XML Message
OASIS
App
Date
+
Time
Date
Employee
Person
Person
Person
Null
0
24
World Class Standards
Message guideline
XML schema
specification for a
message
Making Test Specification
Semantic Constraints
Test Cases
Message Instances
and Validation
Conditions
Test Data
Specification
Occurrences examples:
Header-level ship-to: Occur(1,
/aiag:SyncShipmentSchedule[4]);
Line-level ship-to: Occur(0,
/aiag:SyncShipmentSchedule[4]/*/*/aiag:ShipmentSchedule
Line[1]);
Test data metadata examples:
DUNSID of the ship-to party: UserSpecified(876598675);
Document date and time: DateTimeBefore(PT10M);
Test Purpose
Test Requirement: Check the mapping of the ship-to
information when the oa:ShipToParty is omitted at the line
level and the oa:ShipToParty is present in the header section
25
World Class Standards
26
World Class Standards
A Testing Application Business Case:
Inventory Visibility e-Kanban Process
 Project Sponsored by Automotive Industry Action Group (AIAG)
 eKanban = “Electronic Kanban”
 Cross-partner Business Process
 Defined by AIAG
 POC Implements eKanban
 With Next Gen XML Messaging technology
 Variety of Participants
 Major OEMs
 Suppliers
 Multiple IT Vendors
27
World Class Standards
An Application of the Test Bed:
An e-Kanban Transaction Interoperability
Trading Partner C
GM
c
GM Legacy App
Trading Partner A
SyncShipmentSchedule
Information
Mapping
Test
Tier 1 Supplier to GM
c
Apolon IV Tool
c
SyncShipmentSchedule
Information
Mapping
Test
SyncShipmentSchedule
Information
Mapping
Test
Trading Partner B
Tier 1 Supplier to GM
Tier 2 Supplier to Tier 1
FTH IV Tool
28
World Class Standards
Examples of Test Results
SUTs
(IV Tools)
Conformance Max Kanban Loops Per
Issues Message (1..*)
Max Kanbans per loop
(1..*)
Kanban number format
(string)
GM Legacy
1..1
1..1
String
Apolon
1..1
1..*
Integer
Ford Test Harness
1..*
1..*
String
Interoperability Profile
1..1
1..1
Integer
Examples of other issues found:
• Mapping rules between ID & SchemeAgencyID and DUNSID were incorrect
• Mapping rules or transformation engine has an issue when mapping multiple
kanbans
• ATHENA transformation tools are stateless, i.e., they do not maintain any prior
information thus it cannot, for example, help fill in sequentially generated
information such as document ID
29
World Class Standards
Workshop
 A workshop will be held during the same week and at the same
place:
 To show participants the benefit of Interoperability and conformance
testing,
 Testing partners (e.g. Korbit, NIST) to present their solutions with use
cases,
 To show and comment results of the ongoing Plugtests,
 ETSI to present its testing methodologies related to standardization
 To match the interest of participants on inter-operability issues
and the testing solutions.
30
World Class Standards
Benefits for Application Domain Teams
 Hands-on understanding and assessment of the technology and
standards over a real use case.
 Limitations, best practices
 Immediate help FROM standards experts and software providers
on a personalized solution design.
 Very quick feedback TO standards experts, product providers
about user requirements.
 Acquire leadership to jump-start a general solution design for
their domain, and profiling of the eB technology for their app
domain.
 Discuss and share best practices with teams from other
domains.
31
World Class Standards
Benefits for Product Providers
 Exposure to requirements from User Communities,
acquire advantage over competition.
 Verify the value and relevance of their product features
with users, over real use cases.
 Live feedback to standards committees representatives
for future specification improvements.
 Verify interoperability and composability of their products.
32
World Class Standards
Next steps
1. Event planed in Q1 2008
2. ETSI Plugtests web pages to be published during summer.
3. Maintain the relationship and keep support from communities
and partners
4. Seek for participants from application and platform vendors
5. Seek urgently for Key account vendors in B2B area.
6. Communicate widely on the Plugtests event.
7. Improve continuously test plan
33
World Class Standards
Communities to support the Plugtests
 To target following communities (not excluding other
ones)
 Automotiv
 BoostAero
 DGME (France)
 eExport project for cosmetic
 GS1
 HL7
 Inventory management project
 OASIS
 RosettaNet
 To be extended ….
34
World Class Standards
Partners
 Special thanks to partners:
 Fujistu Siemens
 Korbit
 NIST
 We expect extending this list in the next weeks!!
35
World Class Standards
Questions?
Contacts:
 Francois FISCHER: [email protected]
+33 4 92944330
 Philippe COUSIN: [email protected]
+33 4 92944306
 Feel free to contact us
 Distribute this information to all interested parties.
36