Transcript E-2D Advanced Hawkeye Lessons Learned from Integrated Test (IT) Rick Quade Navy T&E 10 March 2010

E-2D Advanced Hawkeye
Lessons Learned from Integrated Test (IT)
Rick Quade
Navy T&E
10 March 2010
1
Agenda
•
•
•
•
•
Program Overview
IT Challenges
Implementation of IT
IT Self Assessment
Keys to Success
2
E-2D Advanced Hawkeye Program
ACAT: ID
M/S:
MS B June 03, MS C May 09, IOT&E FY12, IOC FY15
Contractors:
Northrop-Grumman as Total Weapon System Prime
Lockheed-Martin as Radar Principal Subcontractor
Flight Test Program Phases
• SDD – 2 SDD Aircraft, ~2000 Flt Hrs
• Apr 2007
• Pilot Production Verification – 3 Aircraft, ~800 Flt Hrs
• June 2010
• IOT&E – 4 Aircraft, ~1000 Flt Hrs
• FY12
E-2D Integrated Test Team (ITT)
• 100+ engineers and project officers
3
E-2D Test Organization
ISEET/VX-20
Integrated Test Team (ITT)
Operational Test
Coordinator
AHE T&E IPT
PMA-231, NGC
COTF
LEGEND
Use of Test Site Specific
Facilities or Services
Operational Test
Director
VX-1
CFTD/GFTD
Test Director
Aircraft
Coordinators
A/C Maintenance
& Quality Control
SAMC, VX-20
LTE
Aircrew
(Pilots)
Logistics/
Supply
Safety Dept.
DCMA, VX-20
Flight Operations
SAMC,VX20
Air
Vehicle
Test Engineering*
Mission
System
Test Engineering*
Aircrew
(WSOs & NFOs)
Data Reduction/
Management
Test
Facilities
Instrumentation
Engineers &
Techs
Reliability &
Maintainability
Engineering
Safety Officer
* Including Aircrew Performing
Test Planning and Data Reduction
and Analysis Functions
FCRA
4
Test Environmental Factors
• E-2D complex weapon system with extensive amount of
flight testing
– Mission Systems - ~225 successful flights (SDD)
– Air Vehicle - ~125 successful flights (SDD)
– 25+ Test Plans (SDD)
• Many moving parts (Staff, HW/SW, DRs, Management)
• Large and diverse test team comprised of NAVAIR
(5.1.1, 5.1.2, 5.1.6, VX-20, 5.2, 5.4, CSS), Northrop
Grumman, Lockheed Martin, VX-1, COTF and others
• Typical program and flight test challenges
5
E-2D IT Challenges
•
•
•
•
•
•
•
•
DT, OT and Program Organizational Barriers
“I’ve got a secret”
Expectations Management
Staffing/Turnover
Spec Compliance vs Suitability
Legacy vs Program of Record
Weapon System Maturity
Leveraging/Integrating DT/OT efforts
IT touches all aspects of program execution.
6
E-2D IT Implementation
• PMA embraced T&E role in program execution
– Multiple 5.0 T&E Deep Dives of test program
– Conducted an Independent T&E Review to identify test risks
– Program unilaterally added an Operational Assessment (OA)
• Focused on improving internal/external communications
– Monthly meetings with VX-1 (OTA)
– Weekly reports and metrics to stakeholders & leadership
• Embraced early and robust OT participation
– OA Report mitigation plans pre-coordinated
– OT concerns included in update to CDD
– OT part of program management team
• E-2D ITT CONOPS implemented to document roles,
responsibilities and procedures
– Signed by NGC, PMA, DT (VX-20), OT(VX-1) and DCMA
7
E-2D IT Implementation (Continued)
• Early and continuous participation by all stakeholders
(DT, Cont and OT) on test DT planning and execution
– Test planning working groups
– Discrepancy reporting/NTAB Yellow Sheet Reviews
– Technical Reviews
• Integrated Test Planning & Execution
– DT/OT Test Point Matrix for Pilot Production/IOT&E testing
– OT Test Planning – coordinate with program, risk reduction
– Integrated flight schedule w/OT crews
• Efficient use T&E Infrastructure/Capability
– Telemetry Trailer, targets, labs
– Data/data analysis personnel used by DT and OT
• Northrop-Grumman Support
– Embraced early OT involvement and feedback
– Willing to discuss and mitigate relevant OT issues
8
E-2D IT – Self Assessment
• Contractor data augmenting IOT&E data
– OA Report leveraged significant amount of data collected
during DT
• DT and OT personnel recognize each other in airport
• OT personnel influence DT scenarios
– OT part of planning process, common goal of leveraging “DT”
flights to meet OT objectives
• DT system operated by OT users
– Monthly flt hr goals for OT team, DR verification
• DT and OT sharing data in common format
• OT confirms DT results
– OA Report did not identify any new issues
9
E-2D Awards and Recognitions
• CY2007
– NAWCAD Commander's Award for 2007
– VX-20 Test Team Award 2007
• CY2008
– NAWCAD Commander's Award for 2008 for Individual Effort for Mr. Pat
Svatek
– Society of Flight Test Engineers' International Flight Test Team of the
Year 2008 (James S McDonnell Award)
– Daedalian Weapons Systems Award: Colonel Franklin C. Wolfe
Memorial Trophy
– VX-20 Test Team Award 2008
• CY2009
– NAWCAD Commander's Award 2009
– Society of Flight Test Engineers’ 40th International Symposium Best of
Symposium Award for E-2D ACAWS Team
– European Flight Test Safety Award for 2009
– E-2/C-2 Shore Pilot of the Year – LT Greg Machi
– E-2/C-2 Shore NFO of the Year – LCDR Matthew Tharp
10
E-2D IT Keys to Success
• Set Expectations
– Known roles & responsibilities, big picture awareness
• Open Communication
– Create forums for discussion, education and decision making
– No secrets or surprises, transparency expedites issues resolution
• Common Goals & Objectives
– Deliver weapon system to war fighter with known performance
• Robust Conflict Resolution Process
– No one has to agree, resolve conflicts at lowest level possible
• Demand Constructive-Tension/ Positive-Friction
– Disagreements are expected, know when to move on
• Embrace value of robust T&E program
– Program leadership values T&E and solicits input
– T&E’s job is to inform the PM and decision makers
11