Transcript The Network and Combat Power

Information Superiority Workshop II:
Focus on Metrics
Groups I and II:
Attributes and Metrics for
Awareness and Shared Awareness
Group Chairs:
John J. Garstka, JCS/J6Q
Dr. Richard Hayes, EBR, Inc.
Dr. Larry Wiener, OPNAV/N6C
Final Report: 5 July 2000
1
Overview
•
•
•
•
Conceptual Framework and Definitions
Reference Model
Application of the Reference Model
Summary
2
Conceptual Framework
• A Conceptual Framework provides:
– Way of thinking about Information/IS/NCW
– Language to talk about Information/IS/NCW
– Set of measures to quantify the nature and impacts of
Information/IS/NCW
• A Conceptual Framework accelerates progress
and helps us get the most out of experiments
and research activities
• A “Reference Model” is a key component of a
conceptual framework
3
Terms of Reference
Attribute of Interest:
• Variable that is key to understanding.
Metric:
• An operational definition of an attribute.
Measure:
• A specific application of a metric.
Standard:
• The agreed to unit of and approach to
speed
distance per unit time
mph, kph
mph in U.S.
measuring an attribute.
Indicant:
• A surrogate measure used for
air pressure
practical reasons.
Value
• A relative measure of worth
value of time
4
Battlespace
Information
Awareness
Knowledge
• Battlespace Information results from the fusion of key
elements of information which characterize the battlespace
– Explicit Information (e.g. position of forces, geography, and
weather)
– Requires Little Interpretation
– Can be communicated quickly and easily
• Battlespace Awareness involves the identification of
patterns in the situation derived from perceived Battlespace
Information and a priori Knowledge
• Battlespace Knowledge yields predictive ability
– Extrapolation of situation awareness
Requires Knowledge-Based Processes and Workforce
5
Candidate Definition
• Relative Information Advantage
– An advantage that one force establishes over
another force in the information domain.
– The advantage is not measured in an
absolute sense, but rather with respect to the
information needs of both forces
– Metrics are applicable at the tactical,
operational, and strategic level
6
Candidate Definition
• Tactical Information Superiority
– The ability to establish and maintain a relative
information advantage in a specified area of the
battlespace, for a specified period of time, in
support of a specified mission area
7
Overview
•
•
•
•
Conceptual Framework and Definitions
Reference Model
Application of the Reference Model
Summary
8
Domains
World View
Body of Personal Knowledge
Experience/ Training
Individual Capabilities
Situation
Knowledge of Situation
•Understanding
Human
Information
Perception
•Awareness
•Assessment
Data
Reality
9
Reference Model: Conceptual Framework
The Cognitive Domain
The Information Domain
The Physical Domain
10
Reference Model: Conceptual Framework
The Cognitive Domain: Perception of Ground Truth
Based on Interaction with Information Domain
and Direct Observation of Physical Domain
The Information Domain
“Paper Format”
“Digital Format”
The Physical Domain: “Ground Truth”
11
Reference Model: Conceptual Framework
The Cognitive Domain:
Shared Awareness
The Information Domain
Shared Information
The Physical Domain: “Ground Truth”
12
Reference Model: Conceptual Framework
Blue Cognitive Domain
Blue
Blue Information Domain
Relative
Information
Advantage
Red
The Physical Domain:
Competitive Advantage - Combat Power
Red Information Domain
Red Cognitive Domain
13
Reference Model: Conceptual Framework
Blue Cognitive Domain
Relative
Information
Advantage
Blue Information Domain
Defensive
Info Ops
The Physical Domain
Offensive
Info Ops
Red Information Domain
Offensive
Info Ops
Red Cognitive Domain
14
Reference Model: Conceptual Framework
Blue Cognitive Domain
Blue Information Domain
Relative
Information
Advantage
“The Situation”
The Physical Domain
Red Information Domain
Red Cognitive Domain
15
Reference Model: The Situation
• Awareness is a Perception of the Situation
Time & Space
Capabilities & Intentions
The Situation
M
i
s
s
I
o
n
Red
Blue
Other
Opportunities & Risks
E
n
v
i
r
o
n
m
e
n
t
• Levels of Awareness
– entities, relationships, the patterns and implications
16
Reference Model:
Components of Situational Awareness
Patterns
Capabilities
Applied
Knowledge
Blue Estimate
of Adversary
Intent
Risk
Personal
Situational
Subjective
Awareness
“Assessment”
Tactics,
Techniques,
Procedures
Decide
Opportunities
Cognitive
Domain
Training
State
Information
on Objects
Objects
Act
Information
Domain
Physical
Domain
17
Reference Model: Domain Relationships
Cognitive
Domain
Shared Awareness
Information Sharing
Direct
Sensing
Information
Domain
Indirect
Sensing
Reality
Action
18
Reference Model: Shared Awareness
Shared Awareness
19
Reference Model: Collaboration
Collaboration
Information Sharing
20
Reference Model: Synchronization
Shared Awareness
The Plan
Synchronization
21
Reference Model: Self-Synchronization
Shared Awareness
Intent
Information Sharing
Self-Synchronization
22
Reference Model: Self-Synchronization
Shared Awareness
Self-Synchronization
23
Reference Model: Detailed View of Tactical Level
Awareness
Human 1
Cognitive
Domain
View 1
Data 1
Cognitive Domain
Digital
Info
Domain
Com: Voice
Information
Domain
Com: Data
Organic
Sensors
Physical Domain
24
Reference Model: Detailed View of Tactical Level
Shared Awareness
Cognitive Domain
Digital
Info
Domain
Com: Voice
Digital
Info
Domain
Data 1
Shared
Information
Com: Voice
View 1
Cognitive Domain
View 1
Cognitive Domain
Data 1
Human 1
View 1
Human 1
Data 1
Human 1
Digital
Info
Domain
Com: Voice
Com: Data
Com: Data
Com: Data
Organic
Sensors
Organic
Sensors
Organic
Sensors
Physical Domain
25
The Information Domain
Information
“Richness”
• Content
• Accuracy
• Timeliness
• Relevance
..
.
NetworkCentric
Operations
Platform-Centric
Operations
Information
“Reach”
Richness and reach were introduced by Phillip B. Evans and Thomas S. Wurster, “Strategy and the New Economics of
Information,” Harvard Business Review, September-October 1997.
26
Richness and Reach
• Information Richness is an aggregate measure
of the
– Quality of Battlespace Information, and
– Quality of the interactions among entities
• Information Reach is an aggregate measure of
the degree to which Information is shared
Richness and reach were introduced by Phillip B. Evans and Thomas S. Wurster, “Strategy and the New Economics of
Information,” Harvard Business Review, September-October 1997.
27
Information Domain: Attributes of
Information Richness
Information
Completeness
Information
Commonality
and Consistency
Information
Timeliness
“When”
Richness of Interaction
(Voice / Data / Video)
Trust and Confidence
in Information
Information
Relevance
“Why”
Object State Information
- Identification
“What”
Information
- Classification
Accuracy
“Who”
- Location
“Where”
28
Example Information Richness Attributes
for a Single Integrated Air Picture (SIAP)
• Completeness. The percentage of real tracks that are
included in the SIAP.
• Correctness. Data accurately reflects true track attributes
(position, kinematics, and identity).
• Commonality. Track attributes of shared data are the same
for each SIAP user.
• Continuity. Proper maintenance of track attributes over
time.
• Timeliness. Data is where it is needed, when it is needed.
Source: Representative Measures of a Single Integrated Air Picture (SIAP)
29
Information Domain: Attributes of
Information Reach
Access
(Search/Navigation)
Geographic
Range
of Sharing
Sharing By
Number of
Nodes
Sharing By
Allied / Coalition
Sharing
By Component /
Echelon
Sharing by Availability
(24x7)
Capability for
Multi-actor Interactions
Sharing By
Security Level
30
Overview
•
•
•
•
Conceptual Framework and Definitions
Reference Model
Application of the Reference Model
Summary
31
Application of the Reference Model
• Mission Area: Air-to-Air
• Information needs are approximately symmetric
– Both forces require relevant information to engage
– Relevant information consists of object state information
• Identification
• Classification
• Engage quality information (Precise Position Location)
– Synchronization and coordination of tactical actions
requires information sharing by voice or data link
32
Air-to-Air Mission with Tactical Data Links
Information
“Richness”
• Content
• Accuracy
• Timeliness
• Relevance
..
.
* Link-16: Shared Battlespace
Awareness
* E-3 AWACS
* F-15C
NetworkCentric
Operations
Platform-Centric
Operations
Information
“Reach”
33
Mission Area: Air-to-Air
The Tactical Situation
Adversary
Aircraft
Blue Aircraft’s
Organic Sensor
X
X
X
X
X
X
Blue Aircraft
34
Reference Model: Air to Air Mission
Shared Awareness
Cognitive Domain
Data 1
Shared
Information
Digital
Info
Domain
View 1
Cognitive Domain
View 1
Human 1
Data 1
Human 1
Digital
Info
Domain
Com: Voice
08
400
450
09
10
5
1500
5
1000
500
500
5
5
10
10
X FRIENDLY
TARGET
Com: Voice
Com: Data
Com: Data
Organic
Sensors
Organic
Sensors
Physical Domain
Heads-up Display with
Platform-Centric
Operations
Warfighter “View”
which results
from sharing info
via voice only
communications
35
Reference Model: Air-to-Air Mission
Shared Awareness
Cognitive Domain
Data 1
View 1
Cognitive Domain
View 1
Human 1
Data 1
Human 1
Heads-up Display with
Network-Centric
Operations
08
400
450
10
Digital
Info
Domain
Com: Voice
1000
X
X
5
XX
10
X FRIENDLY
TARGET
Com: Voice
Com: Data
Com: Data
Organic
Sensors
Organic
Sensors
Physical Domain
1500
5
500
5
Shared
Information
10
500
XX
Digital
Info
Domain
09
5
Warfighter “View”
which results
from sharing info
via voice and data
communications
36
Application of Richness Attributes
and Associated Metrics
• Relevant Information
– Information on Blue, Red, and Neutrals within
a specified distance “R”
– Object State Information
• Precise position location information
• Identification
• Typing
• Completeness measured as percentage of
objects “mapped” to information domain
37
Measuring a Relative
Information Advantage
Case Where Info Needs are Approximately Symmetric
100%
Blue Info Position
Blue
Y: Percentage of Own Force
Correctly Typed and Tracked
within Sphere of Radius R1
R1
*
(xB, yB)
Y
*
Red
Red Info Position
0
Info Advantage = f ((xB, yB), (xR, yR))
Blue/Red
Info Needs
(xR,
yR)
X
100%
X : Percentage of Adversary Force
Correctly Typed and Tracked
38
within Sphere of Radius R1
Air-to-Air Mission with Tactical Data Links
F15-C Air Ops: Active Missile Counter Tactics
Without JTIDS/With JTIDS
• Information Advantage
• OODA Loop
• Kill Ratio
Voice Only vs. Shared Tactical Picture
Baseline Compressed with Self-Synchronization
3.10:1 vs. 8.11:1 (2.6 x increase)
The Bottom Line:
JTIDS Operational Special Project
demonstrated networked air crews
fighting with shared awareness
could increase combat power by
over 200 %
Source: JTIDS Operational Special Project - Report to Congress, Dec 97
39
Translation of an Information Advantage
To Increased Combat Power
Velocity
of Info
Data
Network
Awareness of Blue (Y)
Voice
Network
Awareness of Red (X)
3.10:1 *
8.11:1 *
Self Synch
Kill Ratio
2.6 x increase
OPTEMPO
40
Extracts from JTIDS Operational Special
Project Report to Congress (Cont.)
• Operational Effectiveness
Kill Ratio
– Active Missile Counter Tactics, Fall 1996
• Non-JTIDS equipped aircraft vs. adversary
• JTIDS equipped aircraft vs. adversary
3.10.1
8.11.1
2.61 x increase
– Night Composite Force Tactics Development
and Evaluation, Spring 1997
• Non-JTIDS equipped aircraft vs. adversary
• JTIDS equipped aircraft vs. adversary
3.62:1
9.40:1
2.59 x increase
41
Extracts from JTIDS Operational Special
Project Report to Congress (Cont.)
• Air Combat Command Project Order: 92-035TF
• Operational Special Project Details
– 19,400 flying hours
– 12,500 sorties
– Multiple Missions with F-15C
• Basic 1-on-1 flight maneuvers
• 8 vs. 16 defensive counter air and offensive counter air
– Missions were flown as part of normal training sorties
– Duration: 20 Sep 93 - 30 Apr 97
42
Extracts from JTIDS Operational Special
Project Report to Congress
Section 4.3: Tactics Adaptation and Section 5.0: Conclusions
• Situational Awareness drastically increased with data links due to
continual positional awareness of friendlies and adversaries which
reduced the need for radio communications. This greatly increased the
accuracy of targeting threat aircraft.
• Each flight member was able to see the disposition of flight members,
regardless of their separation.
• This shared awareness made split tactics easier, led to greater flight
effectiveness and afforded quicker rejoins when desired.
• The mutual support enhancements proved even more significant
against a non-equipped adversary in night and weather conditions
since the adversary formation either had to stay together or
substantially degrade mutual support.
• When voice was used, the pilots often referred to common picture
making the voice more meaningful.
43
Extracts from JTIDS Operational Special
Project Report to Congress (Cont.)
• In testing with the data link, a perfect sort was routine with four (and
two) ship flights. This had strong positive implications concerning
first pass kill results, fighting outnumbered, survivability and cost
effectiveness in employing expensive aircraft/missiles. When an F-15
inadvertently locked on to another flight member, the error was
graphically displayed (by the lock line going to the friendly fighter)
and the pilot lost little time in determining the error and avoiding
possible fratricide)
44
Extracts from JTIDS Operational Special
Project Report to Congress (Cont.)
• OSP Message Formats
– Precise Participant Location and Identification (PPLI) and status
information, displayed to the F-15 pilots and AWACS operators,
about the identification, position, fuel, weapons, etc. of all Link 16
equipped aircraft
– Track/target reports which convey location and ID information
about aircraft (and other platforms) and potential targets
– Weapons coordination and target assignments
– Sensor reports (including primary target and missile in flight)
provided by shooters (e.g., fighters).
– Limited intelligence derived information
45
Overview
•
•
•
•
Conceptual Framework and Definitions
Reference Model
Application of the Reference Model
Summary
46
Summary
• The IS/NCW Conceptual Framework and Reference Model
developed and refined as a result of IS Workshop II provide
a methodology for:
– More precisely defining attributes and metrics for the
information domain
– Describing relationships between the physical,
information, and cognitive domains
– Measuring an information advantage
• The utility of this methodology for providing insight into
the relationship between an information advantage and
combat power was demonstrated in the successful
application of these tools to the Air-to-Air Mission.
47
Back-Up Slides
48
SIAP Cont.
(3) The mean range at which initial detection (by sensor type: Search radar,
Fire control radar, ESM, IFF, Visual, etc) was made compared to the
predicted range (considering RCS, environmentals, radar Horizon, etc).
(This is a chart)
 [range at which detection of the vehicle/formation was made (by sensor) in a
given environment
divided by the predicted sensor detection range of the vehicle/formation (in a
given environment)]
divided by
# of vehicles/formations
Note: Multiple objects that are part of a formation not discriminated by the force
sensors will be counted as only one ground truth vehicle (until the formation
breaks)
49
SIAP Cont.
c. Attribute: Correctness
(1) Percentage of time tracking false tracks (for each individual unit and for all links)
 the duration of all false tracks
 the duration of all tracks
(2) Mean track positional accuracy/errors of sensors
 of the difference between sensor positional and kinematics data of air and space
vehicles and the 3D positional and kinematics truth data for air and space vehicles
divided by # of track updates
(3) For false tracks, mean time from Track Start to Drop Track tracks (for each individual
unit and for all links)
 [Time (Drop track) minus Time (Track Start)]
Number of false tracks
50
Shared Awareness
Situation
“Physical Domain”
Organic
Sensors
Organic
Sensors
Organic
Sensors
Organic
Sensors
Information
Domain
Information
Domain
Information
Domain
Information
Domain
View 1
View 2
View 3
View 4
Cognitive
Domain
Cognitive
Domain
Cognitive
Domain
• Intel
• Intent
Cognitive
Domain
Human 1
Voice
Human 2
Voice
Human 3
Shared Awareness
Voice
Human 4
51
Shared Awareness
Situation
“Physical Domain”
Organic
Sensors
Organic
Sensors
Organic
Sensors
Organic
Sensors
Information
Domain
Information
Domain
Information
Domain
Information
Domain
View 1
View 2
View 3
View 4
Cognitive
Domain
Cognitive
Domain
Cognitive
Domain
Cognitive
Domain
Human 1
Human 2
Human 3
Human 4
• Intel
• Intent
Shared Awareness
52
SIAP Cont.
Critical Operational Issue (COI) #2:
Evaluate the Naval Force’s capability (operating independently or as
part of a Joint/Combined Force) to detect and maintain a single and
continuous track on each air and space vehicle within the assigned
battlespace.
A. Measure of Effectiveness (MOE ) #1:
Determine the capability of the Naval Force to detect and create a
firm track for each air and space vehicle within the assigned
battlespace.
1. Measures of Performance (MOP) Follow:
53
SIAP Cont.
a. Attribute: Completeness:
(1) % of air and space vehicles detected in the assigned battlespace
Number of Air & Space Vehicles detected
Number of Ground Truth Air & Space Vehicles
(2) Mean % of time an air or space vehicle was detected and tracked in
the assigned battlespace
 Time air or space vehicle/formation was detected and tracked
divided by
 Time air or space vehicle/formation was in the assigned Battlespace
54
SIAP Cont.
b. Attribute: Timeliness
(1) Mean time from air or space vehicle entry into the assigned
battlespace to initial detection by each unit
Max [(Time initial detection was made minus time air or space
vehicle/formations entered the assigned battlespace),0] divided by
Total number of vehicles/formations
(2) Mean time to firm track
[ [Time (Track transitioned to firm track)]
minus
[Time (Initial Detection was made)]
Total number of vehicles]
55
Candidate Definition
• Operational Information Superiority
– The ability to establish and maintain a relative
information advantage for a specified period of
time at the operational level of war
– Example: Operation Overlord: Allied Invasion
of Normandy in June of 1944.
56
Example: Progressive Degradation
* Data Link
Information
“Richness”
* Voice
Information
“Reach”
57