Transcript Simulation Needs for Cyber Analytics

Simulation Needs for
Cyber Analytics
28-30 October
PNNL-SA-63095
1
Introduction
• Simulation Group Leads
– Sandy Thompson
– Laura Nolan
2
Overview
• One of the Discipline Groups
• Group will
– examine the analytical issues from the tracks
– Identify issues that simulation can help address
– Propose simulation solutions to address issues
• DCO session goal is to identify
–
–
–
–
Current capabilities
Requirements
Capability needs
General Information
3
Please rate (high, med, low) how
Simulation is doing in…
Tracks
Overall
Well defined
need
Requires
research
Importance
Cyber Environment
& 4th Gen
Cyber Situational
Awareness & C2
Cyber Defense
Cyber Exploitation
and Offensive Ops
Cyber Deterrence
DoD Cyber Policy
4
Current Capabilities
• What are current simulation tools?
• Characteristics of good tools
– Fidelity,
– Ease of use,
– Cost, ...
• Should tools be accredited by IO JMEMS?
• What sort of V&V is/should be required for
Cyber Simulation tools?
5
Simulation Questions
1. What variables need to be accounted for in
simulations?
–
–
–
–
–
–
–
–
Human interfaces with networks
Applications (email, chat, VTC, …)
Data packets
Data flows
Network characteristics (bandwidth, routes, …)
Defensive countermeasures
Adversary activities (tools, culture, decisions, …)
Mission and Campaign impact (translation from
technical effect)
– Second and third order effects (connected systems)
6
Simulation Questions
2. What systems should be simulated and
where?
– Computer network
– Critical Infrastructures
– Process control systems
– Others
– On the IO Range
– Other ranges and testbeds
7
Simulation Questions
3. Who is the target audience for cyber simulations?
–
–
–
–
–
–
Network/Software/Hardware designers
Network builders
System administrators
Cyber Ops planners and decision makers
Campaign analysts
Other analysts (Cyber Ops, vulnerability, network, system-ofsystems, …)
– End-host users
– Business managers
– POM
• Justification for funding requires translation from “geek-speak,”
transparent methodology, and clear return on investment
– …
8
Requirements for Simulation Tools
• What sets of requirements are applicable?
– Air Force
– IO JMEM
–…
• What requirements should be added?
9
Needed Capabilities
• Areas in need of simulation
– Campaign-level meaning
• Prototype tools
• Restrictions on cyber simulation
– Minimal data (SAP/SAR/uncollected)
• Accreditation process
– What should be included
– Who should lead or participate
10
General Needs
• Identify organizations who fund cyber
simulation research
• Identify organizations who do or would be
interested in cyber simulation research
11
What are we missing?
12