Transcript Slide 1

Situational Awareness for Fire
Fighters (SAFIRE)
Sharad Mehrotra
Professor of Computer Science
SAFIRE: Situational Awareness for Firefighters
SAFIRE Team

Faculty



Sharad Mehrotra
Nalini
Venkatasubramanian
Researchers,
Engineers,
Programmers





Naveen Ashish
Chris Davison
Dmitri Kalashnikov
Jay Lickfett
Imagecat Inc.




Graduate Students







SAFIRE: Situational Awareness for Firefighters
Paul Amyx
Charlie Huyck
Ron Eguchi
Subin Anthony
Stefano Bonetti
Chiara Chiappini
Jeffrey Hu
Dani Massaguer
Ronen Vaisenberg
Bo Xing
Outline


Center for Emergency Response
Technologies
SAFIRE Project


Goals, concept, deliverables, core research areas
Progress & Timeline



SAFIRE system
Research
Testing & validation
SAFIRE: Situational Awareness for Firefighters
Bren School Center for Emergency
Response Technologies
Established in 2007 by the School of
Information and Computer Sciences
SAFIRE: Situational Awareness for Firefighters
CERT Mission

lead research, technology development &
coordination of ongoing projects on role of IT
to improving emergency response.

Provide a forum for collaboration between
academia, industry, and government
agencies.
SAFIRE: Situational Awareness for Firefighters
5
CERT Research

Robust computing, communication, and
storage infrastructure


Graceful performance degradation under extreme
loads, catastrophic failures, surge demands
Real-time Situational Awareness from
multimodal inputs to support decision
making

Diversity of information sources, modalities, and
needs, uncertainty in data, challenge of scale
SAFIRE: Situational Awareness for Firefighters
CERT: Current Projects

NSF funded Responsphere Infrastructure


NSF funded ITR-RESCUE


Funded by NSF through research infrastructure program
(1.8M, 2004-2010)
Funded by NSF through its large ITR program (12.5M,
2003-2009)
DHS funded SAFIRE project

Funded by DHS through FEMA fire fighter safety program
(1M, 2008-10).
SAFIRE: Situational Awareness for Firefighters
7
CERT: Infrastructure
1/3 of UCI
sensing,
communicating,
storing, and
computing
infrastructure
with
~ 300 sensors of
~ 10 types,
several comms
nets:
SAFIRE: Situational Awareness for Firefighters
8
~200 indoor net
cameras (with
mics), ~30 MicaZ
motes (with light,
acoustic,
acceleration,
magnetic, etc
sensors), ~6
people counters,
~6 mobile cameras
, RFID readers,
outdoor cameras,
gas sensor, mesh
routers, 802.11
(Wi-Fi), Ethernet,
power-line comms,
802.15.4 (Zigbee),
mobile sensing
platforms, storing
server, computing
servers, PCs,
laptops,
cellphones, PDAs,
etc.
CERT Industrial Partners
5G Wireless
Broad-ranged IEEE 802.11
networking
Apani Networks
Data security at layer 2
Boeing
AMD
Compute Servers
Asvaco
1st responder (LAPD), and threat
analysis software
Canon
Community Advisory Board
Member
Visualization equipment SDK
Convera
Cox Communications
Software partnership
Broadcast video delivery
D-Link
Ether2
Camera Equipment and SDK
Next-generation ethernet
IBM
ImageCat, Inc.
Smart Surveillance Software (S3)
and 22 e330 xSeries servers
GIS loss estimation in emergency
response
Microsoft
Printronix
Software
RFID Technology
The School Broadcasting
Company
Vital Data Technology
School based dissemination
Walker Wireless
SAFIRE: Situational Awareness
for Firefighters
People-counting
technology
Software partnership
CERT Government Partners
California Governor’s
Office of Emergency
Services
California Governor’s
Office of Homeland
Security
City of Champaign
City of Dana Point
City of Irvine
City of Los Angeles
City of Ontario
Fire Department
City of San Diego
Department of Health and
Human Services – Centers
for Disease Control
Lawrence Livermore
National Laboratory
Los Angeles County
National Science
Foundation
Orange County
Orange County Fire
Authority
U.S. Department of
Homeland
Security
SAFIRE: Situational Awareness
for Firefighters
Outline


Center for Emergency Response
Technologies
SAFIRE Project


Goals, concept, deliverables, core research
areas
Progress & Timeline



SAFIRE system
Research
Testing & validation
SAFIRE: Situational Awareness for Firefighters
SITUATIONAL AWARENESS FOR
FIRE FIGHTERS (SAFIRE)
Improve the safety of firefighters by
providing decision makers with greatly
improved situational awareness during
response activities
SAFIRE: Situational Awareness for Firefighters
Varying Situational Awareness Needs
& Technological Requirements

1st responders @ crisis site



IC @ crisis site
SAFIRE



dangers, hazmat in vicinity, ingress/egress routes, status of equipment,
victim location
Technology Needs: information to enable immediate action,
knowledge of surroundings, role-specific and fine granularity data
Accurate assessment of the ongoing situation, response monitoring, and
on-site planning
Technology Needs: mechanisms to monitor onsite, site-level
granularity, information assimilation, decision-support
EOC

longer-term planning & consequence management

Traffic planning, shelter planning, structural health, public health, news/media
Technology Needs: inter-organization data sharing, simulations to
help predict future, coarse level monitoring, decision support,
SAFIRE:
Situational
Awareness for Firefighters
ability
to understand
the “big picture”.

SAFIRE Concept
SAFIRE: Situational Awareness for Firefighters
How Situational Awareness can Help?
Example Scenario:
Structure Fire
Abnormal event such as
flashover detected by
sensors.
Alert on FICB causes IC
to conduct roll call earlier
than normal.
RIC or closest firefighters
can be directed to last
known location.
SAFIRE: Situational Awareness for Firefighters
SAFIRE Deliverables

Core technologies for creating SA at IC level

A prototype end-to-end SA system for IC



Collect, manage, and transform diverse sensor
data streams from incident site into actionable
information.
Connect to existing info systems (e.g., CAD)
“Intelligent” interactive display system


Real-time situational data, alerting & analysis capability
Testing & validation of the SA system
SAFIRE: Situational Awareness for Firefighters
SAFIRE Core Technology Areas
GIS
External Data hazmat
Sources
occupancy
FICB
Visualization
SAFIRE
System
Sensor
databas
e





Acoustic
data
Environmental
sensors Video FF physio.
data
& location.
Multimodal Sensing
Robust Network Infrastructure
Visualization and User Interfaces
Sensor stream processing
Integration of external data sources
SAFIRE: Situational Awareness for Firefighters
Sensing Technologies

SAFIRE has explored variety
of sensor technologies:


Personnel accountability / health
monitoring, Incident site /
environment / hazard information,
Resource tracking
Location sensing

Despite numerous efforts,
effective indoor localization has
remained a challenge!


WIFI, UWB, IR, Acoustic,
ultrasound, video-based
Acoustic sensing – e.g., first
responder communication

Benefit of human cognition
SAFIRE: Situational Awareness for Firefighters
Polar T31 Heart
rate strap
transmitter
Polar
Heart
Rate
Module
Mote
Environmental sensors
Mobile Optical/Acoustic sensors
(D-Link TPZ cameras)
Fixed Mote Infrastructure (dB,
Temperature, Light, Humidity)
Personal sensors
Pulse Rate (heartbeat),
Acceleration, Temperature,
Humidity, location, , Orientation,
Barometer
Localization Framework

An integrative technology-agnostic
localization framework



Modeling location components
Modeling location queries
Location Queries

Diverse Types:





Simple queries: “where am I”
Boolean queries: “Am I in Bren Hall”
Nearest neighbor queries
Proximity queries: “Are Alice & Bob within 100 feet”
Quality requirement



Search Space of Possible
localization Plans
Granularity – room level, building level, ...
Certainty
1
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
pmf_1
pmf_2
Solve queries using the best combination
1 3 5 7 9 1113
of location components

Best tradeoff accuracy-precision/cost
Based on Lazaridis & Mehrotra,
SIGMOD 2006
SAFIRE: Situational Awareness for Firefighters
pmf_ag
1
gregate
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
pmf_1
Merging results of
different components
1
3
pmf_2
pmf_ag
gregate
5
7
9 11 13
Acoustic Sensing for Enhancing SA
Acoustic Analysis
Acoustic Capture
Firefighters
SA Application
Alerts
Speech
Voice
Processing
Conversation
monitoring & playback
Image/video tagging
Amb. Noise
Spatial Messaging
Localization
•
Type of Acoustic Analysis:
•
•
•
•
Human Speech: Who spoke to whom about what from where and when.
Ambient Sounds: explosions, loud sounds, screaming, etc.
Physiological Events: cough, gag, excited state of speaker, slurring, ..
Other features: too loud, too quiet for too long, …
SAFIRE: Situational Awareness for Firefighters
23
23
Robust Networking Infrastructure
The
Proble
m
Network Infrastructure
that can deliver
contextual data sensed
by firefighters to the
incident commander

Multitude of technologies


But ….


SAFIRE: Situational Awareness for Firefighters
Rapidly deployable, selfconfiguring networks are still
elusive!
SAFIRE-Net: a robust
networking infrastructure for
crisis site

FICB
WSN, UWB, mesh networks,
DTN
Exploit multiple networks that
together provide connectivity,
Exploit mobility when
disconnected
Fire Incident Command Board (FICB)
Firefighter Status
Dashboard
Available
GIS layers
Receive and display
alert messages.
SAFIRE: Situational Awareness for Firefighters
Mapping and
Localization
Integrating External Sources through EBox

EBox -- one-stop information source for pre-compiled and
evolving situational information

GIS, floor plans, hazmat locations, hazmat descriptions, occupancy, real-time
building sensors and instrumentation, other external data sources
User can select from list of available
GIS layers, documents, or sensor streams
Data automatically “ingested” by SAFIRE to
provide an integrated view
SAFIRE: Situational Awareness for Firefighters
Outline


Center for Emergency Response
Technologies
SAFIRE Project


Goals, concept, deliverables, core research areas
Progress & Timeline
SAFIRE: Situational Awareness for Firefighters
Formation of the SAFIRE Advisory
Board
Board formed
within 1 month of the
grant
Fire Agencies
•Advisory
•Advisory
board
members involved in all
aspects of SAFIRE
Research prioritization
•System development
•Testing & validation
•Technology transfer
opportunities
•
•Four
CERT Fire Fighter
Forum in the past 1 year.
SAFIRE: Situational Awareness for Firefighters
County of Los Angeles F. D.
Ron Cabrera, Battalion Chief
Newport Beach F. D.
Paul Matheis, Division Chief
Chip Duncan, Battalion Chief
City of Ontario F.D.
Rob Elwell, Battalion Chief
Dave Schuler, Battalion Chief
Orange County Fire
Authority
Art Nevarez, Battalion Chief
Michael Boyle, Battalion Chief
Bill Lockhart, Captain
Rich Toro, Comm. Supervisor
Jonathan Wilby, Safety Officer
Other Agencies and
Companies
UC Irvine
Police Department
UC Irvine
Environmental Health &
Safety
Deltin Corp.
Tactical Survey Group
Mesh Dynamics
Progress: Component Level Research

Sensing - incorporation of multiple new sensors


Networking & Data collection Infrastructure


ability to incorporate variety of sensors , multimodal sensor archival
and retrieval functionality
Talk by Prof. Mehrotra
Visualization


New antenna array for increased coverage, multi-network & storeand-forward architecture
Talk by Prof. Venkatasubramanian
Stream management


Talk by Dr. Kalashnikov
CO sensors, localization, speech
New functionalities in FICB – simplified UI, annotations, ebox
integration, etc.
Ebox

Illustrated through demo/video
Prototype development, ontologies for resource selection, integration
of static and dynamic data such as sensing infrastructure of
buildings
SAFIRE: Situational Awareness for Firefighters
30
Progress: SAFIRE End-to-End SA System


Sept. 2008 -- 1st Prototype
May 2009 -- Significant redesign to add Robustness &
more dynamic configuration of components
Fire Incident Command Board
Alert Generator
Incident Replay
real time visualization of one incident
define alert rules, generate alerts
post-incident visualization, analysis
SAFIRE Server
Mock CAD
EBox
coordinates all aspects of real time inicident monitoring
communication with external systems (CAD, EBox)
configuration of stream processor, incident archiver
maintain representation of current state
messaging between clients and data stream sources
Stream Processor
Incident Network
& Sensors
Incident Archiver
schedule data collection
store incident and sensor stream
receive and manage data streams data sufficient to meaningfully
stream level data processing recreate an incident at later date
Sensor
Data Streams
SAFIRE: Situational Awareness for Firefighters
Incident Event DB
Progress: Testing & Validation

Technology Testing Exercise: 16
SEP 08

Bren Hall Evacuation w/Campus
Police Department & UCI Zone Crew
3


Networking & sensing technologies, 1st
gen. FICB.
Live Burn Exercise: 23 FEB 09

Live Burn with OCFA,LA Fire and
Anaheim Fire

Testing Sensing (human bio-sensing)
data collection & 2nd generation FICB
SAFIRE: Situational Awareness for Firefighters
32
Progress: Testing & Validation
Talk by Dr. Davison

Technology Testing Exercise:
12 May 09

Bren Hall Hazmat, multiple
casualty incident


Integrated technology exercise, 3rd
gen. FICB.
Table Top Exercise: 15 May 09


Part of CERT Fire Forum
Participants: LA County Fire, UCI
EH&S, Newport Beach Fire
Department, Orange County Fire
Authority, ImageCat Inc., Raytheon
SAFIRE: Situational Awareness for Firefighters
33