Transcript MetaData Embedding in Compressed UAV Video

Metadata Embedding in
Compressed UAV Video
via Digital Watermarking
Domenick
Cinalli
Domenick Cinalli
ECE Department
Villanova University
Bijan
Mobasseri
Colin
O’Connor
Intelligent Ship Symposium V
Monday, May 12, 2003
Acknowledgments
• This work was supported in part by a grant
from the US Air Force Office of Scientific
Research. Predator video footage was
provided by Mr. Scott Adams of the Air
Force Research Lab, Rome, NY.
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Objectives
• Define Watermarking
• Why Watermark?
• How to Watermark
– MPEG Introduction
• Metadata Embedding System
– Synchronization
• Metadata Viewer Application
– Demo
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
What is
Watermarking?
Ability to insert a signal into a separate
carrier signal without adversely affecting the
carrier signal’s perceptual transparency.
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Watermarked Image
Example
Langelaar, C., Setyawan, I., and Lagendijk, R., “Watermarking Digital Image and
Video Data,” IEEE Signal Processing Magazine, vol. 17, no. 5, pp. 20-46, Sept.
2000.
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Why Watermark?
Protection
Informative
Copyright Protection
Indexing
Fingerprinting
Medical Record Storage
Copy Generation Control
Data Hiding
Broadcast Monitoring
Data Authentication
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
MPEG Introduction
Table B-14
MPEG Bitstream
Slice
Macroblock
Block
Domenick Cinalli
ECE Department
Villanova University
Variable length code
run
level
10 (NOTE 2)
End of Block
1 s (NOTE 3)
0
1
11 s (NOTE 4)
0
1
011 s
1
1
0100 s
0
2
0101 s
2
1
0010 1 s
0
3
0011 1 s
3
1
0011 0 s
4
1
0001 10 s
1
2
0001 11 s
5
1
0001 01 s
6
1
0001 00 s
7
1
0000 110 s
0
4
0000 100 s
2
2
0000 111 s
8
1
0000 101 s
9
1
Intelligent Ship Symposium V
Monday, May 12, 2003
Data hiding in labelcarrying VLCs
• Compressed-Domain Scheme
• Frame data is encoded into MPEG bitstream
using Variable-Length Codes.
• Subset of VLCs, Label-Carrying VLCs, have
least significant bit modified to carry watermark.
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Label-Carrying VLCs
To classify as a LC-VLC pair, both VLCs
must:
1. Share a run-length
2. Differ in level by one
3. Have exactly the same bit-length
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
LC-VLC Example
VLC
Run-Length
Level
000000011101
0
12
000000001100
0
13
Insert Label ’11’
0 0 0 0 0 0 0 1 1 1 0 1 0 0 0 0 0 0 0 0 1 1 0 0
1
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Metadata
Embedding System
Embed
Extract
v
Display
v
Video
W
s
m
Domenick Cinalli
W-1
m
ECE Department
Villanova University
Metadata
Intelligent Ship Symposium V
Monday, May 12, 2003
Metadata
• Descriptive Information
– Date / Time
– Direction
– Location
• Why Embed?
– Bookkeeping
– Efficiency of storage
– Ease of display
http://www.airforce-technology.com/projects/predator/predator3.html
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Video – Metadata
Synchronization
• Requirements
– Metadata sampling starts simultaneously with recording of video
– Metadata is sampled at a constant rate
• Result
– Video and metadata are concurrently displayed and maintain
synchronization.
5s
1st Record
Domenick Cinalli
10s
2nd Record
ECE Department
15s
3rd Record
Villanova University
20s
4th Record
25s
5th Record
6th Record
Intelligent Ship Symposium V
Monday, May 12, 2003
Metadata Viewer
Application
•
•
•
•
Concurrently display metadata & video
Graphical User Interface (GUI)
Abstract technical detail
Easy-To-Use
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Metadata Viewer
Demo
• Predator UAV video (MPEG) & metadata
provided by US Air Force
• Java-based
– Swing API for GUI
– Java Media Framework (JMF) for video
• Watermarking module coded in C
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Summary
• Implemented LC-VLC Watermarking to
insert metadata into Predator UAV MPEG
video
• Created an application that abstracts
watermarking tasks and extracts
embedded data for simultaneous display
with video
Domenick Cinalli
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003
Future Work
• Going beyond proof of concept…
–
–
–
–
–
Domenick Cinalli
Integrating operational factors
secure embedding
frame content metadata using MPEG-4
lossless embedding
controlled access to video based on viewer clearance
ECE Department
Villanova University
Intelligent Ship Symposium V
Monday, May 12, 2003