Transcript plenary_session_ii_
BIOMETRICS IN ABC: COUNTER-SPOOFING RESEARCH
Hong Wei, Lulu Chen and James Ferryman Computational Vision Group School of Systems Engineering University of Reading, UK 11th October 2013 1
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
Outline of the presentation
• • •
Introduction Research on counter spoofing attacks
– – –
for face for fingerprint for iris Challenges and future research
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
2
• • • • •
Introduction
ABC requires: fast, secure identity verification.
EU FastPass project ( www.fastpass-project.eu
): harmonised, modular reference system for future European ABC.
Biometrics: face, fingerprint and iris – important for ABC.
Potential vulnerability: sensor-level attacks – “spoofing”.
Counter-spoofing measure: crucial for FastPass.
FastPass Heavy traffic and pressure at current border control – how to ease these?
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
3
Face
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
4
•
Face counter spoofing approaches Three categories in developing face anti spoofing algorithms
− Motion analysis: make use of significant difference between motions of planar objects and real face (3D) in optical flow fields.
− Texture analysis: extract image texture features which reflects difference between real face and printed or replayed faces.
− Liveness detection: detection of life signs such as eye blinking, lip movement, etc.
5
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
Relevant competitions
• Competitions on counter measures to 2D facial spoofing attacks • • First with IJCB 2011: 6 teams [Chakka, et al 2011] .
Second with ICB 2013: 8 teams [Chingovska, et al 2013] • • Participants: academic teams Replay-Attack face spoofing database: • Printed photographs • • Photographs on a mobile device (iPhone / iPad) Videos replayed on a mobile device 6
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
Summary of the 2013 competition
Methods used in algorithms development
Team
Texture based Motion based Liveness based Fusion
1
Yes Yes No
2
No No Yes
3
Yes Yes No
4
Yes Yes No
5
Yes No No
6
Yes No No Feature Score Score Feature Feature Score
7
Yes No No No
8
Yes No No No • Database: Replay-Attack Face Spoofing Database • Teams 1&4 achieved 100% accuracy in both development and test.
• All 8 teams developed highly sophisticated methods, and some introduced methods beyond the three categories, such as human pulse.
7
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
• • •
Open issues and challenges
Facial features: • • Change over time Similarity between family members: e.g. twins, father and son.
Capture: • • Moving subject Efficient sensor-level fusion (VR+NIR, stereo vision) 2D face only: 3D attacks should be added, e.g. 3D face masks.
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
8
Fingerprint
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
9
Fingerprint sensing technologies
Optical sensors Relatively big in size In border control, biometric enrolment Solid state fingerprint sensors Different types, most common: capacitive Can be compact Sensitive to electrostatic discharges Multiple spectral imaging sensor 3D scanner Can be touchless
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
10
Fingerprint counter-spoofing methods
Solutions: Hardware and Software based Hardware: Pulse oximetry, smell, temperature, blood pressure, heart beat etc.
Requires additional hardware Software: Perspiration pattern Skin distortion Pores Image quality measure
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
11
Software based
Pore distribution Perspiration patterns Skin distortion Real Fake Image quality measure
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
12
Fingerprint counter-spoofing competitions
LivDet: Fingerprint Liveness Detection Competition Since 2009, every two years Software based methods Multiple sensors: • Optical and swipe Various reproduction materials: • Gelatin • Silicon • Play-doh • Latex 13
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
Fingerprint LivDet
Participants Submissions
LivDet 2009 4 4
Best results (avg. across datasets)
Dermalog: Ferrfake: 5.4% Anonymous 2: Ferrlive: 20.1% LivDet 2011 LivDet 2013 3 2 9 Part I: algorithms 3 Part II: system 2 Part I: algorithms 11 Part II: system 2 Federico: 26.60% Ferrfake Dermalog: 17.60% Ferrlive Dermalog: 0.8% Ferrfake Greenbi: 38.8% Ferrlive Dermalog: 1.10% Ferrfake Federico: 11.96% Ferrlive Morpho: 0.0% Ferrfake Morpho: 1.4% Ferrlive • • Ferrfake: a false acceptance of a spoof image.
Ferrlive: a false rejection of a live subject.
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
14
• •
Open issues and challenges
Various spoofing materials • Recent approaches: • Handles certain types well • Poor performance on other materials • New methods should: • Detect and handle all types of spoofing materials • Combine successful algorithms • Enable more balanced ferrfake and ferrlive rates Touchless fingerprint scan
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
15
Iris
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
16
• • • •
Iris counter-spoofing approaches
Spectrographics based: optical properties • • Purkinje reflection Retina light reflection: ‘Red eye’ effect Image quality measure Behaviour based: dynamic properties • Eye hippus • • Pupil and iris constriction and dilation Eyelid blinking Other: • 3D structure
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
17
•
Iris counter spoofing competitions
LivDet-Iris: First Liveness Detection-Iris Competition 2013 • Held by IEEE BTAS Conference (September 29 – October 2, 2013)
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
18
• •
Open issues and challenges
FastPass: • Data capturing: involves additional noise • Small target • Long-distance • On-the move • Illumination, focus Research: • Data collection: lack of data for training • Lack of standardisation on spoofing experimental datasets
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
19
Challenges
• • • • • • Current biometric systems: – Have counter-spoofing mechanism integrated.
– However, research show vulnerability from spoofing attacks (e.g. TABULA RASA Spoofing Challenge 2013).
Arms race: between spoofing and counter-spoofing. – Spoofing using new technologies, e.g. Hand-held mobile devices.
Increased throughput and intuitive user-friendly devices.
Lack of training data.
Data interchange format.
E-Passport storage capacity.
20
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
Future of counter spoofing
• • • • • Multimodal: – Increase difficulty to spoof multiple traits.
– Not every person has all biometric features.
Multi-sensor system: – Visible range and Near IR – 2D and 3D Combined approaches: – Handle different types of materials.
Tackle continuously updated and practised spoofing attacks.
Increase difficulty for replication process.
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
21
Future research
• • • • Explore and develop new algorithms on counter spoofing measures and attacks in ABC applications. Assemble ABC-specific databases with more realistic spoofing attacks.
Create a framework for counter spoofing measures.
Analyse data fusion effects at a quantitative level: – At the feature level for a single trait; – – – At the decision (score) level for multiple traits; Combination of feature fusion and trait fusion; Adaptive fusion schemes taking additional information (quality, thresholds) into account.
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
22
Summary
• ABC demands harmonized capturing devices adopting international standards – non intrusive and enable remote biometric capture – – faster, more secure, efficient, seamless robust counter spoofing detection Subject to appropriate legal and ethical controls
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
23
www.fastpass-project.eu
Thank you.
& Questions
FRONTEX - 2nd Global Conference and Exhibition on Future Developments of Automated Border Control (ABC) 10/11 October 2013, Warsaw, Poland
24