Transcript Datactics – Our Role

Error Tolerance vs. Soundex
If you don’t happen to live in a Perfect World!
RCP Consulting Limited
Suite B, 15th Floor, Casey Building,
38, Lok Ku Road, Sheung Wan,
Hong Kong
Tel: 2815 9911
Fax : 2815 0611
E : [email protected]
File of Surnames with Duplicates
CLUSTER
ID
FirstName
Surname
CLUSTER
ID
FirstName
Surname
1
1
David
Walker
10
16
Daria
Frankowa
1
2
David
Warker
10
17
Darea
Frankova
1
3
Dave
Wallker
11
18
Radislav
Brdjanin
1
4
David
Walker
11
19
Radislav
Brjanin
1
5
David
Walke
12
20
Samoko
Jorda
1
6
David
Whalker
12
21
Samojko
Djorda
1
8
David
Ealker
13
22
Peter
Rubou
1
9
David
Walkor
13
23
Peter
Hrubou
1
7
David
Whaler
14
24
Marianne
Beaux
6
10
James
Wilkinson
14
25
Marianne
Beau
6
11
Jim
Wilkensen
15
26
Peter
McComb
6
12
James
Wilkonsen
15
27
Peter
McCome
6
15
James
Wilkison
16
28
Abraham
Lincoln
6
14
James
Wilonsen
16
29
Abrahm
Lincon
6
13
James
Ilkonsen
17
30
Michelle
Feiffer
17
31
Michelle
Pfeiffer
•31 candidate records
•10 individuals
RCP Consulting Limited
Suite B, 15th Floor, Casey Building,
38, Lok Ku Road, Sheung Wan,
Hong Kong
Tel: 2815 9911
Fax : 2815 0611
E : [email protected]
Standard SQL Matching
CLUSTER
ID
FirstName
Surname
1
1
David
Walker
1
4
David
Walker
• Exact matching
• 1 identity found - Walker (2 records)
If only our data was perfect!
RCP Consulting Limited
Suite B, 15th Floor, Casey Building,
38, Lok Ku Road, Sheung Wan,
Hong Kong
Tel: 2815 9911
Fax : 2815 0611
E : [email protected]
Soundex Matching
CLUSTER
ID
FirstName
Surname
1
1
David
Walker
1
3
Dave
Wallker
1
4
David
Walker
1
6
David
Whalker
1
9
David
Walkor
5
10
James
Wilkinson
5
11
Jim
Wilkensen
5
12
James
Wilkonsen
5
15
James
Wilkison
8
16
Daria
Frankowa
8
17
Darea
Frankova
•Converts name to a code,
based on 1st letter followed
by up to 3 digits. English
pronunciation based.
•3 identities found
•Walker (5 records)
•Wilkinson (4 records)
•Frankowa (2 records)
What did we miss, though?
RCP Consulting Limited
Suite B, 15th Floor, Casey Building,
38, Lok Ku Road, Sheung Wan,
Hong Kong
Tel: 2815 9911
Fax : 2815 0611
E : [email protected]
What Soundex missed and why?
Cluster
ID
FirstName
Surname
1
2
David
Warker
1
5
David
Walke
1
7
David
Whaler
6
12
James
Wilkonsen
6
13
James
Ilkonsen
11
18
Radislav
Brdjanin
11
19
Radislav
Brjanin
12
20
Samoko
Jorda
12
21
Samojko
Djorda
13
22
Peter
rubou
13
23
Peter
Hrubou
14
24
Marianne
Beaux
14
25
Marianne
Beau
•Key consonant missing
•First character missing
•Silent characters
•Additional consonant
RCP Consulting Limited
Suite B, 15th Floor, Casey Building,
38, Lok Ku Road, Sheung Wan,
Hong Kong
Tel: 2815 9911
Fax : 2815 0611
E : [email protected]
Fuzzy Matching
CLUSTER
ID
FirstName
Surname
CLUSTER
ID
FirstName
Surname
1
1
David
Walker
10
16
Daria
Frankowa
1
2
David
Warker
10
17
Darea
Frankova
1
3
Dave
Wallker
11
18
Radislav
Brdjanin
1
4
David
Walker
11
19
Radislav
Brjanin
1
5
David
Walke
12
20
Samoko
Jorda
1
6
David
Whalker
12
21
Samojko
Djorda
1
8
David
Ealker
13
22
Peter
rubou
1
9
David
Walkor
13
23
Peter
Hrubou
1
7
David
Whaler
14
24
Marianne
Beaux
6
10
James
Wilkinson
14
25
Marianne
Beau
6
11
Jim
Wilkensen
15
26
Peter
McComb
6
12
James
Wilkonsen
15
27
Peter
McCome
6
15
James
Wilkison
16
28
Abraham
Lincoln
6
14
James
Wilonsen
16
29
Abrahm
Lincon
6
13
James
Ilkonsen
17
30
Michelle
Feiffer
17
31
Michelle
Pfeiffer
• All matches found
•10 identities
RCP Consulting Limited
Suite B, 15th Floor, Casey Building,
38, Lok Ku Road, Sheung Wan,
Hong Kong
Tel: 2815 9911
Fax : 2815 0611
E : [email protected]