Transcript Libraries in the History of Print Culture Mining Global Library Records for National Publication Profiles: Books as an Expression of Cultural Diversity 10 Sept.

Libraries
in the History
of Print Culture
Mining Global Library Records for
National Publication Profiles:
Books as an Expression of
Cultural Diversity
10 Sept. 2010
Timothy J. Dickey, Ph.D.
Post-Doctoral Researcher
OCLC Research
Overview
Introduction to the Project
Research Results:
• Publication profiles
• Language data
• Translation data
Next steps
Introduction: Genesis and Background of
the Project
Genesis and Background of the Project
Interested in measures of cultural diversity:
• UNESCO Institute for Statistics
• IFLA Statistics and Evaluation Committee
• ISO Global Library Statistics Project
• Book and Media Studies School, Leiden
• Index Translationum
• UNESCO Division of Cultural Expressions & Creative Industries
• 1932 - present
Genesis and Background of the Project
Genesis and Background of the Project
Genesis and Background of the Project
WorldCatTM and Global Book Data:
• 200 million records, 1.63 billion holdings
• Strongest in monographic records
• 72,000 libraries
• 171 countries
• > 50% non-English cataloging
• > 470 languages
WorldCat as an “Aggregate Collection“
Data Mining can:
“…not only provide librarians data for decisionmaking for collection and service development, but
also provide users with enhanced discovery and
access methods.”
Connaway, L.S., & Dickey, T.J. (2008). Beyond data mining: Delivering the next generation
of service from library data. Proceedings of the 2008 Annual Meeting of the American
Society for Information Science & Technology, 1059-63 at 1062.
Project Objectives
•Mine data from WorldCat’s monographic records
•Parse the data:
• Country of publication
• Year of publication
• Language use as a “measure of cultural diversity”
•Seek patterns in the data
Project Objectives
Data limits:
• Textual material, non-serial
• Publication date numeric, < 2010
Data extracted:
• Published titles
• Holdings – indigenous libraries and worldwide
• Languages
• Translation data
Project Objectives
• Profiles of book publishing in six countries:
• Bolivia, Chile, Germany, Poland, South Africa,
Thailand
• Expansions in groups:
• China, Columbia, Finland, France, India, Indonesia,
Italy, Kenya, Nigeria, Russia, Ukraine, Venezuela
• Australia, Belgium, Denmark, Egypt, Greece, Iran,
Iraq, Ireland, Japan, Korea(s), Mexico, Netherlands,
New Zealand, Norway, Spain, Sweden, Switzerland
• Etc.
Project Limitations
• “As reflected in WorldCat”
• Collection patterns
• Cataloging practice
• Definition of a book
• Definition of a COUNTRY
• Definition of a publishing date
National Publishing Profiles
Book Publishing Profiles: Publishing Output
Country
Bolivia
Publications
58,838
Holdings
Translations
302,309
780
(1 OCLC member lib.)
Chile
265,948
900,330
7,351
12,843,615
70,341,725
381,141
1,225,446
3,108,677
174,738
299,574
2,014,327
10,063
181,003
463,104
5,700
(387 member libraries)
Germany
(378 members)
Poland
(27 members)
South Africa
(1,082 members)
Thailand
(39 members)
Book Publishing Profiles: Publishing Output
Country
China
Publications
3,208,114
Holdings
Translations
8,160,062
238,315
(1,160 member libs.)
Finland
905,252
1,476,734
122,150
4,948,620
29,127,570
211,341
1,121,311
6,636,530
52,107
1,883,418
8,151,097
94,319
236,166
710,372
9,061
(71 members)
France
(253 members)
India
(37 members)
Russia
(45 members)
Ukraine
(3 members)
Book Publishing Profiles: Publishing Output
Germany: Book Publication
1,600,000
1,400,000
1,200,000
1,000,000
800,000
600,000
400,000
200,000
0
Titles
All Holdings
18
8
18 0
9
19 0
0
19 0
1
19 0
2
19 0
3
19 0
4
19 0
5
19 0
6
19 0
7
19 0
8
19 0
9
20 0
00
National Holdings
date of publication
Book Publishing Profiles: Publishing Output
Germany: Book Publication
70,000
60,000
50,000
40,000
30,000
20,000
10,000
0
Titles
All Holdings
14
80
15
1
15 0
4
15 0
7
16 0
0
16 0
3
16 0
6
16 0
9
17 0
2
17 0
5
17 0
8
18 0
1
18 0
4
18 0
70
National Holdings
date of publication
Book Publishing Profiles: Publishing Output
France: Book Publication
60,000
50,000
40,000
Titles
30,000
Holdings
20,000
10,000
16
00
16
20
16
40
16
60
16
80
17
00
17
20
17
40
17
60
17
80
18
00
18
20
18
40
18
60
0
date of publication
Book Publishing Profiles: Publishing Output
Poland: Book Publication
80,000
60,000
Titles
40,000
All Holdings
National Holdings
20,000
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
0
date of publication
Book Publishing Profiles: Publishing Output
South Africa: Book Publication
70,000
60,000
50,000
Titles
40,000
All Holdings
30,000
National Holdings
20,000
10,000
19
00
19
10
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
0
date of publication
Book Publishing Profiles: Language Data
Publications Translations
Bolivia
58,838
Language
780 Spanish (O)
Quechua (O)
Aymara (O)
Guarani
Other Amerindian
(English)
56,326
202
228
28
269
887
529
46
28
10
64
69
Language
Distribution
96.56%
0.35%
0.39%
0.05%
0.46%
1.52%
Titles
Translations
Chile
265,948
7,351 Spanish (O)
English
German
Mapudungun
(French)
248,935
10,965
772
127
935
6,505
533
81
33
55
94.20%
4.15%
0.29%
0.05%
0.35%
Thailand
181,003
5,700 Thai
English
Chinese
(French)
(Pali)
129,461
44,233
1,224
991
920
3,806
1,514
65
91
47
73.70%
22.76%
0.70%
0.56%
0.52%
Book Publishing Profiles: Language Data
Publications Translations Language
Germany
Poland
12,843,604
1,225,446
381,141 German
Danish
Frisian
Sorbian
Romani
(English)
(Latin)
(French)
(Italian)
174,738 Polish
German
Ukrainian
Lithuanian
Belarusian
Kashubian
(English)
(Latin)
(French)
(Russian)
10,558,895
1,712
401
83
32
580,149
378,698
92,516
16,901
317,446
320
51
22
4
29,072
8,041
6,919
1,588
Language
Distribution
83.73%
0.01%
0.00%
0.00%
0.00%
4.60%
3.00%
0.73%
0.13%
917,229
85,304
2,105
327
691
43
63,137
23,877
13,556
9,927
150,061
5,041
282
81
92
6
10,916
882
2,204
912
78.95%
7.34%
0.18%
0.03%
0.06%
0.00%
5.43%
2.06%
1.17%
0.85%
Titles
Translations
Book Publishing Profiles: Language Data
German-language Publishing in Germany
200,000
180,000
160,000
140,000
120,000
100,000
80,000
60,000
40,000
20,000
0
Titles
18
80
18
90
19
00
19
10
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
Translations
date of publication
Book Publishing Profiles: Language Data
Latin-language Publishing in Germany
1400
1200
1000
800
Titles
600
Translations
400
200
18
80
18
90
19
00
19
10
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
0
date of publication
Book Publishing Profiles: Language Data
Publications Translations
South Africa
299,574
Language
10,063 English
Afrikaans
Zulu
Xhosa
Sesotho
Sepedi
Setswana
Xitsonga
Venda
Ndebele
Other indigenous
languages
(Dutch)
(German)
193,504
77,449
2,649
2,364
1,368
1,344
1,290
729
670
167
96
2,082
5,145
487
553
298
177
154
132
115
31
7
Language
Distribution
65.30%
26.13%
0.89%
0.80%
0.46%
0.45%
0.44%
0.25%
0.23%
0.06%
0.03%
3,175
1,320
82
76
1.07%
0.45%
Titles
Translations
Book Publishing Profiles: Translation Data
South Africa
Publications Translations Original
299,574
10,063 Afrikaans
English
Xhosa
Zulu
Afrikaans
Sesotho
Afrikaans
Tswana
English
Sepedi
Venda
English
Zulu
English
Translation
English
Afrikaans
English
English
Dutch
English
German
English
German
English
English
Zulu
Afrikaans
Xhosa
Number
4,077
1,008
453
357
292
219
209
204
165
109
80
54
40
31
40.51%
10.02%
4.50%
3.55%
2.90%
2.18%
2.08%
2.03%
1.64%
1.08%
0.79%
0.54%
0.40%
0.31%
Book Publishing Profiles: Translation Data
Translated Works in WorldCat Published in South
Africa
300
Afrikaans-English
200
English-Afrikaans
150
Xhosa-English
100
Zulu-English
50
0
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
titles
250
date of publication
Book Publishing Profiles: Translation Data
Translated Works in WorldCat Published in Poland
6,000
5,000
English-Polish
German-Polish
3,000
French-Polish
Russian-Polish
2,000
Polish-English
1,000
date of publication
00
20
90
19
80
19
70
19
60
19
50
19
40
19
30
19
20
0
19
titles
4,000
Book Publishing Profiles: Translation Data
Bolivia
Publications Translations Original
58,838
780 English
French
Spanish
German
Aymara
Translation Number
Spanish
211
Spanish
61
English
58
Spanish
50
Spanish
32
27.05%
7.82%
7.44%
6.41%
4.10%
Chile
265,948
7,351 English
French
German
Spanish
Italian
Spanish
Spanish
Spanish
English
Spanish
2,571
1,365
575
442
410
34.97%
18.57%
7.82%
6.01%
5.58%
Thailand
181,003
5,700 English
Thai
Chinese
Pali
French
French
Thai
English
Thai
Thai
Thai
English
2,322
983
237
178
165
154
40.74%
17.25%
4.16%
3.12%
2.89%
2.70%
Book Publishing Profiles: Translation Data
120
100
80
60
40
20
0
Thai-English
English-Thai
Thai-Chinese
Thai-French
19
10
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
titles
Translated Works in WorldCat Published in
Thailand
date of publication
Book Publishing Profiles: Translation Data
Translated Works In Worldcat Published in Italy
1000
800
600
400
200
19
20
19
30
19
40
19
50
19
60
19
70
19
80
19
90
20
00
0
English-Italian
French-Italian
German-Italian
Latin-Italian
Italian-English
Next Steps
•Refinements (always) to data extraction
•Map and graphical interface
•Longitudinal data
Questions?
Timothy J. Dickey, Ph.D.
[email protected]
www.oclc.org/research/projects/globalbooks/default.htm
Special thanks to Jeremy Browning, Lynn Silipigni Connaway, Michael Heaney, and Karen Smith-Yoshimura