Transcript Working with International Data Data sources and resources from the World Bank Open Development Open Data and its consequences.

Working with
International Data
Data sources and resources
from the World Bank
Open Development
Open Data and its consequences
In April 2010 the World Bank made all of its
development databases freely accessible on
the web … and that changed everything …
New site: 13,500 unique
visitors/day
30,000
20,000
Old site: 5,500 unique
visitors/day
10,000
0
Mar 20, 2010
Apr 20, 2010
Open Data
• New website in English, French, Spanish, Arabic, with 1,200
WDI/GDF indicators freely available
• Data Catalog to provide access to all World Bank datasets
• Best practice Terms of Use that allows commercial use and
re-use
• Multiple access options with full downloads, Application
Programming Interface (API) for developers, etc
Open Data
data.worldbank.org
By Country
» View profiles for over 200 economies
By Topic
» See key indicators for a variety of topics
Indicators
» View data for 1,200 indicators in four languages
World dataBank
» “Slice and dice” the data
Data Catalog
» Lists open data sources of the World Bank
Open Data
Chart an indicator
Open Data
Map an indicator
Open Data
Multilingual
New Search Tool
The Data Catalog
Data Catalog – selected contents
World Development Indicators
Actionable Governance Indicators
Manufactures Unit Value Index
Global Development Finance
Enterprise Surveys
Private Participation in Infrastructure
Africa Development Indicators
Bulletin Board on Statistical Capacity
Privatization Database
Research Datasets and Analytical Tools
Business Environment and Enterprise
Performance Survey
Quarterly External Debt Statistics
Africa's Infrastructure
Commodity Prices
Remittance Prices Worldwide
AidFlows
International Comparison Program
Temporary Trade Barriers Database including
the Global Antidumping Database
Doing Business
Joint External Data Hub
World Integrated Trade Solution
Education Statistics
Knowledge Economy Index
Worldwide Governance Indicators
Gender Statistics
Logistics Performance Index
Environmental Accounting - Total Wealth
Global Economic Monitor
Population Projections
Household Survey Education Profiles
Health Nutrition and Population Statistics
Rural Access Index (RAI)
Millennium Development Goals
Thematic Gender Data
Country Policy and Institutional Assessment
databank.worldbank.org: custom queries
Open Data
Terms and conditions of access
• Conforms to Open Knowledge Foundation definition for
open data: http://www.opendefinition.org/okd/
• No restrictions on use or reuse of data, except attribution
to source
• License models
Open Data Commons Attribution License (ODC-BY)
<http://www.opendatacommons.org/licenses/by/>
Creative Commons Attribution License (CC-BY)
<http://creativecommons.org/choose/>
Data Exposed to Web Searches
Continuing demand for data
A Look at the World Development Indicators
Data sources and coverage
Distribution of WDI Indicators by topic
WDI 2010
Economy
Environment
Global Development Finance
Global Links
Social and demographic
States and Markets
Cross-domain
Total
Number of indicators
314
109
175
171
314
130
72
1285
Sources of WDI Data
1%
2%
1%
9%
1%
2%
2%
2%
44%
3%
4%
6%
9%
14%
WDI 2010 database
1635 indicators with identified sources
World Bank
UNESCO
IMF
ILO
WHO
DAC
FAO
ITU
IEA
UNPD
UNICEF
IRF
DHS
0ther
WDI and GDF Data Availability
•
•
•
•
237 countries
1158 series
50 years
Average coverage
• 4,453,206 available observations
• 13,722,300 possible cells
• => 32.45 % coverage
Major Data Gaps
• States of former Soviet Union prior to 1988
• States of the former Yugoslav Republic prior to 1990
• Limited reporting by many small states and
dependencies
• Data derived from irregular or infrequent sources
•
•
•
•
Poverty and income distribution
Malnutrition
CO2 emissions
Forest coverage
Improving Data Coverage
GDP (current LCU)
-40
-35
-30
-25
-20
-15
-10
Inflation, consumer prices (annual
%)
5
-5
0
4
4
3
3
2
2
1
1
0
0
-40
-35
-30
-25
-20
-15
-10
Y axis shows average number of years with data (averages for all developing countries, 5 is maximum)
X axis shows lag (in years) from the beginning of five-year intervals for which WDI has published these data; the most
recent five-year interval starts with 2003 for WDI2009 and 1993 for WDI1999
-----WDI 2009
5
WDI 1999
-5
0
Improving Coverage of MDG Indicators
Source: Paris21 at Ten: Improvements in Statistical Capacity Since 1999
Building the Database -- I
Improving Statistical Capacity
Assessing Statistical Capacity
Statistical Capacity: Methodology
Indicators
1. National accounts base year
2. Balance of payments manual in use
1
Within last 10 years or annual chain
linking
Balance of Payments Manual, the
fifth edition
3. External debt reporting status
Actual or preliminary
4. Consumer Price Index base year
5. Industrial production index
Within last 10 years or annual chain
linking
Produced and available from IMF
6. Import/export prices
Produced and available from IMF
7. Government finance accounting concept
Consolidated central government
accounts
Annual or missed reporting only
once in the last 4 years
8. Enrolment reporting to UNESCO
9. Vaccine reporting to WHO
Nationally reported data on measles
vaccine coverage consistent with
WHO estimates
10. IMF’s Special Data Dissemination
Subscribed
Standard
Maximum total score is 100
Statistical Capacity: Source Data
Indicators
1
1. Periodicity of population
census
≤10 years
2. Periodicity of agricultural
census
≤10 years
1/2
3. Periodicity of poverty related ≤ 3 years
surveys (IES, LSMS, etc.)
≤ 5 years
4. Periodicity of health related
surveys (DHS, MICS, Priority
survey, etc)
≤ 3 years
≤ 5 years
5. Completeness of vital
registration system
Complete
Maximum total score is 100
Statistical Capacity: Periodicity
Indicators
1. Periodicity of income
poverty indicator
2. Periodicity of child
malnutrition indicator
3. Periodicity of child
mortality indicator
4. Periodicity of
Immunization indicator
5. HIV/AIDS indicator
6. Periodicity of maternal
health indicator
7. Periodicity of gender
equality in education
indicator
8. Primary completion
indicator
9. Access to water indicator
1
2/3
1/2
1/3
≤ 3 years
≤ 5 years
> 5 years
≤ 3 years
≤ 5 years
> 5 years
National or
international estimates
available for at least
one year out of the last
3 years
≤ 3 years
≤ 5 years
> 5 years
Observed for at least 5 Observed for at least 3
out of 5 latest years
out of 5 latest years
Observed for 1 out of 5
latest years
National or
international estimates
available
Annual
Observed for at least 5 Observed for at least 3
Observed for 1 out of 5
out of 5 latest years
out of 5 latest years
latest years
Observed for 2 out of 6
Observed for 1 out of 6
latest years
latest years
10. Periodicity of GDP growth Annual
≤ 1.5 years
> 1.5 years
indicator
Maximum total score is 100
World Bank Support for Statistical
Capacity
• Trust Fund for Statistical Capacity
• Multi-donor trust fund to support creation of national strategies for
development of statistics (NSDSs)
• $35 million in grants since 2000
• Statistics for Results Facility
• Multi-donor trust fund to support implementation of NSDSs
• $120 million pledged; $50 million committed
• STATCAP
• World Bank investment lending program for improving statistical
capacity
• 13 STATCAP projects planned or underway – largest is India ($107
million
Accelerated Data Program
Virtual Statistical System
Building the Database -- II
Standardizing Data
www.childmortality.org
For some countries, many estimates
Trend line by weighted, splined
regressions
Combining estimates reduces uncertainty
But results may differ from national
estimates
Building the Database -- III
The International Comparison
Program
ICP Data in the Data Catalog
International Comparison Program (ICP)
• ICP is a worldwide statistical initiative to collect
comparative price data and estimate purchasing
power parities (PPPs) of the world’s economies.
• Using PPPs instead of market exchange rates
makes it possible to compare the output of
economies and the welfare of their inhabitants in
real terms.
41
What are Purchasing Power Parities
?
Definition
Basic Data
Required
• PPP between two countries, A and B, is a price
ratio that measures the number of units of
country A’s currency that are needed in country
A to purchase the same quantity of an
individual good or service as one unit of country
B’s currency will purchase in country B.
• National annual prices for products chosen
from a common basket of well-defined goods &
services.
• A breakdown of final expenditure on National
GDP into 155 categories using a common
classification.
42
Calculating PPPs: an Example
Exchange Rate Yuan
to USD
Y 1= $ 0.15
Y 1800
= $ 270
PPP
=
0.25
Price of
Hotel Room
in China
Y 1800
$ 450
43
Price of Same
Hotel Room
in the US
Comparing Income Levels
log scale
GNI per capita
100000
10000
Low income PPP
Lower middle income PPP
Upper middle income PPP
High income PPP
Low income XR
Lower middle income XR
1000
Upper middle income XR
High income XR
100
1990
1995
2000
2005
44
Shares of global output
45
Uses of PPPs
•
•
•
•
•
•
•
•
•
•
•
•
International poverty headcount index (World Bank)
Comparing relative sizes of economies and estimating weighted averages of regional
growth rates (IMF)
Allocation of structural and cohesion funds (European Commission)
Human Development Index (UNDP)
Gender empowerment measures (UNDP)
Health inequality assessment (World Health Organization)
Assessing per capita expenditures in education (U.N. Educational, Scientific and
Cultural Organization)
Monitoring the welfare of children (U.N. Children’s Fund)
Designing effective aid programs (International Organizations)
Analysis of an economy’s comparative advantage on prices and expenditures of goods
or services (Policy Makers)
Evaluation of investment costs and industry growth potential across countries.
PPP adjusted cost of living allowances (Multinational Corporations, Non-Government
Organizations, International Development Agencies)
46
Open Knowledge
Tools and Applications
Open Tools
Open Data Access World Bank datasets free of charge
NADA Access survey microdata and documentation
iSimulate Collaborate on economic forecasting
ADePT Automate economic analysis of survey data
PovcalNet Estimate poverty and inequality
PovMap Software for poverty mapping
AidFlows Easy access to global data on aid funding
WITS Access international trade and tariff data
Mapping for Results Map projects, compare with development data
Apps for Development Competition
• First global competition to
create innovative software
applications for development
• Must use some World Bank
data, and address one of the
MDGs
• Aim is to bring together
software developers and
development practitioners
• Closes 10 January 2011
Open Data
A vision for the future
“Imagine this: A health care worker or
parent in a village, with a laptop or
mobile device, can access development
knowledge in real time through geocoding and mapping. She can see which
schools have feeding programs and
which go without, and what is
happening to local health…. She can dig
deeply and compare her village with
others. She can upload her own data,
throw light on the likely effect of new
interventions, and mobilize the
community to demand better or more
targeted health programs.”
Robert B. Zoellick,
2010, Washington DC
Thank you
[email protected]
[email protected]
data.worldbank.org