Transcript PPT

CountryData
SDMX for
Development Indicators
Metadata in DevInfo:
Creation, Mapping and
Registration
Metadata
• According to the ISO;
“Metadata is data that defines and describes
other data.”
• Perhaps, better visualized as layers within a pyramid.
• Information describing the data is more detailed as
one moves down from the top of the pyramid.
“Structural” metadata
1. At the top of the pyramid is information essential for
understanding the data
•
Needs to explain the ‘basics’ of when, where, who and
what?
Reference metadata
2. In the middle are explanatory notes and text
generally located in the same “publication”
provides a good description of the statistics
•
definitions, key issues, limitations, etc., that can
impact on the use of the data.
Methodological metadata
3. Detailed methodological information disseminated in
publications / websites.
•
•
These are potentially the source of the most detailed
methodological information available.
Some statistical agencies publish very detailed
concepts, sources and methods for a number of their
key statistics.
CountryData Metadata Structure
Definition (MSD) background


Developed by UNSD for CountryData
Supports exchange of CountryData Indicator
metadata between countries and UNSD



Implemented in SDMX 2.0
Design to exchange higher level reference
metadata
Latest version (1.0) finalised in Dec 2012
DevInfo (Di) background

Data and metadata dissemination software
supported and promoted by UNICEF

DevInfo7 (Di7) launched in Nov 2012


7 out of 11 project countries plan to
share metadata through DevInfo
Good support for metadata collation and
exchange.
Mapping to the MSD
Metadata mapping from DevInfo to MSD is
much simpler than data mapping.

MSD structure is simpler and no part is
mandatory.

Expectation that at least “Definition”, “Method of
Computation” and “Process of obtaining data” are
available.

Open metadata in admin tool…
Set metadata structure…
Edit metadata by indicator…
Export list to excel…
Export all or selection…
Create/ choose excel file…
Open excel file and edit…
Import file into di database…
Select excel file used to edit…
Import excel file used to edit…
New metadata imported…
Di Mapping Tool: Introduction

Once the metadata is entered into the
database, then can use “DX Remote Access”
to update di7 web-based software in same way
as data

Once metadata exists in di7 web then
metadata can be mapped and published which
conforms with the CountryData MSD.

Like for data, this is all done online through the
di7 web-based repository through the
administration profile, so let’s begin…
Getting Started…
Scroll down to ‘Registry’ menu
Log onto administrative profile
Prepare the Dbase for mapping
Prepares the SDMX artifacts
If DSD in place, ready to map…
Metadata mapping

To map metadata,

First, map the associated time series through (1st
stage) codelist and (2nd stage) IUS

Once this is complete move to mapping metadata
Metadata mapping
Metadata mapping
MSD Concepts
Definition of the MDG
official indicator or
background series
provided
Method of computation
Describes the basic definition and includes references to standards and classifications and clarification of technical terms included in
the definition.
Sources of discrepancies
between global and national
figures
Treatment of missing values
Describes the main reasons for discrepancy between data and metadata used for national and global monitoring to improve
understanding by users of the differences between country-level data disseminated through the MDGs global database and those
available in country MDGs databases.
Describes the process and provides the mathematical formula to produce the estimates for the indicator when country data are not
available.
Describes (a) country coverage; (b) universe/population of interest; (c) time lag between reference year and actual production of data
series; (d) overview of frequency of data production.
Provides the mathematical formula and describes the method used for the calculation of the regional/global aggregates from the
country values. Specifies what types of weights are used for aggregating country indicator values to regional level.
Describes the algorithm used in the calculation of the indicator, providing the mathematical formula (if applicable). Identifies all
statistics used to derive the indicator such as normalizing and weighting variables (for instance, the population). List different methods
used by country or agency to compute the indicator and includes hyperlinks to references to the agency international or national
methodology adopted if available.
Process of obtaining data Describes the mechanism for gathering data from countries including: (i) the government counterpart at the country level; (ii)
description of the existing process of validation and consultation with countries. Describes the process of adjusting country data to
allow international comparability. This includes adjustments such as: to a standard classification, age group or to comply with a
specific international or national definition.
Comments and limitations Describes comments and limitations of the indicators including issues such as: comparability, sex disaggregating if applicable,
presence of wide confidence intervals (such as for maternal mortality ratios). Provides further details on additional non-official
indicators commonly used together with the official MDG indicator.
Expected time of release Provide the expected calendar of release for new data for each indicator, by the specialized agencies.
Data availability
Regional and Global
estimates
Map Metadata concepts
Confirm mapping saved
Final Step: Register the mappings
Final Step: Select mappings
Final Step: Generate SDMX-ML
Final Step: Complete
Exercise: Publish metadata

Use unstats.un.org/unsd/demodiweb[1-6]
Username = [email protected]
Password = support@2012

Publish/ register the time series for


1.
2.
3.
4.
5.
“Maternal mortality ratio (MMR)”
“Employment to population ratio”
“Share of women in wage employment in the nonagricultural sector”
“Infant mortality rate”
“Land under forest cover”
MSD Maintenance
• The mapping and registry tool allows users to edit
and delete the MSD (has to be packaged with the
DSD and uploaded in DevInfo).
• For when the MSD is updated, it is recommended to
edit the DSD/MSD rather than delete
• MSD/DSD deletion has the effect of removing all
the mappings and subscriptions used for that
MSD/DSD
MSD Maintenance…
MSD Header…