Transcript PPT
CountryData SDMX for Development Indicators Metadata in DevInfo: Creation, Mapping and Registration Metadata • According to the ISO; “Metadata is data that defines and describes other data.” • Perhaps, better visualized as layers within a pyramid. • Information describing the data is more detailed as one moves down from the top of the pyramid. “Structural” metadata 1. At the top of the pyramid is information essential for understanding the data • Needs to explain the ‘basics’ of when, where, who and what? Reference metadata 2. In the middle are explanatory notes and text generally located in the same “publication” provides a good description of the statistics • definitions, key issues, limitations, etc., that can impact on the use of the data. Methodological metadata 3. Detailed methodological information disseminated in publications / websites. • • These are potentially the source of the most detailed methodological information available. Some statistical agencies publish very detailed concepts, sources and methods for a number of their key statistics. CountryData Metadata Structure Definition (MSD) background Developed by UNSD for CountryData Supports exchange of CountryData Indicator metadata between countries and UNSD Implemented in SDMX 2.0 Design to exchange higher level reference metadata Latest version (1.0) finalised in Dec 2012 DevInfo (Di) background Data and metadata dissemination software supported and promoted by UNICEF DevInfo7 (Di7) launched in Nov 2012 7 out of 11 project countries plan to share metadata through DevInfo Good support for metadata collation and exchange. Mapping to the MSD Metadata mapping from DevInfo to MSD is much simpler than data mapping. MSD structure is simpler and no part is mandatory. Expectation that at least “Definition”, “Method of Computation” and “Process of obtaining data” are available. Open metadata in admin tool… Set metadata structure… Edit metadata by indicator… Export list to excel… Export all or selection… Create/ choose excel file… Open excel file and edit… Import file into di database… Select excel file used to edit… Import excel file used to edit… New metadata imported… Di Mapping Tool: Introduction Once the metadata is entered into the database, then can use “DX Remote Access” to update di7 web-based software in same way as data Once metadata exists in di7 web then metadata can be mapped and published which conforms with the CountryData MSD. Like for data, this is all done online through the di7 web-based repository through the administration profile, so let’s begin… Getting Started… Scroll down to ‘Registry’ menu Log onto administrative profile Prepare the Dbase for mapping Prepares the SDMX artifacts If DSD in place, ready to map… Metadata mapping To map metadata, First, map the associated time series through (1st stage) codelist and (2nd stage) IUS Once this is complete move to mapping metadata Metadata mapping Metadata mapping MSD Concepts Definition of the MDG official indicator or background series provided Method of computation Describes the basic definition and includes references to standards and classifications and clarification of technical terms included in the definition. Sources of discrepancies between global and national figures Treatment of missing values Describes the main reasons for discrepancy between data and metadata used for national and global monitoring to improve understanding by users of the differences between country-level data disseminated through the MDGs global database and those available in country MDGs databases. Describes the process and provides the mathematical formula to produce the estimates for the indicator when country data are not available. Describes (a) country coverage; (b) universe/population of interest; (c) time lag between reference year and actual production of data series; (d) overview of frequency of data production. Provides the mathematical formula and describes the method used for the calculation of the regional/global aggregates from the country values. Specifies what types of weights are used for aggregating country indicator values to regional level. Describes the algorithm used in the calculation of the indicator, providing the mathematical formula (if applicable). Identifies all statistics used to derive the indicator such as normalizing and weighting variables (for instance, the population). List different methods used by country or agency to compute the indicator and includes hyperlinks to references to the agency international or national methodology adopted if available. Process of obtaining data Describes the mechanism for gathering data from countries including: (i) the government counterpart at the country level; (ii) description of the existing process of validation and consultation with countries. Describes the process of adjusting country data to allow international comparability. This includes adjustments such as: to a standard classification, age group or to comply with a specific international or national definition. Comments and limitations Describes comments and limitations of the indicators including issues such as: comparability, sex disaggregating if applicable, presence of wide confidence intervals (such as for maternal mortality ratios). Provides further details on additional non-official indicators commonly used together with the official MDG indicator. Expected time of release Provide the expected calendar of release for new data for each indicator, by the specialized agencies. Data availability Regional and Global estimates Map Metadata concepts Confirm mapping saved Final Step: Register the mappings Final Step: Select mappings Final Step: Generate SDMX-ML Final Step: Complete Exercise: Publish metadata Use unstats.un.org/unsd/demodiweb[1-6] Username = [email protected] Password = support@2012 Publish/ register the time series for 1. 2. 3. 4. 5. “Maternal mortality ratio (MMR)” “Employment to population ratio” “Share of women in wage employment in the nonagricultural sector” “Infant mortality rate” “Land under forest cover” MSD Maintenance • The mapping and registry tool allows users to edit and delete the MSD (has to be packaged with the DSD and uploaded in DevInfo). • For when the MSD is updated, it is recommended to edit the DSD/MSD rather than delete • MSD/DSD deletion has the effect of removing all the mappings and subscriptions used for that MSD/DSD MSD Maintenance… MSD Header…