United Nations Economic Commission for Europe Statistical Division The Role of Metadata UNECE Training Workshop on Dissemination of MDG Indicators and Statistical Information Astana, Kazakhstan.
Download ReportTranscript United Nations Economic Commission for Europe Statistical Division The Role of Metadata UNECE Training Workshop on Dissemination of MDG Indicators and Statistical Information Astana, Kazakhstan.
United Nations Economic Commission for Europe Statistical Division The Role of Metadata UNECE Training Workshop on Dissemination of MDG Indicators and Statistical Information Astana, Kazakhstan 23 – 25 November 2009 Steven Vale, UNECE Contents What are metadata? Types of users What do the users need? Metadata standards 24.9.2009 Steven Vale - UNECE Statistical Division Slide 2 What Are Metadata? Official definition: “Data that define and describe other data” Metadata are an essential tool to communicate about data (and data quality!) Steven Vale - UNECE Statistical Division Slide 3 What are Metadata? Metadata Title and Units Albania Armenia Austria Azerbaijan 2004 12 24 45 28 2005 2006 13 15 28 29 41 43 28 24 Source: UNECE Footnotes Steven Vale - UNECE Statistical Division 2007 17 28 42 26 Data Slide 4 Types of Metadata Structural metadata • Table / chart titles • Row / column headings • Row / column values • Source information Reference metadata • Footnotes • Definitions • Methodological texts Steven Vale - UNECE Statistical Division Slide 5 Types of users “Tourists” – want basic data and easy to understand metadata Most users are likely to be tourists They are not experts in statistics or databases systems Steven Vale - UNECE Statistical Division Slide 6 Types of users “Harvesters” – want data for basic research or economic decisions, with summary metadata to help them understand data quality They have some statistical knowledge Steven Vale - UNECE Statistical Division Slide 7 Types of users “Miners” – want detailed data for further analysis They need detailed metadata so that they can fully understand the data They are prepared to do some work themselves to get the data Steven Vale - UNECE Statistical Division Slide 8 Layers of Metadata Structural Metadata for “Tourists” Drill down Simple Reference Metadata for “Harvesters” Detailed Reference Metadata for “Miners” Steven Vale - UNECE Statistical Division Slide 9 Most statistical organizations are good at providing ... Structural metadata Simple reference metadata But not so good at ... Detailed reference metadata Steven Vale - UNECE Statistical Division Slide 10 How to Improve Reference Metadata Write the metadata for users not producers Follow international standards for terminology and definitions Develop a simple, easy to use tool for storing and publishing reference metadata Provide clear links from (and to) data Steven Vale - UNECE Statistical Division Slide 11 Metadata Standards Statistical Data and Metadata eXchange (SDMX) Guidelines for Statistical Metadata on the Internet Common Metadata Framework European Commission Recommendation on reference metadata for the European Statistical System Steven Vale - UNECE Statistical Division Slide 12 SDMX Statistical Data and Metadata eXchange A set of technical and content-related standards for data (and metadata) transfer between statistical organizations Recognized as a preferred standard by the United Nations Statistical Commission Technical standards have ISO accreditation • ISO 17369 Steven Vale - UNECE Statistical Division Slide 13 SDMX Content-oriented Guidelines Adopted January 2009 Harmonization of concepts and terminology Main components: • Cross-domain concepts • Cross-domain code lists • Statistical subject-matter domains • Metadata common vocabulary www.sdmx.org Steven Vale - UNECE Statistical Division Slide 14 Guidelines for Statistical Metadata on the Internet Approved by the Conference of European Statisticians Specific advice for web dissemination www.unece.org/stats/publi cations/metadata.pdf Steven Vale - UNECE Statistical Division Slide 15 Common Metadata Framework Being developed with input from national and international statistical organizations, coordinated by the METIS Steering Group. 4 parts: each concentrates on different aspects of statistical metadata systems Latest versions are on the METIS wiki: www1.unece.org/stat/platform/display/metis Steven Vale - UNECE Statistical Division Slide 16 Part A Explains importance of metadata and metadata systems Published on the web Printed version 2009/2010 Steven Vale - UNECE Statistical Division Slide 17 Other Parts in Development Part B: Metadata Concepts, Standards, Models and Registries Part C: Metadata & the Statistical Business Process Part D: Implementation • Case studies from national and international organizations Steven Vale - UNECE Statistical Division Slide 18 European Commission Recommendation on Reference Metadata Promotes standard concepts for reference metadata Consistent with SDMX Legal document but not compulsory Reference: 2009/498/EC Steven Vale - UNECE Statistical Division Slide 19 Summary Metadata help users fully understand data Different users need different levels of detail of metadata Reference metadata provide descriptions of the data and any quality issues International standards are important to ensure harmonized concepts, definitions and presentation of metadata Steven Vale - UNECE Statistical Division Slide 20 Questions? Steven Vale - UNECE Statistical Division Slide 21