Transcript The Role of Metadata in Census Data Dissemination United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis Amman, Jordan 16-19 May 2011

The Role of Metadata in Census Data
Dissemination
United Nations Regional Seminar on Census Data
Dissemination and Spatial Analysis
Amman, Jordan
16-19 May 2011
Outline
• What is metadata?
• What does metadata do?
• Types of metadata
• Metadata in census data dissemination
• Metadata standards: current situation
• Conclusion
What is metadata?
• It is structured information or documentation about data
which:
– informs users about the content, quality and condition of
data;
– describes the structure of datasets, explains, locates, or
makes it easier to retrieve, use, or manage data;
– provides information on the processes of data production;
– guides on proper usage or interpretation of data.
• “Data that define and describe other data” (ISO definition)
• “Information about information” (Dion, 2006)
What does metadata do?
•
•
•
•
•
Assist in retrieving and processing data
Support correct use of data
Provide transparency in data
Enhance interoperability
Improve archiving, preservation, institutional
memory over time
Types of metadata
• Structural metadata
– provide information about the structure of the dataset
– act as identifiers and descriptors of the data, making it
possible to properly identify, retrieve and browse the data
• Reference metadata
– allow a thorough understanding and interpretation of the
corresponding statistical data
– Describe the concepts, definitions, methodology and quality of
data; production and dissemination process, data access
conditions, release policy, confidentiality, etc
Metadata in Census Data Dissemination
All tabulations of census data should include:
–
–
–
–
–
Census questions
Reason why the questions are asked
Conceptual definitions
Geographic hierarchies used
Changes since the previous census, regarding content,
operational methods or geographic boundaries
– Quality indicators (ex. coverage rates and item non-response)
– Methodological note on the rules and methods applied
If a long-form sample is used...
– Sampling design, size, sampling variability of the results
(P&R, 2008)
Metadata standards: current situation
•
Currently, data dissemination and exchange take place
in ad-hoc manner, using all kinds of non-standard format.
Common standards and guidelines are needed to enable
more efficient exchange of statistical data.
• Standard metadata system will:
– ensures consistency and comparability of content
– avoids duplication and diversity of definitions
– ensures reduction in cost of data development
Metadata standards (cont’d)
Two international metadata standards are becoming well
established:
- SDMX (Statistical Data and Metadata Exchange)
a number of international agencies have endorsed SDMX;
supported by the UN Statistical Commission
-DDI (Data Dissemination Initiative)
Microdata Management Toolkit of WB uses the DDI
metadata standard
Conclusion
• Metadata are at the heart of the information
management.
• They should be an integral part of statistical
dissemination strategies.
• Standards for metadata management are important to
develop.
• Regional and international collaboration between NSOs is
an important consideration
Thank you !
Users of metadata
Metadata support the knowledge of potential user
of statistical information. The major users include:
– Users of statistical data
– Producers of statistical data
– Researchers on the development of statistical
systems
Points for discussion
- What are the success factors of metadata?
• Strategies?
• Infrastrucure?
• Resources?
- How to ensure the security of metadata?
- How “open” or “transparent” the metadata can be?
- How to improve standerdization of metadata?