Transcript 8 th Oslo Group meeting in Azerbaijan, 24-27 September 2013 Quality management and metadata for crude oil statistics in the SSC of the Republic.

8 th Oslo Group meeting in
Azerbaijan, 24-27 September 2013
Quality management and metadata for
crude oil statistics in the SSC of the
Republic of Azerbaijan
Yusif Yusifov
Deputy chairman of the State
Statistical Committee of the Republic
of Azerbaijan
[email protected]
1
Outline
1.Quality management and metadata in the
SSC of the Republic of Azerbaijan
2.GSBPM for energy statistics
3.GSBPM for crude oil statistics: phases
4.Sub-processes and activities for oil statistics
5.Challenges
2
Quality management and metadata
in the SSC of the Republic of
Azerbaijan.
Metadata as new challenges for world statistics
Quality management and metadata system is
one of the recommendations of Global
Assessment of the official statistics of Azerbaijan
which organized by Eurostat,The European Free
Trade Association(EFTA) and United Nations
Economic Commission (UNECE) for Europe in
2010.
3
Activities of Azerbaijan on Quality Management
2010
 Decision about creation of “Quality Management system”
 Ratification of policy and aim about Quality Management
 Creation of new sector for implementation “Quality Management”system
2011
 Quality management system has been applied to the Industry ,Transport
and communication and Price statistics sectors of Community as pilot project.
2012
 Creation of “Quality Management and Information Technology “
department for effective coordination activities on SSC.
 Ratification of “Activity plan 2012-2013”about implementation of Quality
Management and Metada system.
 Starting implementation Quality management to all sections of the
Committee.
2013
 Starting implementation QM system to local statistics organizations of
SSC.
 Realization of internal audit to find out condition on divisions of SSC.
4
Forming of external audit by certification organization
Original external
audit
Period of audit
Area of audit
Direction of audit
• Contact with Quality Management
system (25 June 2013)
• 04-09 July 2013
• Departments of SSC
• Condition of implementation of
ISO 9001:2008 in SSC
5
İSO 9001: 2008
Bureau Veritas
Certification certify that
the Management System
of the organisation has
been audited and found
to be in accordance with
the requirements of the
management system
standard İSO 9001: 2008
Original certification date:
6
What is GSBPM?
 GSBPM is a speedy tool which gives an opportunity to
standardize ,operation, organize single mechanism of production
and minimize the mistakes of the management.
This model enables coordinate the process with human
resource and realize the system with the qualified technological
route.
The structure of the model
GSBPM consist of 4 levels :
1. Statistics-business process
2. 9 Steps of statistics-business
process
3. Sub-process of each step
4. Description of the sub-processes
7
Why GSBPM for energy
statistics
 Associated with forming ISO 9001:2008 Quality
Management in the State Statistical Committee of the
Republic of Azerbaijan
 Recommendation of Global Assessment to the State
Statistical Committee
 Common way for describing process steps
 Appreciation of the accumulation, usage, evaluation
process of the energy statistics indexes
 Challenges
 Achievement of the Committee
8
Advantages of GSBPM on energy
statistics
GSBPM facilitate management of processes
Emend the mistakes in time
Systematic approach to the problems
Increase belief of users
Increase quality of statistics information
9
Our strategy
Improve the base
of the energy
statistics process
taking into
consideration the national
version of GSBPM.
Our aim
The aim of the GSBPM is provision of the
base of metadata system with the
standard nomenclature.
10
“Generalized Model of Statistical
Business Processes” (GSBPM)
“Methodological
Conception of
Existing Process
on Management
System on Energy
Statistics”
Standards and map of
management of
statistical processes on
industry and
construction statistics”
11
Model GSBPM for energy
statistics
Specify needs
Process
Design
Analysis
Build
Disseminate
Collect
Archive
Evaluate
12
Model GSBPM for oil statistics
Specify needs
Analysis
Design
Disseminate
Build
Collect
Archive
Process
Evaluate
GSBPM model for
oil statistics is
identical to the
model of GSBPM on
energy statistics.
13
Continue of phase 1
Phases and sub-processes for energy statistics
1.Specify needs
1.1
Determine
need for
information
1.2 Consult
and confirm
needs
1.5 Check
data and
metadata
availability
1.3
Establish
output
objectives
1.4 Identify
concepts
1.6 Prepare
business
case
14
Continue of phase 1
1. Specify needs
Determine the need
on crude oil statistics
Input
Output
International
methodology,
questionnaire,
presentation, users
request, orders, decrees
Improved official
statistical
questionnaires
15
Input
1.1
Determine need for information
International
requirements and
recommendations orders,
decrees, reports,
presentations
Identification
of need on
crude oil
statistics
1.2
Consult and confirm need
Input
Offers from SOCAR
and MIE
Implementation of discussion
with SOCAR and MIE on
improvement of crude oil
indicators and its
coordination and confirmation
Continue of phase 1
Output
Study needs of
data users
Output
Minutes of
meetings, works and
written agreement
16
Continue of phase 1
Input
1.3
Establish output objectives
Decrees and orders
of the SSC
Create viable
definitions of the
variables
Output
Conceptual definitions
of variable, table
outlines
1.4
Identify concepts
Input
Standards, control
checking concepts
Output
Identify concepts
Improved
concepts
17
Input
1.5
Check data and metadata availability
Output
Issues with SOCAR and MIE
the project approved by
Methodological Council,
decrees and orders of the
SSC
Input
Projects,
estimations
Determine
internal and
external
sources
Agreements,
strategy, analysis
1.6
Prepare business case
Make a project
work plan,
determine the
budget
Results Phase 1. Approved projects and plans
Output
Work plan,
budget
18
Continue of phase 2
2. Design
2.1 Design
outputs
2.2 Design
variable
descriptions
2.5 Design
statistical
processing
methodology
2.3 Design
data
collection
methodology
2.4 Design
frame and
sample
methodology
2.6 Design
production
systems and
workflow
19
Continue of phase 2
2.Design
Discussion of the program
on processing of the
instructions on filling in of
the report forms (6extraction (oil, gas) 1-TİG
(oil), 1-balance (oil)) in PC
Input
Questionnaires,
output tables, set
of indicators
Output
Layout of the
output tables
20
2.1
Design outputs
Input
Questionnaires,
output tables, set
of indicators
Input
Design outputs
2.2
Design variable descriptions
Letters of agreement,
resolution, register
Design variable
descriptions, surveys,
registers
Continue of phase 2
Output
Layout of the
out
put tables
Output
Harmonization of
clarification
21
Input
2.3
Design data collection methodology
Metadata
Definition report
coverage
Continue of phase 2
Draft metadata
2.4
Design frame and sample methodology
Output
Input
Survey plan
Determination of
frame of survey
and plan to
conduct survey
Actual register
22
Input
2.5
Design statistical processing
methodology
Letters of agreement ,
Methodological Council s
resolution
Input
Design statistical
processing
methodology
Output
Statistical processing
methodology
2.6
Design production systems and
workflow
Output
Division of work on
Department of Industry
and Construction
Statistics
Including of report
forms reflecting
crude oil data in
statistical work
Preparation of
work plan
program
Results Phase 2. All designs approved
23
Continue of phase 3
3. Build
3.1
Construct
components of
data collection
issues
3.2
Build or
enhance process
components
3.5
Test statistical
business
process
3.3
Configure
workflow
3.4
Test production
system
3.6
Finalize
production
system
24
Continue of phase 3
3. Build
Create process
components
Input
Instruments
Output
Production
system
25
Input
3.1
Construct components of data
collection issues
Issues, instruments
Build system
Continue of phase 3
Output
Production system
3.2
Build or enhance process components
Input
Output
Instruments
Build process
components
Created
components
26
Input
Raise the issue
3.3
Configure workflow
Preparation of
reports
Continue of phase 3
Output
Reports
3.4
Test production system
Input
Raise the issue
Test production
system
Output
Take over
27
3.5
Test statistical business process
Input
Output
Raise the issue
Test statistical
business process
Take over
3.6
Finalize production system
Input
Output
Staffs, production
system
Finalize production
system
Skills,
production
system
Results Phase 3. System in production
28
Continue of phase 4
4. Collect
4.1
Select sample
4.3
Run collection
4.2
Set up collection
4.4
Finalize collection
29
Continue of phase 4
4. Collect
Data collection
Input
Output
Data
Data
30
4.1
Select sample
Input
Set of
observation
Including all economic
subjects engaged in crude
oil extraction,
consumption, import and
export in reporting
register
Continue of phase 4
Output
List of statistical
units presenting
reports 6-extraction
(oil, gas) 1-TİG
(oil), 1-balance (oil)
4.2
Set up collection
Input
Questionnaires data
Output
Set up
collection
Data
Data
31
4.3
Run collection
Input
Raise the issue
Output
Online collection of the
reports
Data
4.4
Input
Finalize collection
Output
Finalize collection
Data
Results Phase 4. Data ready for processing
Data
32
Continue of phase 5
5. Process
5.1
Integrate
data
5.2
Classify
&coding
5.5 Derive new
variables &
statistical units
5.6 Calculate
weights
5.3 Review,
validate &
edit
5.7
Calculate
aggregates
5.4 Impute
5.8 Finalize
data files
33
Continue of phase 5
5.Process
Classify and mode,
micro edit, control,
imputation, calculate
weights
Input
Output
Data
Statistical data
34
5.1
Integrate data
Input
Data and registers
Input
Units data
Continue of phase 5
Output
Link data sources
and statistical
registers
5.2
Classify & coding
Classification and
coding
Integration of data
Output
Data
35
Input
Data
5.3
Review, validate & edit
Review, validity
check and editing
Continue of phase 5
Output
Validated data
5.4
Impute
Input
Data
Identification of
potential errors
and missing
Output
Estimated data
36
Continue of phase 5
5.5
Derive new variables & statistical units
Input
Output
Results of
monitoring
Derive new
variables&
statistical units
Variable
5.6
Calculate weights
Input
Approved notes by
MCC
Output
Calculate weights
Data
37
5.7
Calculate aggregates
Input
Output
Approved notes by
MCC
Input
Data
Calculate
aggregates
5.8
Finalize data files
Finalize data files
Data
Output
Store micro-data
Results Phase 5. Data ready for analysis
38
Continue of phase 6
6. Analysis
6.1
Prepare draft
outputs
6.2
Validate
outputs
6.3
Scrutinize &
explain
6.4
Apply disclosure
control
6.5
Finalize
outputs
39
6. Analysis
Input
Data
Produce statistics,
quality of data,
preparation of data,
finalize
Continue of phase 6
Output
Ready data
6.1
Prepare draft outputs
Input
Primary output
Preparation of initial
results based on 6extraction (oil, gas) 1TİG (oil), 1-balance
(oil) reports
Output
Output
40
Input
Primary output
6.2
Validate outputs
Validate outputs
Input
6.3
Scrutinize & explain
Summarized data
based on reports
Explanation of results
based on output data
Continue of phase 6
Output
Validated outputs
Output
Data
41
6.4
Apply disclosure control
Input
Summarized data
based on reports
Preserve
confidentially of
primary data
Output
Control of preserve
confidentially of
primary data
6.5
Finalize outputs
Output
Input
Summarized data
based on reports
Prepare final result
Final outputs for
user
Results Phase 6. Analysis ready to dissemination
42
Continue of phase 7
7.
Disseminate
7.1
Update
output
system
7.4
Promote
dissemination
products
7.2 Produce
dissemination
products
7.3
Manage release
of dissemination
products
7.5
Manage users'
inquires
43
Continue of phase 7
7. Disseminate
Input
Output
Analysis and
data
Input
Dissemination of
oil data
Analysis and
data
7.1
Update output system
Register on
dissemination of the
issues
Update of oil data
Analysis and data
44
Continue of phase 7
Input
7.2
Produce dissemination products
Register on
dissemination of the
issues
Input
Oil data production
Output
Analysis and
data
7.3
Manage release of dissemination
products
Working plan on
statistical analysis,
catalogue of
statistical
publications
Manage oil release
products
Output
Notify users of
release
45
Input
7.4
Promote dissemination products
Dissemination
products
Promote dissemination
products
7.5
Manage users' inquires
Input
The assignment of
chairman or deputy
chairman of the
Committee
Manage questionnaires
on oil, filling of
questionnaire
Output
Manage of
products
Output
Meet requirements
of users
Results Phase 7. Statistics disseminated
46
Continue of phase 8
8.Archive
8.1Determine
the rules of
archive
8.2Management
of archive
8.3Support of
information and
metadata
8.4Extermination
of metadata and
information
8.1.1. Reference
to standard legal
acts
8.2.1. Creating
of archive
catalogue
8.3.1.
Identification of
metadata and
information
8.4.1. Make
actual the
information
8.1.2 Preparation
of theory about
archive
8.2.2. Check out
archive and
expulsion process
8.3.2 .
Overcharge and
renewal of
information
8.4.2.
Extermination of
metadata and
information
8.1.3 Solution of
planning and
forming tasks of
archive
operations
8.2.3.
Determination the
completeness of
metadata and
information
8.3.3. Catalogue of
metadata and
information
8.4.3. Document the
extermination
8.2.4 Format of
archive
8.3.4. Verify of
archive
47
Continue of phase 8
8.Archive
Archive
Input
Procedural
nomenclature, data
and metadata
Output
Archive
48
Input
Procedural
nomenclature
Input
Procedural
nomenclature
8.1
Determine the rules of
archive
Determine archiving
rules
8.2
Management of archive
Determine
archiving rules
Continue of phase 8
Output
Documents
Output
Documents
49
8.3
Support of information and
metadata
Input
Preserve data and
associated metadata
Data and
metadata
Input
8.4
Extermination of metadata and
information
Data and metadata
Dispose of data &
associated metadata
Results Phase 8. Statistics archived
Output
Archive
Output
Archive
50
9.Evaluate
Continue of phase 9
9.1. Gather
evaluation inputs
9.2 Conduct
evaluation
9.3 Agree action
plan
9.1.1Creating of
team
9.2.1. Analysis
and include on a
report
9.3.1. Forming
action plan
9.2.2. Reference
9.3.2 Determine
monitoring
mechanism
9.1.2 Gather the
materials of
precedent
evaluation
9.1.3Present
materials to the
team
9.3.3 Confirm action
plan
51
9.Evaluate
Input
Evaluation
materials
Input
Gather
evaluation inputs
Continue of phase 9
Output
Evaluate of
processes
9.1
Gather evaluation inputs
Gather evaluation
inputs
Evaluation
Output
Evaluation
52
9.2
Conduct evaluation
Input
Conduct
evaluation
Output
Conduct evaluation
Evaluation
9.3
Agree action plan
Output
Input
Agree action
plan
Agree action plan
Results Phase 9. Evaluate
Evaluation
53
Challenges
Operate the processes of energy statistics on the
basis of GSBPM in detail.
 Provide possible relations of the processes .
To form the metadata op detailed processes.
Organize trainings and development programs
about GSBPM.
Explore the methodology, recommendations and
innovative plans accepted by the international
organizations and determine expediency of
application standards.
54
55