Transcript Use of Administrative Data in U.S. Energy Statistics by Stephen Harvey of the U.S. Energy Information Administration

Use of Administrative Data in EIA’s
Data Program
For
10th Meeting of the Oslo Group on Energy Statistics
May 12, 2016 | Aguascalientes, Aguascalientes, Mexico
By
Stephen Harvey, Assistant Administrator for Energy Statistics
U.S. Energy Information Administration
Independent Statistics & Analysis
www.eia.gov
U.S. Energy Information
Administration (EIA)
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
2
What EIA does
• Statistical and analytical agency within the U.S. Department of
Energy
• Collect, analyze, and disseminate independent and impartial energy
information
• Committed to promoting:
– Sound policymaking
– Efficient markets
– Public understanding
of energy and its interaction with the economy and the environment
• By law, EIA data, analyses, and forecasts are independent of
approval by any other officer or employee of the U.S. government
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
3
Selected EIA strategic data objectives
• Maintain an integrated, comprehensive data program
• Improve the data planning and development process
• Establish and implement standard, reusable processes
• Evaluate and implement improvements on a regular basis
• Improve the survey respondent experience through
– Effective communications
– Clear definitions and instructions
– Facilitated submissions through technology
• Protect the confidentiality of data entrusted to EIA
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
4
Federal Policy Regarding
the Use of Administrative Data
in Official U.S. Statistics
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
5
U.S. statistical policy promotes the
increased use of administrative data
• Definition: “..administrative, regulatory, law enforcement,
adjudicatory, financial, or other data … collected for
other than statistical purposes.”
• “The increased use of administrative data for statistical
purposes can generate a range of benefits. Most
notably, individuals, businesses, and institutions will
benefit through agencies' use of existing information that
would otherwise need to be collected from them again
through costly and duplicative surveys.”
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
6
Four goals of U.S. policy
regarding use of administrative data
• Strengthen the federal statistical programs by increasing the utility
of and access to administrative data.
• Promote collaboration between agencies on expanding use of
administrative data, while protecting privacy and respecting
confidentiality parameters.
• Establish best practices and a model for inter-agency data sharing
for statistical purposes.
• Identify and monitor barriers that may impede agencies sharing
administrative data.
Office of Management and Budget (OMB) Memorandum M-14-06 “Guidance for
Providing and Using Administrative Data for Statistical Purposes,” February 14, 2014,
https://www.whitehouse.gov/sites/default/files/omb/memoranda/2014/m-14-06.pdf
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
7
EIA Program Innovation and
Calculated Use of Administrative Data
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
8
EIA already makes
extensive use of administrative data
• Fill data gaps
• Review quality of survey results
• Calculate non-sample estimates
• Provide inputs to models
• At least 62 administrative datasets used for data
publications and models – likely undocumented
uses of administrative data in analyst-driven quality
reviews
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
9
Important areas where EIA uses
administrative data
• Imports and exports of energy
• Buildings lists for consumption survey sampling
• Oil and natural gas production in certain areas
• State-level breakouts of energy production and use
• Energy transportation by rail
• Financial operations of energy companies
• National Oceanic and Atmospheric Administration local
weather data
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
10
Administrative data may not meet all needs:
EIA’s oil production experience
• Modeled oil and gas production
based on tax data reported by the
state of Oklahoma
• Data lagged, with delays in posting
volumes for near months
Thousand
b/d
500
Comparison of Oklahoma
Monthly Crude Oil
Production Estimates, 2015
Survey estimate
450
400
350
• Model estimated how lagged data
was likely to be based on past
trends
• In 2015, EIA began surveying oil
and gas companies directly
EIA estimate
based on
administrative data
300
250
200
150
Oklahoma
administrative
data
100
50
• Materially changed assessment of
Oklahoma estimates
0
Jan
Feb
Mar
Apr
EIA-914 Estimate
May Jun
2015
Jul
Aug
Sep
ALR Estimate
State Data derived from well-level figures
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
11
Recent coordination promises significant
enhancement of petroleum supply balances
• Near-real-time petroleum export data promises significant
improvement in EIA petroleum balance reports
• EIA summarizes the previous week’s petroleum complex supply
balances every Wednesday, including oil supply, refinery
production, imports, and exports
• Many elements surveyed, but weekly oil production and petroleum
product exports are estimated
• Agreement with U.S. Customs and Border Protection now permits
EIA analysts to see near-real-time export data
• Working with OMB and the U.S. Census Bureau (publishes official
U.S. export data) to reach agreement to incorporate estimates
based on this data into the weekly balances
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
12
For more information
U.S. Energy Information Administration | www.eia.gov
Short-Term Energy Outlook | www.eia.gov/steo
Annual Energy Outlook | www.eia.gov/aeo
Monthly Energy Review | www.eia.gov/mer
EIA Information Center
[email protected]
(202) 586-8800
24-hour automated information line about EIA
and frequently asked questions.
Stephen Harvey, U.S. Energy Information Administration
Aguascalientes, Mexico, May 12, 2016
13