Transcript Document

USAID’s Open Data Policy
ADS 579 – Development Data
Center for Data Innovation
December 9, 2014
Mission Statement:
“We partner to end extreme poverty and to promote resilient,
democratic societies, while advancing our security and prosperity.”
2
Illustrative Data Collection / Data Storage Location:
3
OPEN DATA: GLOBAL CONTEXT
United Nations - Data Revolution Advisory Group
•
August 2014 - To “close data gaps and to strengthen national statistical
capacities” in support of the post-2015 development agenda
International Aid Transparency Initiative
•
November 2011 – USG as signatory, to “improve the transparency of
aid, development and humanitarian resources” via a common standard
for the publication of aid information (via www.foreignassistance.gov)
Open Government Partnership
•
September 2011 – USG as member, to “foster a global culture of open
government that empowers and delivers for citizens.”
4
OPEN DATA: U.S. CONTEXT
“My Administration is committed to creating an unprecedented level of openness in
Government. We will work together to ensure the public trust and establish a
system of transparency, public participation, and collaboration.”
- President Barack Obama
Memorandum on Transparency and Open Government
January 2009
“To promote continued job growth, Government efficiency, and the social good that
can be gained from opening Government data to the public, the default state of
new and modernized Government information resources shall be open and
machine readable.”
- President Barack Obama
Executive Order -- Making Open and Machine Readable the New Default for
Government Information
May 2013
5
Pre-Policy Data Flow:
Grants, contracts,
cooperative agreements
Narrative Reports via
Development Experience
Clearinghouse
(dec.usaid.gov)
Implementing
partners
International
development programs
Aggregate data captured in
corporate systems. - Raw
datasets generally not
included in central systems.
Program
data
6
USAID - Funded
Data
Access
Challenges
USAID’s Open
Data Policy
USAID
Priorities
Ownership
Questions
Specification
of Deliverables
Joint
Funding
Science
Technology
Innovation
Data
Quality
Partnership
Business
Processes
Definition
of Data
7
USAID OPEN DATA POLICY MILESTONES
May 2013
Open Data
Executive
Order and OMB
Policy
January 2011
USAID
Evaluation
Policy
November 2013
Create
USAID.GOV/DATA
March 2014
Establish
Business
Process for
Data Clearance
June – July
2014
Policy
Revisions
August –
September
2014
Policy Final
Clearance
August 2013
September
2013
Draft
Procurement
Language
Establish Data
Governance
January 2014
Formalize
Working Group
February 2014
Begin Drafting
Policy
April 2014
May 2014
Policy
Socialization
and FAQ
Agency Policy
Clearance
Begins
November 2014
October 2014
Policy Takes
Effect
Implementation
and
Socialization
8
WHAT
USAID’s Open Data Policy:
1. Defines USAID’s Data Governance Structure
o
Information Governance Committee (InfoGov). Executive level
committee to ensure Agency-wide buy-in and coordination.
2. Establishes Data Submission Mechanism via the
Development Data Library (DDL)
o
Repository of USAID-funded data at www.usaid.gov/data
3. Outlines Standard Data Clearance Process
o
Reviews for privacy, personal security, and operational
sensitivity, etc.
4. Creates Data Stewards in Every USAID Operating Unit
o
Local policy expert; provides guidance on data clearance.
9
HOW
1.
Procurement Language
o
Effective for contracts, grants, cooperative agreements issued on or
after October 1, 2014:
The Contractor / recipient must submit to the Development Data Library
(DDL), at www.usaid.gov/data, in a machine-readable, non-proprietary format,
a copy of any Dataset created or obtained in performance of this award,
including Datasets produced by a subcontractor at any tier.
2.
CORs / AORs Responsible for Ensuring Data Submission to DDL
o
3.
Should include data as a deliverable in contracts whenever possible
Data Stewards Guide Operating Units on Policy Implementation
o
o
Continue socializing the open data mandate
Specialized training
10
Role of the U.S. Global Development Lab
To increase the application of
science, technology, innovation
and partnerships to achieve,
sustain and extend the agency’s
development impact to help end
extreme poverty.
11
How Do We Connect with Data Producers and Users?
Challenges:
- Policy and logistical complexities of opening data.
- Cataloging the breadth of the data we have.
- Understanding the audience for our data.
Approach:
- Need-finding interviews with our audiences.
-
Developing guidance on how to make data useful to our audience.
-
Creating opportunities to connect people who generate data and
those who use data.
12
What Does Our Audience Want?
•
What doesn’t matter: If the data are good, there will be an
audience for them.
•
…but standards do: Data become valuable when they can be
combined with other information.
• Data producers and consumers are not aware of mutual
interests.
– Much of the research/journalist community isn’t aware
USAID has data that would interest them.
– Data generators are disconnected from researchers: “We
know the broad stakeholders but we’re not able to figure out
who would want our data or how to get it to them.”
• USAID is seen as a source for guidance on how to manage
knowledge, establish data pipelines, and create standards for
data collection.
13
What makes data useful?
• Consistency: “The largest problem isn’t whether or not data are
open, but whether or not they are standardized and
comparable.”
• Explicit relationship between data: Unique and consistent IDs to
connect data
• Scale: Comparable data across multiple countries
• Uniqueness of the data: Data difficult/impossible to access any
other way.
• Documentation: “How the data are collected is the most value
added but is the hardest part.”
• Timely: Recent, ideally real-time data.
• Easily accessible: Web-based interface where the data can be
downloaded at the drop of a hat.
14
Public Engagement: Hackathons
Hacking for Hunger
• USAID
• Palantir
• Grameen
• 28,000 geo-located soil samples from Uganda (Grameen)
• Combine with soil types, population, income (Palantir)
• Develop a system to track the outbreak of crop and livestock
diseases
15
Public Engagement: Hackathons
Ingredients for Success:
1. Have a well defined
question.
2. Have a clearly defined
entry point for non-experts.
3. Mix multiple viewpoints.
Next Up: January 29-30, 2015
at Open GovHub
16
Open Data Grant
Connecting Data Demand with Data Supply
-
We identify high priority datasets, focusing on those that are
directly relevant, interesting, and useful for the broader community.
-
Applicants provide a proposal for how they would use those data.
-
We open up those data and help create a community to collaborate
on those data.
Provide Your Input:
http://bit.ly/AIDdatagrant
17
NEXT STEPS
1.
Internal socialization / change management across all USAID
operating units
2.
Increased public engagement, including policy feedback
3.
Ongoing improvements to the Development Data Library
4.
External engagement, including implementing partners
REFERENCES
Policy Announcement: http://1.usa.gov/1tF8COg
Policy: http://1.usa.gov/1zi21Mc
Fact Sheet: http://bit.ly/ADS579onepager
18
How Can I Contribute to this Discussion?
StackExchange (general questions):
http://bit.ly/1FSzL3t
GitHub (technical questions):
http://bit.ly/1DqewSB
Email:
[email protected]
Data Grant Survey:
http://bit.ly/AIDdatagrant
Brandon Pustejovsky
Chief Data Officer
Laura Hughes
Open Data Specialist
19