Transcript The LIBRARY of CONGRESS JISC-CNI Envisioning Future Challenges in Networked Information York, England July 6, 2006

The LIBRARY of CONGRESS
JISC-CNI
Envisioning Future Challenges
in Networked Information
York, England
July 6, 2006
The LIBRARY of CONGRESS
NDIIPP
NDIIPP:
Key Challenges of
Collaboration and Sustainability
Laura E. Campbell
Associate Librarian for
Strategic Initiatives
July 6, 2006
The LIBRARY of CONGRESS
NDIIPP
Background
• Created by federal legislation (PL 106-554) in
December 2000
• Up to $175 million available with matching
• Guided by National Digital Strategy Advisory
Board (NDSAB)
• Preserving Our Digital Heritage national NDIIPP
plan approved December 2002
3#
The LIBRARY of CONGRESS
NDIIPP
NDIIPP Vision
To ensure access over time to a rich body of digital
content through the establishment of a national
network of committed partners.
4#
The LIBRARY of CONGRESS
NDIIPP
Overall NDIIPP Goals
• Identify and preserve at-risk digital content
• Develop a national digital collection and
preservation strategy
• Support development of improved tools, models,
and methods for digital preservation
• Work with industry, concerned federal agencies,
libraries, research institutions and not-for-profit
entities
5#
NDIIPP
Key Challenges:
U.S. Context for Digital Preservation
• Decentralized activities in many communities
–
–
–
–
–
Government at various levels
Universities
Non-profits
Corporations
Consortial domains (i.e., Earth scientists and
climate data, Biologists and genomic data, etc.)
• Assorted mandates, objectives, approaches
6#
NDIIPP
Answering the Challenges
• LC/NDIIPP to help bring a national focus, encourage
collaboration among communities
• LC is providing resources and leadership
– Working with other institutions to develop common understanding
• Established ‘Affinity Groups’ based on cross-cutting issues
–
–
–
–
Selection and Collection
Rights and Restrictions
Technical Architecture
Economic Sustainability
7#
NDIIPP
A Network of People
An Architecture for Preservation
8#
NDIIPP
Working with Other Federal Agencies
• LC/NDIIPP works with the following agencies
– National Archives and Records Administration
(responsible for federal records)
– National Science Foundation
– Government Printing Office
– National Library of Medicine
– Institute of Museum and Library Services
– National Agricultural Library
– Department of Commerce/National Institute of Science
and Technology
– Office of Science and Technology Policy
9#
NDIIPP
International Context
• LC/NDIIPP engaged internationally:
– Founding member of the International Internet
Preservation Consortium
– Allied with the Digital Preservation Coalition
– Chief Executive of the British Library on
NDIIPP advisory board
– Consulted with many national libraries
concerning digital preservation efforts
10#
The LIBRARY of CONGRESS
NDIIPP
NDIIPP is a Portfolio of Activities
• Four areas of focus
–
–
–
–
Network of preservation partners
Architectural framework for preservation
Digital preservation research
Intellectual Property
• Two phases of investment
– Phase I commenced 2004
– Phase II commenced 2006
11#
The LIBRARY of CONGRESS
NDIIPP
A National Content Stewardship Network
•
•
•
•
8 Consortial Agreements with 36 Participants
10 Digital Preservation Grants
4 AIHT Participants
2 Technical Archiving and Testing Participants
– Diego Supercomputer Center
– Los Alamos National Lab Research Library
• 2 Developers of Preservation Business Models
– Portico
– LOCKSS/CLOCKSS
• 2 International Partnerships
– Representing 12 other national libraries
• 19 Experts on the Section 108 Working Group
12#
The LIBRARY of CONGRESS
NDIIPP
A National Content Stewardship Network
• NDIIPP’s Network is comprised of 28 agreements
and 67 institutions involved in the beginning stages
of building a digital preservation strategy under the
NDIIPP program as well as a major initiative to
address needed changes to copyright law.
• Reflects distributed approach necessary for
preserving the volume and complexity of digital
content
13#
The LIBRARY of CONGRESS
NDIIPP
Preserving At-Risk Content
• Content Experts providing insight into specific
domain requirements
• Variety of content scope, e.g.
–
–
–
–
–
–
Public television (high-definition digital TV)
Materials relating to southern culture
Government and political web sites
Social science data
Geospatial data
Dot-com era business records
http://digitalpreservation.gov/partners/project.html
14#
The LIBRARY of CONGRESS
NDIIPP
Preservation Research Grants
• Joint LC/NSF program funding cutting-edge research
• 10 grants across different areas, e.g.
– Large-scale data repositories for oceanographic study data
and MODIS satellite images
– Video
– Engineering and design data
– Infrastructure and lifecycle issues, including data
provenance and versioning
– Incentives for data producers to create archive-ready
datasets
– http://www.digitalpreservation.gov/partners/research.html
15#
The LIBRARY of CONGRESS
NDIIPP
Preservation Architecture Projects
• Archive Ingest and Handling Test
– Harvard, Stanford, Johns Hopkins & ODU conducted ingest,
export, format migration and exchange on a common archive
• Tools and protocols
– Los Alamos National Lab Research Library developing tools and
standards to package, disseminate and store e-journal content
• Repository and storage
– San Diego Supercomputer Center building and testing utility and
trust in a third-party repository
– National Digital Newspaper Program building distributed content
production and validation network and a central repository to
preserve digital newspaper content over time
– eDeposit through Copyright acquiring and preserving eJournal16#
content from multiple sources in different formats
The LIBRARY of CONGRESS
NDIIPP
Preservation Architecture
• Principles:
–
–
–
–
–
–
Support institutional relationships
Separate preservation and access
Construct modularly
Assemble over time, not all at once
Upgrade parts without disruption of the whole
Use broadly adoptable standards and protocols
17#
The LIBRARY of CONGRESS
NDIIPP
Section 108 Study Group
• Working group sponsored by NDIIPP with Copyright Office
– 19 copyright experts – half from libraries, archives; half from
various content industries
• Mission:
– re-examine copyright exceptions applicable to libraries and
archives in light of digital technologies
– findings and recommendations on revising law
– ensure appropriate balance among copyright interests and
needs of libraries and archives in manner that best serves the
national interest
• Submit report to Librarian of Congress by late 2006
• Roundtables on preservation and eligibility held March
2006; written comments due April 17, 2006
18#
The LIBRARY of CONGRESS
NDIIPP
Partnership Outcomes
• Identify and preserve significant at-risk content
• Leverage resources and experience through
collaboration
• Learn how to build and sustain a national digital
stewardship network
• Construct a technical infrastructure to support
interoperability and preservation services
• Explore public policy issues
• Provide basis for 2010 report to Congress
http://digitalpreservation.gov/partners/project.html
19#
The LIBRARY of CONGRESS
NDIIPP
Phase Two Investments
• Expanding partnerships to commercial content and
technology companies
– Preserving Creative America
• Encouraging development of repositories for state and
local “at-risk” content
• Additional funding of NSF/LC Grants
• Additional business models
• Technical infrastructure projects to expand and sustain a
preservation network
20#
The LIBRARY of CONGRESS
NDIIPP
Preserving Creative America
• Engage the commercial sector
• Goals
– Preserve at-risk digital cultural heritage collections
• Recorded sound; moving image; interactive/electronic
games; still images
– Encourage agreement on preservation standards & best
practices
– Support demonstration projects with new tools & services
– Establish Public-Private partnership models
21#
The LIBRARY of CONGRESS
NDIIPP
NDIIPP and the States
• LC exploring how best to include the States
within the scope of NDIIPP
• Focusing on significant and at-risk state
government digital information, broadly defined
• Special attention on multi-state repositories
• Received 9 responses June 15, 2006
• Funds awarded in September 2006
22#
The LIBRARY of CONGRESS
NDIIPP
Technical Infrastructure Projects
• Establish a network of shareable storage
– Support preservation strategies such as content
exchange, syndicated storage and risk assessment
• Develop services to support preservation
functions such as
– Data replication
– Risk assessment
– Data integrity assurance
– Content validation
– Content exchange
• 25 Proposals received June 1, 2006
23#
Digital Universe
24#
The LIBRARY of CONGRESS
NDIIPP
www.digitalpreservation.gov
25#