Overview of the OAIS Reference Model

The Lingua Franca of Digital Archives

Kenneth S. Casey Acting Technical Director NOAA National Oceanographic Data Center

Adapted from Presentations by:

D.M. Sawyer/NASA/GSFC C. Huc/CNES D. Boucon/CNES-SILOGIC J.G. Garrett/NASA-Raytheon 1

Context

• NOAA Archives are evolving to a new paradigm, where CLASS will serve as the common IT infrastructure supporting all three NNDCs • CLASS won’t be the only IT infrastructure (we’ll still have our individual legacy systems) but it will be the only

enterprise

IT solution • When possible, legacy systems will be “retired” and holdings transferred into CLASS (e.g., GOES Active Archive and Satellite Active Archive) • CLASS, until now, has been entirely within OSD but the operational part is now moving to NNDC management NNDC = NOAA National Data Centers CLASS = Comprehensive Large Array Data Stewardship System OSD = NESDIS Office of System Development 2

Context

• DAARWG and the Science Advisory Board • Archival Appraisal Process • NOAA Administrative Order 212-15 • Submission Agreements • NOAA IOOS Data Integration Framework • GEO-IDE • Archive Architecture Team’s Archive ConOps …. ENOUGH TO MAKE YOUR HEAD SPIN!

DAARWG = Data Archiving and Access Requirements Working Group DIF = Data Integration Framework GEO-IDE = Global Earth Observing Integrated Data Environment IOOS = Integrated Ocean Observing System 3

What is a Reference Model?

• A framework for understanding significant relationships between the entities of a system and to the external environment • A

lingua franca

for discussion, development, implementation, management, and use of that system

A reference model is NOT an implementation!!

4

Why the OAIS Matters to NOAA

• Provides a framework for consideration of roles and responsibilities of NNCDs and CLASS to ensure fundamental archive responsibilities are accomplished • Facilitates strategic planning of archive evolution • Assists with the education of our customers and stakeholders on essential information preservation activities 5

Why the OAIS Matters to NODC

• It gives a common language for us to use as we discuss both our internal archive process and our cross-NOAA archive activities • It serves as a useful tool for “gap analysis”, by providing a comprehensive suite of functions we should perform and responsibilities we must meet to be called a “capital A” Archive 6

The OAIS Reference Model

• The

Open Archival Information System Reference Model

(OAIS RM) is the CCSDS and ISO Standard (14721) for Digital Archives • It applies to all organizations that need to preserve digital information for the long-term • It does NOT specify any particular implementation • An organization

conforms

to the OAIS RM by discharging a minimal set of responsibilities and supporting basic information concepts 7

OAIS Responsibilities

• • Negotiates and accepts information from

Producers Obtains sufficient control

preservation to ensure long-term • • • Ensures the information to be preserved is

independently understandable

to identified

Designated Communities Follows

documented

policies and procedures

to insure information is preserved

Provides information

to the Designated Communities in understandable forms 8

The OAIS Environment

• • •

Producer

provides information to be preserved

Management

sets overall policy

Consumer

information seeks and acquires preserved

Producer OAIS (Archive) Management

The OAIS Environment from 30,000 ft

Consumer

9

OAIS Functional Entities

P R O D U C E P R D U C E R R

SIP

Ingest Preservation Planning Data Management

Descriptive Info

Archival Storage

AIP

Access

queries result sets orders DIP

C O N S U M E R R Administration

Policy, budget

SIP = Submission Information Package AIP = Archival Information Package DIP = Dissemination Information Package

The OAIS Environment from 10,000 ft 10

Ingest

OAIS Functional Entities

Data Management Access Archival Storage P R O D U C E R Administration Preservation Planning C O N S U M E R

The OAIS Environment from Sea Level Adapted from

MANAGEMENT

11

OAIS Common Services

• Operating System Services • Network Services • Security Services These pervasive functions link together the other 6 OAIS Functional Entities… 12

OAIS Functional Entities

•

Ingest:

This entity provides the services and functions to accept Submission Information Packages (SIPs) from Producers and prepare the contents for storage and management within the OAIS – Receive Submission – Quality Assurance – Generate AIP – Generate Descriptive Information – Coordinate Updates 13

OAIS Functional Entities

•

Archival Storage:

This entity provides the services and functions for the storage, maintenance and retrieval of Archival Information Packages (AIPs) – Receive Data – Manage Storage Hierarchy – Replace Media – Error Checking – Disaster recovery – Provide Data 14

OAIS Functional Entities

•

Data Management:

This entity provides the services and functions for populating, maintaining, and accessing both descriptive information that identifies and documents OAIS holdings and internal OAIS administrative data – Administer Database – Perform Queries – Generate Report – Receive Database Updates 15

OAIS Functional Entities

•

Access:

This entity supports Consumers in determining the existence, description, location and availability of information stored in the OAIS and allows Consumers to request and receive Dissemination Information Packages (DIPs) – Coordinate Access Activities – Generate DIP – Deliver Response 16

OAIS Functional Entities

•

Preservation Planning:

This entity monitors the environment of the OAIS and provides recommendations to ensure that the information stored in the OAIS remain accessible to the Designated Community over the long term – Monitor Designated Community – Monitor Technology – Develop Preservation Strategies and Standards – Develop Packaging Designs and Migration Plans 17

OAIS Functional Entities

•

Administration:

This entity manages the overall operation of the OAIS – Negotiate Submission Agreement – Manage System Configuration – Archival Information Update – Physical Access Control – Establish Standards and Policies – Audit Submission – Activate Requests – Customer Service 18

Making Sense of the Seascape

Conference Booths IOOS DIF QA and Products (WOD, GTSPP)

Preservation Planning P R O D U C E P R D U C E R R

SIP

Ingest

CLASS

Data Management

Descriptive Info

Archival Storage

AIP ATDB, OAS

Access

queries result sets orders DIP

C O N S U M E R R Administration

Policy, budget Submission Agreements Archive Appraisal, NAO 212-15 Implementation of the OAIS: GEO-IDE, Archive ConOps and Architecture 19

CLASS, NNDCs, and the OAIS

• Broad agreement to use the OAIS

language

and

framework

for CLASS NNDC relationships and operations transition planning • Not always easy to do - very easy to slip back into using “local dialects” • The Data Management Committee (DMC), subset of the NOAA Observing System Council (NOSC) has directed we perform a “mapping” to the OAIS RM 20

CLASS, NNDCs, and the OAIS

• Mapping of Current and Desired End States to the OAIS RM: – Refine the roles and responsibilities of the: NNDCs, CLASS operations, and CLASS development – Increase understanding of OAIS functional gaps (i.e., a baseline assessment or “gap analysis”) 21

NODC OAIS Mapping Process

• Commence with overview of the OAIS RM • Hold follow-on meetings to discuss each of the Functional Entities – Start each discussion with detailed description of that Functional Entity and its constituent functions – Populate the OAIS Traceability Matrix for that Functional Entity, describing how our current activities map to the OAIS functions now and how we envision the CLASS-NNDC partnership should accomplish those functions in the future 22

Traceability Matrix

23

Evolution of NOAA’s Archives

• OAIS RM provides a basis for delineating archive roles and responsibilities among NNDCs and CLASS • Provides a basis for identifying required archive functions and ensuring CLASS development to NNDC operations handoff can occur smoothly • Provides a way forward for strategic planning of archive evolution 24

“For the eye sees not itself, but by reflection, by some other things.” Brutus, in William Shakespeare’s

The Life and Death of Julius Caesar

25