Transcript EUAN in a Swedish perspective - National Archives of Australia

Experiences from digitization and
digital preservation at the Swedish
National Archives
Presented at the Digital Futures International
Forum in Canberra
Sept 19, 2007 by Göran Kristiansson
A Swedish National Archival
Database (NAD)
• Background
– Database for private papers
– Tool for producing archival guides
– A Government Commission 1988
• Project at the National Archives 1990
– Coordination of existing databases
A Swedish National Archival
Database (NAD)
– Strategy
• Descriptive standards. ISAD(G) and ISAAR(CPF)
• Data elements.
• Exchange format. MARC-AMC
• Distribution on CD-ROM
– Content from Archives, Libraries and Museums
A Swedish National Archival
Database (NAD)
• Development of an Archival information
system (ARKIS) for the National and the
Regional Archives.
–
–
–
–
top level archival descriptions
"container lists"
registration of cartographic material
repository control
A Swedish National Archival
Database (NAD)
• Unemployment projects
– Finding aids, census records and Cabinets cause-lists.
• The present edition of NAD
–
–
–
–
170 000 fonds
40 000 inventories
Digital and microfilmed copies of records
Information about administrative boarder changes
• NAV – a tool for updating NAD
Next generation - ARKIS II
• Merge three systems
– ARKIS I
– Microfilm Database
– Database for magnetic tapes
• Web based system
• Full implementation of multilevel
description
Next generation - ARKIS II
• Used a Generic datamodel
• Support for XML and the Encoded Archival
Description (EAD) and Encoded Archival
Context (EAC)
Demo NAD, bildexempel, ARKIS och XML1, XML2
Next generation - ARKIS II
• Used a Generic datamodel
• Support for XML and the Encoded Archival
Description (EAD) and Encoded Archival
Context (EAC)
Demo NAD, bildexempel, ARKIS och XML1, XML2
Linking and Exploring Authority
Files (LEAF)
• Develop a model architecture for a
distributed search system
• A common European name authority file
• Encoded Archival Context (EAC)
• Context information from Archives,
Libraries and Museums
Large digitization projects
• Reproduction of church records 1895-1991
– 57 million images (total 110 million)
– 40 Tb/year
• Digitization of microfilm 1600-1905
– 15 million images
• National Land Survey of Sweden 1600 – 70 million images
• Scanning on demand
Large digitization projects
Scanning process
Archival
description
Scanning
TIFF-editing
HSM
Converting image
to DjVu
Image
database
ARKIS
Grayscale, 8 bit-color, 300 dpi and TIFF 6.0
A Government Commission 2002
”Arkiv för alla – nu och i framtiden”
• Task: Not to solve the problem, but to give advise
to the government on the best way to support
archival authorities in their work with long term
preservation of digital records.
• The commission was run by the governor of
northern Sweden, Kari Marklund, with support of
a group of experts
• IT-reference group
Vision
• Open Archival Information System (OAIS)
• Format for digital deliveries
– XML and emulation
– Specification of information package for ingest
– Delivery control
• Storage and administration of digital records in
archival institutions
• Access to digital information
Project on long term preservation
of digital Information (LDB)
• Cooperation between the Luleå University
of Technology, the National Archives
and the municipality of Boden
• Putting the vision into practice
• Records management/archives
management – a key question for a
successful e-government
LDB test case
National Social Insurance Board
• Electronic Record Management
System
• Digital Archive
• Common development project
• Test transfer summer 2006
Reference model: Authority
Caseworker
Other systems
Other systems
Call center
Create
Provide help
Process
View
Archivist
Describe
Search
?
Deliver
Archive
Templates
Administrative document
Forms
Documents in files
Metadata
Distribute
Employers
Receive
Store document
Citizens
National Archives
Citizens
Register
Search/FAQ
Edit
Arrival archive
Publish
Open
Citizens
Create/modify
View
Local and public applications
Complementary
information
LDB test case
Agresso
• Accounting System
• specifications from preceding
project
• export test spring 2006
Open Archival Information System
(OAIS) – A conceptual model
Information package
Container list
(sökbar)
Representation
information
(structure, semantic)
Data object
Arkiv(analog,
digital)
beskr.
negotiation
SIP
delivery
Incheckning
AIP
Package identification
Preservation
Information
(referensinfo,
provenance,
context,
äkthet)
SIP = Submission Information Package
AIP = Archival Information Package
DIP = Dissemination Information Package
Preservation planning
Archival Archival
descriptiondescr.
OAIS
Digital
AIP
archive
Administration
Access
DIP
retrieval
answer
order
delivery
General architecture of SIP
SIP/(AIP)
METS
Package level
Technical metadata
Authority records
Archival Description
PREMIS
EAC
EAD
Archival structure level
Records management
systems
ERMS
Economical systems
OR
SIE-XML
Other systems
Data bases
OR
[ ADDML]
OR
[to be defined]
System structure level
Specific metadata
Ex Style sheet
(Ex: XSLT / XSL-FO)
Context metadata
Ex Manual
(Ex: PDF/A)
Digital
Data object
Digital
Data object
Digital
Data object
Physical
Data object
(Ex: TIFF, XML, PDF/A, ASCII, …)
Object level
EAD
Encoded Archival Description

description of archival collections

based on ISAD(G)

International Standard Archival Description (General)

for encoding archival finding aids

multi-level description

used by archival repositories
EAC
Encoded Archival Context

description of authorities


based on ISAAR(CPF)


organizations, persons and families
International Standard Archival Authority Record
describing the circumstances under which
records have been created and used
ERMS
Electronic Records Management Systems

metadata standard from UK
based on Functional Requirements for
Electronic Records Management Systems

exchange of records metadata and
interoperability between ERMS systems

ERMS levels
ERMS
XML-file
Class
Folder
Record
Component
Record
Component
XML-files
Folder
Record
Component
Component
Component
Record
XML-files
Component
XML-files
Component
ADDML
Archives Data Description Markup Language

describes transferred database files
technical, structural and general descriptive
metadata


developed by National Archives of Norway
Arkadukt (editing) and Arkade (testing and
conversion)

SIE-XML
Standard import/export - XML

describes and contain accounting information

exchange between economic administrative
systems

aggregated and transaction level

XBRL only aggregated level in Sweden today

based on Swedish regulations

developed from classic SIE

implemented on 95% of products on market
PREMIS
PREservation Metadata: Implementation
Strategies

expanded conceptual structure for the OAIS model,

a set of metadata elements reflecting requirements
OAIS

developed by a working group initiated by OCLC/RLG
PREMIS
DATA MODEL
METS
Metadata Encoding and Transmission
Standard







expressing the structure or structures of a digital entity
linking Descriptive metadata with digital content
linking Administrative metadata with digital content
linking behavior definitions and program code with digital
content and with associated descriptive and administrative
metadata
wrapping digital content, and associated descriptive and
administrative metadata as binary data
self-defined profiles
developed by Digital Library Federation
Presentations of records in FKs ERMS
Presentations of FKs transferred SIP
From opportunity to reality
Preservation planning
Riksarkivet
Producer
Researcher
etc
Archival
description
SIP
LDB
DIP
ARKIS
Validation
XML
Archival description
Access
XML
Archiving
Tape robot
EAD
ISAD(G)
EAC
???
Administration
ISAAR(CPF)
Physical Archives
PROTAGE
• Preservation Organizations Testing Agent
Environment
• EU-funded project
• Build and validate flexible software agents for
long-term digital preservation and access
The future
Luleå University of Technology
Competence development
National competence
center in Boden
National
and Regional
Archives
Long term accessibility
Governments, municipalities
Companies
Society
Citizens, organizations