Transcript IT Matters - University of Adelaide

Data Storage 2014
IT Matters
Topics
•
•
•
•
Current Storage Infrastructure
Backup and Restore
Handy Information and Techniques
Storage Future
University of Adelaide
2
Current Storage Infrastructure
• Mainly consists of NetApp Storage (www.netapp.com)
– FAS 6240’s
•
•
•
•
•
•
Home/Shared Folders (U:\ and S:\)
Staff Email (Exchange Mailboxes)
TRIM Records Management
MyMedia Streaming Data
Majority Server Storage
Uptime is vital!
– FAS 3250’s
• Databases (Peoplesoft/Access Adelaide/MyUni)
• Uptime is vital!
– FAS 2240’s
• Lower Cost Storage
University of Adelaide
3
Current Storage Infrastructure
• FAS 6240
University of Adelaide
4
Current Storage Infrastructure
• FAS 3250
University of Adelaide
5
Current Storage Infrastructure
• FAS 2240
University of Adelaide
6
Current Storage Infrastructure
• How much data?
– Total Capacity: 1000TB+ usable.
– Data Transfer Rates: 880MB/s.
– Usage Numbers:
• 20TB of Email (Staff) – 128,368,337 emails.
• 49TB of Home Folders – 84,763,414 files and folders.
• 26TB of Shared – 39,266,782 files and folders.
University of Adelaide
7
Current Storage Infrastructure
• Enterprise Support – 24/7
– Substantial Cost
– Proactive Maintenance
• Guaranteed Compatibility
– The storage system is guaranteed to integrate effectively with
other components of our IT infrastructure.
University of Adelaide
8
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)
– Deduplication
U:\ Drive Storage
Duplication Enabled
University of Adelaide
9
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)
– Thin Provisioning
Only going to buy enough
storage to store actual
data! This should do:
Wow, so much
storage! :D
CRAP!
Money Saved!
Users
Saved Data
Storage Admin
Saved Data
University of Adelaide
10
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)
– Thin Provisioning
– Capacity on Demand (COD)
Lets save
all
Wow,
so much
the data!
storage!
:D
Only going to buy enough
storage to store actual
data! This should do:
Crisis
Averted!
Users
Saved Data
Saved Data
Storage Admin
Data increasing..
Stress rising! Better enable
COD.
University of Adelaide
11
Current Storage Infrastructure
• Data Protection
– Has a whole topic coming next!
• High Reliability
– Hardware Redundancy (two of everything)
• Plus many more..
– Performance
– Manageability (Provisioning/Monitoring/Reporting)
University of Adelaide
12
Backup and Restore
What is a Backup?
A second copy of data!
Main purpose:
Recover data from large scale corruption, equipment failure or disaster scenarios...
University of Adelaide
13
Backup and Restore
Disasters won’t happen to us?
Think again!
University of Adelaide
14
Backup and Restore
Any other uses?!
Alternate usage:
Recover individual emails or files from particular points of time in the past. Alternate usage, but
most common.
University of Adelaide
15
Backup and Restore - Tape
•
Backup-To-Tape:
–
–
Long term retention.
Slow to restore data.
University of Adelaide
16
Backup and Restore - Tape
•
Backup-To-Tape:
–
–
Long term retention.
Slow to restore data.
Data Centre 1
Geographically
Remote
Data Centre 2
U:\ Drive
S:\ Drive
Email
University of Adelaide
Tape Library
Aged 8 weeks
17
Backup and Restore – “Local” Disk
•
Backup-To-Disk:
–
–
–
Reduced disk cost and smart software making this possible.
Fast to access!
We utilise backup-to-disk in a couple ways, Local and Remote backups.
“Local” Backups:
Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.
Storage without Snapshots
“Bugger”
1010101
1010101011
110
101010111
110011
101010010
10100100
10101010100
10101001
10011
10101
Time (Days)
University of Adelaide
18
Backup and Restore – “Local” Disk
•
Backup-To-Disk:
–
–
–
Reduced disk cost and smart software making this possible.
Fast to access!
We utilise backup-to-disk in a couple ways, Local and Remote backups.
“Local” Backups:
Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.
Storage with Snapshots
“Bugger”
“Snapshots!”
1010101
Snapshot 1
1010101011
110
101010111
110011
101010010
10100100
10101010100
10101001
10011
Snapshot 2
Snapshot 3
Snapshot 4
Snapshot 5
10101
Snapshots protect the data!
Time (Days)
University of Adelaide
19
Backup and Restore – “Remote” Disk
#1 “Remote” Disk Backups: Quick Disaster Recovery!
Backup which is physically located some distance from Active Data, on a storage device in a
secondary data centre.
Data is a maximum of 24 hours out
of date.
Primary Data
Centre
Secondary Data
Centre
U:\ Drive
U:\ Drive
S:\ Drive
FAS 6240
University of Adelaide
Changes made to
Data are copied to
Secondary Data Centre
(Twice a day)
S:\ Drive
FAS 6240
20
Backup and Restore – “Remote” Disk
#2 “Remote” Disk Backups: Making File and Email Restores easy!
Backup which is physically located some distance from Active Data, on a storage device in a
secondary data centre.
Secondary Data
Centre
U:\ Drive
Primary Data
Centre
FAS 2240
U:\ Drive
Email Admin
Email
Email
FAS 6240
University of Adelaide
Changes made to data, copied to
Secondary Data Centre (Once a day)
Efficient Backup Software
21
Backup and Restore
•
Important:
– Missing Data? Call Service Desk as soon as possible.
– Never delete required data, assuming it’ll just get restored from backup.
– Local Computer Hard Disc, not backed up!
University of Adelaide
22
Handy Information and Techniques
• Secure Data Transfers and Remote File Access
– AARnet CloudStor (https://cloudstor.aarnet.edu.au/sender/)
•
Secure data transfer to anyone with an email address.
– University Virtual Private Network (https://vpn.adelaide.edu.au/)
•
Secure data access to R:\, S:\ and U:\ drives for all UofA affiliated users.
University of Adelaide
23
Handy Information and Techniques
• Big Datasets
– AARnet CloudStor+ (https://cloudstor.aarnet.edu.au/plus)
– eResearchSA (http://www.ersa.edu.au/data)
• Data Collaboration
– AARnet CloudStor+
– Shared Data Drive (S:\)
– Low Cost Storage (R:\)
• More information on research data management:
http://libguides.adelaide.edu.au/researchdata
University of Adelaide
24
Handy Information and Techniques
What about Cloud Storage?
•
Would the Cloud provider tell you if they were hacked and your data was stolen?
•
Is your data being backed up?
•
Is your data being shared with advertising companies?
•
What happens if the Cloud provider goes bankrupt or is taken over?
•
Are employees of the Cloud provider allowed to view and share your data?
University of Adelaide
25
Handy Information and Techniques
What about Cloud Storage?
Some privacy policies:
“When you upload or otherwise submit content to our Services, you give Google (and those we work
with) a worldwide license to use, host, store, reproduce, modify, create derivative works …
communicate, publish, publicly perform, publicly display and distribute such content.” – Google,
April 2014
“In the event of a reorganization, merger, or sale we may transfer any and all personal information we
collect to the relevant third party.” – Apple, March 2014
“If we are involved in a reorganization, merger, acquisition or sale of our assets, your information may
be transferred as part of that deal. We will notify you (for example, via a message to the email address
associated with your account) of any such deal and outline your choices in that event.” – DropBox,
March 2014
More information about keeping data secure:
http://www.adelaide.edu.au/technology/secureit/data/
University of Adelaide
26
Storage Future
• What’s on the horizon.
– Bigger S:\ drive allocations
– Smarter Archiving
– Cloud Integration for Data Storage
• Ability to access your files any device, any time, any way.
• Ease of collaboration.
– Research Data Reforms (via eResearch Strategy)
• Associate Director Research IT Strategy (David Munro)
– Identify-Classify-Protect! (Data Classification Campaign - Secure IT)
University of Adelaide
27
IT Matters – 2014 Storage
Questions?
THANKS FOR LISTENING!
IT Matters