Transcript Diapositive 1

IN2P3 HPSS Migration report
V 5.1  6.2.2.2
Pierre-Emmanuel Brinette
IN2P3 Computing Center (Lyon – France)
[email protected]
Overview
Context of the migration
 What’s new in HPSS 6.2
 IN2P3 HPSS Configuration
 Migration Planning
 Metadata Migration
 Conclusion

Pierre-Emmanuel Brinette
Friday, July 17, 2015
2
Context of migration


IN2P3 use HPSS as main MSS since 1999.
The last major upgrade (to v 5.1) has been made
in 2005.
 Migration to HPSS 6.2 planned since 2007:
– HPSS 6.2.1 test platform setup in mid 2007.

IN2P3 HPSS staff has changed in 2008.
– The engineers that manage HPSS leave the center.
– The new team has no experience in HPSS.

In 2009 upgrade to HPSS 6.2 is necessary
– Support for T10k-B drives.
– Remove End-Of-Life equipments.
Pierre-Emmanuel Brinette
Friday, July 17, 2015
3
Overview
Context of the migration
 What’s new in HPSS 6.2
 IN2P3 HPSS Configuration
 Migration Planning
 Metadata Migration
 Conclusion

Pierre-Emmanuel Brinette
Friday, July 17, 2015
4
What’s new in HPSS 6.2.2.2

Major changes:
– DCE is no longer used as security mechanism.
– Some changes in the HPSS API.

New Authentication/Authorization mechanisms:
– Unix/Unix : /etc/passwd or NIS
– Kerberos/LDAP.

Officially supported platform:
– AIX 5.3 and RHEL 4.7.
– DB2 v 9.1.
Pierre-Emmanuel Brinette
Friday, July 17, 2015
5
Overview
Context of the migration
 What’s new in HPSS 6.2
 IN2P3 HPSS Configuration
 Migration Planning
 Metadata Migration
 Conclusion

Pierre-Emmanuel Brinette
Friday, July 17, 2015
6
IN2P3 HPSS Configuration (early 2009)

25 M files / 6 Pb
 + 2000 users
 Main access protocol is RFIO
 HPSS is used as tape
backend for others storage
systems:
HPSS
HPSS-API
RFIO
SRB
xrootd
Local users
only
dcache
– xrootd: 1 M files /1 Pb
– SRB used for files transfers
– dcache 2 M files / 2 Pb for grid
Grid users Local and
remote users
(SRM)
Pierre-Emmanuel Brinette
Friday, July 17, 2015
7
IN2P3 HPSS Configuration (early 2009)
Gbit LAN
32 x 64Gb LUN per mover
FASt 900
12 Tb

6 Disk Movers
AIX 5.1
(incl. 3 DCE mover)
HPSS SLAVE
Core Server
AIX 5.2
DCE
DS8300
120 Tb
32/64 x 64Gb LUN per mover
24 Disk Movers
AIX 5.2
(incl. 2 DCE mover)
HPSS MASTER
Core Server
AIX 5.1
DB2 8
DCE
SCSI Disk array
DB2 metadata
DDN
240 Tb
–
–
–
–
–
42 disk movers
2600 disk volumes
28 tape movers
66 drives
Gbits LAN
80x64Gb
20x256Gb LUN per mover
12 Disk Movers
RHEL 4.7
20 drives 9940
RFIO servers
AIX 5.1/5.2
DCE Client
HPSS API
HPSS 5.1
SRB servers
Solaris 10
HPSS API
4 Tape Movers
AIX 5.1
3x SL8500 /
10000 slots
12 drives 9840
34 drives T10k-A
26 Tape Movers
AIX 5.2
Pierre-Emmanuel Brinette
SAN
2/4 gbits
1x STK9310 /
6000 slots
Friday, July 17, 2015
8
Overview
Context of the migration
 What’s new in HPSS 6.2
 IN2P3 HPSS Configuration
 Migration Planning
 Metadata Migration
 Conclusion

Pierre-Emmanuel Brinette
Friday, July 17, 2015
9
Migration Planning
Gbit LAN
32 x 64Gb LUN per mover
FASt 900
12 Tb

HPSS SLAVE
Core Server
AIX 5.2
DCE
Migrate to
HPSS 6.2
6 Disk Movers
AIX 5.1
(incl. 3 DCE mover)
DS8300
120 Tb
32/64 x 64Gb LUN per mover
24 Disk Movers
AIX 5.2
(incl. 2 DCE mover)
HPSS MASTER
Core Server
AIX 5.1
DB2 8
DCE
SCSI Disk array
DB2 metadata
Migrate
Migration
to
to
HPSS
HPSS
6.26
Migrate to
HPSS 6.2
DDN
240 Tb
80x64Gb
20x256Gb LUN per mover
SRB servers
Solaris 10
HPSS API
4 Tape Movers
AIX 5.1
26 Tape Movers
AIX 5.2
Pierre-Emmanuel Brinette
– Clean-up
configuration
– Remove EOL
hardware
– Decrease the
number of volumes
12 Disk Movers
RHEL 4.7
20 drives 9940
RFIO servers
AIX 5.1/5.2
DCE Client
HPSS API
Migration goal
SAN
2/4 gbits
3x SL8500 /
10000 slots
12 drives 9840
Migrate to 34 drives T10k-A
HPSS 6.2
1x STK9310 /
6000 slots
Friday, July 17, 2015
10
Migration Planning
1/10 Gbit LAN
New
10 Gb
DS8300
DB2 Metadata
DDN
480 Tb

40 x 1To LUN per mover
NIS
12 Disk Movers
RHEL 4.7
10 Gb LAN
New Core server
AIX 5.3
DB2 9.1
Migration goal
– Introduce new
hardware
– Use 10 Gbits
for mover
20 drives 9940
New
26 Tape Movers
AIX 5.2
SAN
2/4 gbits
12 drives 9840
3x SL8500 /
10000 slots
34 drives T10k-A
RFIO servers
AIX 5.3
HPSS API
SRB servers
Solaris 10
HPSS API
6 Tape Movers
AIX 5.3
4Gbit FC / 10 Gb LAN
30 drives T10k-B
New
1x STK9310 /
6000 slots
New
Pierre-Emmanuel Brinette
Friday, July 17, 2015
11
Migration Planning

IBM Migration requirements
– Migration procedure applied on the production
server.
– Metadata migration procedure assume a 1 core
server and a 1 subsystem.
– Empty Disk volumes.
– UID/GID in DCE consistent with new auth/authz
system (ie NIS).
Pierre-Emmanuel Brinette
Friday, July 17, 2015
12
Migration Planning

IN2P3 CC constraints
– Change the HPSS Core server and remove
secondary server (EOL)
– Use NIS for Auth/Authz
– Modify metadata of 4 subsystems
– Drastically reduce the number of Disk
Volumes/hpss mover/servers
– Introduce the new tape movers
Pierre-Emmanuel Brinette
Friday, July 17, 2015
13
Migration Planning
(Non linear time line)
Dec 08
Feb 09
Apr 09
May 1, 09
May 15, 09
Jun 1, 09
Jun 5, 09
Migration case study with IBM Support
HPSS 6.2 Test platform setup
Writing migration procedure
HPSS 6.2 metadata migration
platform setup
Clean-up production config
Setup new
production
server
Migration
Pierre-Emmanuel Brinette
Friday, July 17, 2015
14
Migration Planning
(Non linear time line)
May 25
May 31
Jun 1
Jun 2
Jun 3
Jun 4
Jun 5
Reduce disk volume
Stop HPSS access
Purge disk
Shutdown HPSS
Export & Convert
DB2 metadata
Import in new server
Configure new
server
HPSS mover installation
RFIO Installation
Tests
Pierre-Emmanuel Brinette
Friday, July 17, 2015
15
Overview
Context of the migration
 What’s new in HPSS 6.2
 IN2P3 HPSS Configuration
 Migration Planning
 Metadata Migration
 Conclusion

Pierre-Emmanuel Brinette
Friday, July 17, 2015
16
Metadata migration



HPSS 6.2 introduce new DB2 Tablespace containers scheme
Use a production metadata backup after HPSS shutdown
On a temporary HPSS systems:
– Create exactly the same raw devices than the ones used on the production
server
– Restore the backup, run metadata conversion script, and export DB
content

On the new production system:
– Create the databases with HPSS install procedure (mkhpss)
– Populate the databases with the DB content just exported
HPSS 5.1 PROD
DB2 8
# DB2 BACKUP FULL OFFLINE
HPSS 6.2 Test
DB2 9
Same TS containers
Than HPSS 5.1 prod
1. # DB2 RESTORE …
2. # hpss_md_convert …
3. # db2move export …
Pierre-Emmanuel Brinette
HPSS 6.2 new PROD
DB2 9.1
New TS containers
1. # mkhpss subsysx …
2. # db2move import …
Friday, July 17, 2015
17
Overview
Context of the migration
 What’s new in HPSS 6.2
 IN2P3 HPSS Configuration
 Migration Planning
 Metadata Migration
 Conclusion

Pierre-Emmanuel Brinette
Friday, July 17, 2015
18
Conclusion

Migration issues
– Even with a good preparation we have encountered
(small) issues during the migration.
– Details available on demand.

Benefits
–
–
–
–
–
Supported HPSS version.
Stability improved.
Configuration simplified.
Metadata queries now runs faster.
Gain lot of experience for the new staff !
Pierre-Emmanuel Brinette
Friday, July 17, 2015
19
Conclusion

After migration
– Repack of remaining 9940 tapes
– Remove of last PowderHorn library
– Repack of T10k-A  T10kB (Big files SC)
– Repack 9840  T10k-A Sport

Future
– HPSS 7.1 migration in 2010
– 4th SL8500 with T10K-B
– Add more disk (probably DDN)
Pierre-Emmanuel Brinette
Friday, July 17, 2015
20
Thanks for your attention
Pierre-Emmanuel Brinette
Friday, July 17, 2015
21