SAS Grid implementation at PHAC
Download
Report
Transcript SAS Grid implementation at PHAC
SAS® GRID AT PHAC
SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC SAS GRID MANAGER
•
A SAS grid computing environment is one in which SAS computing tasks are
distributed among multiple computers on a network, all under the control of
SAS Grid Manager.
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC FEATURES AND BENEFITS
•
•
•
•
•
Performance
Workload Balancing (multi-user and parallelized)
High Availability
Scalability
Distributed Enterprise Scheduling
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC ARCHITECTURE
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC ARCHITECTURE
•
64bit SUSE Linux Enterprise Server 11
• Virtual Red Hat Server for RTM
• OCFS2
• LDAP / PAM (Novell eDirectory)
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC DESIGN DETAILS
•
Shared executables and configurations
•
/sas/software/ {meta} {app} {midtier}
• /sas/config/ {meta} {app} {midtier}
• /sas/pss/lsf
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC DESIGN DETAILS
•
Workspace Server clustering (hybrid Grid solution)
•
Application Server context association with specific queue:
SASApp – normal queue
• SASPriority – priority queue
•
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC DESIGN DETAILS
Normal queue:
QUEUE_NAME
PRIORITY
NICE
PREEMPTION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
Priority queue:
= normal
= 30
= 20
= PREEMPTABLE
QUEUE_NAME
PRIORITY
NICE
PREEMPTION
= priority
= 40
= 10
= PREEMPTIVE
SAS GRID AT PHAC DESIGN DETAILS
•
Reduced sleep times:
•
MBD_SLEEP_TIME
• SBD_SLEEP_TIME
•
=3
=5
Increased MXJ value (128)
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC DESIGN DETAILS
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC AGENDA
•
1. SAS Grid Manager
•
•
•
2. Grid at PHAC
•
•
•
•
SAS Grid Manager
Features and benefits
Objectives
Architecture
Design details
3. Implementation
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Prerequisites
•
•
•
•
•
Shared storage
Networking
Users
License, SAS Depot, plan file
Third Party Software
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Platform Suite for SAS 6.1 (PSS)
•
•
•
•
•
Install PM, LSF and GMS
Run hostsetup on every node
Install MPI
Test
Install RTM
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Install SAS Software
•
Install Metadata Server, Application Server and Mid-tier
• Configure
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Grid specific options during configuration
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Edit configuration files to configure grid
•
lsb.params
• lsb.hosts
• lsf.cluster.[cluster_name]
• lsb.queues
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Create new application server context
• Associate workspace with grid queue
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
•
Play
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC IMPLEMENTATION
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
SAS GRID AT PHAC FUTURE
•
•
•
•
•
Metadata HA
More customized queues
Additional queues and application server contexts
DI server
Web Application clustering (horizontal / vertical)
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
RESOURCES
•
SAS Grid Computing Documents
•
•
http://support.sas.com/rnd/scalability/grid/griddocs.html
Standard deployment plan - Grid Manager, four machines
•
http://support.sas.com/demosdownloads/sysdep_t6.jsp?packageID=000803&searchv
ar=productCat&searchval=sas%20grid%20manager
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
THANK YOU
C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .
www.SAS.com