Transcript Presentation Title Name Second Line

Balancing the Load –
SAS® Server Technologies
for Scalability
Cheryl Doninger
R&D Director, SAS
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Jason Spruill
Software Developer, SAS
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
The Look and Feel of SAS
proc catmod order=data;
weight wt;
response / out=preds;
model severity=trt hospital;
run;
quit;
/* Keep just the predicted values, predictors, and response */
data pred2;
set preds;
if _type_='PROB';
keep severity trt hospital _pred_;
run;

/* Find predicted response level (level with highest predicted
probability) in each sample. */
proc summary data=pred2 nway;
class trt hospital;
var _pred_;
output out=predlvl (drop=_type_ _freq_)
maxid(_pred_(severity))=predlvl;
run;
/* Transpose the predicted values so that there is one observation per
sample containing predicted values for each response level. */
proc transpose data=pred2 out=pred3 (drop=_name_);
by trt hospital;
id severity;
var _pred_;
run;
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS/CONNECT
Features
SAS to SAS communication
Client session can spawn
any number of server
sessions
Syntax to allow data transfer,
distributed execution and
coordination of multiple
sessions.
Benefits
Execute multiple
independent jobs in
parallel
“Divide and Conquer”
single large problem
Scale up and scale out
Limitations
Application tied to
architecture
Limited load balancing
No knowledge of shared
use of computing
infrastructure
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS/CONNECT – Load Balancing
 Do more work on hosts with more
capacity
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS Grid Manager
SAS Grid Manager
Distributed
Enterprise
Scheduling
Distribute jobs
within workflows
to a range of
hosts.
Multi-User
Workload
Balancing
Distribute
workloads to a
shared pool of
resources.
Parallelized
Workload
Balancing
Distribute
parallelized SAS
workloads to a
shared pool of
resources.
Optimize the Efficiency and Utilization of Computing Resources
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS Grid Manager - Components
SASApp
Central File Server for:
• Job Deployment Directories
• Source and Target Data
• SAS Log files
Grid Client
+
Metadata Server
Management Console
(Grid Manager plug-in)
DIS or EM
SAS Program LSF
Platform Grid
Management Service
Platform LSF
...
Platform LSF
Platform LSF
Platform LSF
Platform Process Mgr
Base SAS
SAS/Connect
Metadata Server
3
SAS Workspace
Server
SAS Grid Server
SAS Data Step
Batch Server
Grid Control
Machine
Base SAS 2
SAS/Connect
1
SAS Grid Server
SAS Data Step
Batch Server 1
Grid Node 1
Base SAS 2
SAS/Connect 1
Base SAS 2
SAS/Connect 1
Grid Node 2
Grid Node n
SAS Grid Server
SAS Data Step
Batch Server 1
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS Grid Server
SAS Data Step
Batch Server 1
SAS Grid Manager – Load Balancing
HOST A
SAS
Application
Normal Queue
SAS Grid
Manager
HOST B
HOST C
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS Grid Manager – Load Balancing
HOST A
High Priority Queue
SAS
Application
Normal Queue
SAS Grid
Manager
HOST B
Night Queue
HOST C
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
What Products can Leverage SAS Grid Manager?
SAS Grid Manager
Distributed
Enterprise
Scheduling
Multi-User
Workload Balancing
Parallelized
Workload
Balancing
SAS Data Integration
Studio
Enterprise Guide
programs
SAS Data Integration
Studio
SAS Web Report
Studio
Any SAS program
(with wrapper)
including stored
processes and SAS
SAS Enterprise Miner
SAS Marketing
Automation
SAS Marketing
Optimization
Any SAS program
(with modification)
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS Risk Dimensions
Any SAS program
(with modification)
SAS Integration Technologies
 Client-server infrastructure
 Support for diverse clients
• .Net – SAS Enterprise Guide
• Java – SAS DI Studio, SAS Management Console
• Web – Web Report Studio, SAS BI Web Services
 Secure, reliable, scalable
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Integrated Object Model (IOM)
 Runtime environment for SAS servers
 Interfaces to SAS servers
 Components
• SAS Workspace Server
• SAS Object Spawner
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Integrated Object Model (IOM)
Workspace Server
.Net
Application
Object Spawner
HOST A
Workspace Server
Java
Application
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
IOM Load Balancing
 Balances client workload
 Allows clustering across multiple machines
 Adjustable to meet changing needs
 No client changes needed for usage
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
IOM Load Balancing
HOST B
IOM Load
Balanced
Cluster
.Net
Application
HOST A
Java
Application
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
HOST C
IOM Load Balancing with SAS Grid Manager
HOST B
IOM Load
Balanced
Cluster
.Net
Application
HOST A
Java
Application
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
SAS Grid
Manager
HOST C
Usage Scenario
 50 SAS Enterprise Guide users
 30 Ad-hoc SAS programmers
 10 SAS Data Integration Studio users
 50 2 core grid nodes
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Load Balancing Multiple SAS EG Users
Cluster of
Workspace
Servers
Pros
Leverage full grid
with no additional
licenses
Cons
Client-side
implementation
Pros
Server-side
administration
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Cons
SAS/IT license on
each node in
cluster
Load Balancing Multiple Ad-hoc SAS Programmers
HOST A
High Priority Queue
Normal Queue
SAS Grid
Manager
HOST B
Night Queue
HOST C
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Load Balancing Multiple SAS DIS Users
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Shared, Load Balanced SAS Environment
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Want to Know More?
 Introducing the SAS ® Code Analyzer, Mon, 3:00 214A, Paper
006-2008
 Using SAS/OR® and SAS® Grid Manager to Solve Optimization
Problems on the Grid, Mon, 5:00 209, Paper 203-2008
 Architecting a Finely Tuned SAS® Grid Solution, Tues, 8:00
214B, Paper 390-2008
 Balancing the Load: SAS® Server Technologies for Scalability,
Tues, 8:30 214B, Paper 391-2008
 Data Integration in a Grid-Enabled Environment, Wed, 8:00
217B, Paper 133-2008
 SAS® Grid 101: How It Can Modernize Your Existing SAS
Environment, Wed, 11:00 Ballroom C1, Paper 046-2008
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.