Transcript Cluster scheduling

Presented by:
Priti Lohani
What is cluster?
 It is a group of loosely coupled computers.
 They are arranged in a way to improvise in a speed and
reliability provided by a single computer.
 It allows the organizations to boost their processing
power.
 It provides expandability.
Classification of clusters:
 High -availability clusters
 Load-balancing clusters
 High-Performance clusters
 Grid clusters
Clustering algorithm
requirements:
 scalability
 Broad scope
 Sensitivity to compute node and interconnect
architecture
 Fair share capability
 Capability to integrate with standard resource
managers
 Fault tolerance
Resource management system
 It manages the processing of load by preventing jobs
from competing with each other for limited compute
resources
 Resource managers do basic node state monitoring,
receive job submission requests and executes the
requests on the computer node.
 The scheduler communicates with the resource
manager to obtain information about queues, loads on
compute nodes, and resource availability to make
scheduling decisions.
Cluster scheduling algorithms:
There are two types of schedulers:
 Time sharing
 Space sharing
Time sharing:
 Local scheduling
 Gang scheduling
 Communication driven co-scheduling
Space sharing:
 Batch scheduling
Batch scheduling:
 FCFS (First come first serve)
 SJF (Shortest job first)
 LJF (Longest job first)
 Advance reservation
 Backfilling
 Preemptive backfilling
Classifications of clustering
algorithms:
 Exclusive Clustering
 Overlapping Clustering
 Hierarchical Clustering
 Probabilistic Clustering
Maui cluster scheduler:
 It is an open source advanced job scheduler.
 It focuses on large turn around of large parallel jobs
 It is a best open source scheduler.
 It is capable of optimizing scheduling and node
allocation decisions.
 It has a 2 phase scheduling algorithm.
Resource managers for Maui:
 PBS
Version of PBS:
 Open PBS
 Professional PBS
 Torque
Open PBS VS Torque
Torque is better than PBS in following areas:
 Fault tolerance
 Scheduling interface
 Scalability
 Usability
Scheduling policies for Maui
 Advance reservation
 Backfill
 Job prioritization
Backfill algorithm:
Thank you for listening!