Transcript PROOF - Parallel ROOT Facility

PROOF - Parallel ROOT Facility
Maarten Ballintijn, Rene Brun,
Fons Rademakers, Gunter
Roland
http://root.cern.ch
Bring the KB to the PB not the PB to the KB
June 21, 2003
1
PROOF in a Slide

Slave
Master
Slave
Slave

Slave
Interactive Physics Analysis of Large
Data Sets using Parallel Processing
and I/O
Transparency, Adaptability,
Scalability

Internet



Integrated into ROOT, Known Paradigm
Adapt to Network and System
Performance, support Heterogeneous
systems
Efficiency and Reliability
Multi Tier architecture, Data Locality

WAN Ready and GRID compatible
User
June 21, 2003
1
PROOF Features

Selector framework




Transparent way to program analysis
Universally applicable, local, PROOF, batch
Extensible, combine with TTask ?
TDSet data description


Lightweight, easily created from CLI
Versatile
June 21, 2003
1
PROOF Features

Packages



Extend and customize environment
Efficient and heterogeneous
Feedback


Simple progress bar
Flexible feedback mechanism
June 21, 2003
1
PROOF in the Pipeline

Continuing Grid Integration


Dynamic Session Configuration Plugin


Authentication ready, Catalogs, Resource
Broker
Requested Data Set, Resource Availability
Feature additions and Improvements


TTree::Draw(), Friend Trees, Event lists
Tuning and improved error handling
June 21, 2003
1
PROOF and Condor

COD, Computing On Demand


Batch and Interactive coexist
Explicit scheduling



Better Interactive Response
Optimize resource usage
Resource broker


Allocate Compute resources
Allocate Data Storage resources
June 21, 2003
1
PROOF and COD
Master
Condor
Slave
Batch
Condor
Condor
Slave
Batch
Condor
Batch
June 21, 2003
1
Software Architecture Philosophy

General principles remain valid


We must benefit from what we and others
(!) have learned


even as bandwidth, latency and capacity grow
Models of usage
Silver bullets do not exist


Methodology, Environments, Languages
Prototype is easy, production quality is hard
June 21, 2003
1