MSI Outreach in the HPCMP PET Program

Susan T. Brown, Ph.D.

PET EOTC FAPOC University of Hawaii Ph: 808-956-2808 Email: [email protected]

Distribution Statement A: Approved for public release. Distribution is unlimited.

Overview

• Summary and Purpose of the PET Program – PET goals • PET Project Participation – PET Functional Areas and MSI Projects • Summer Programs available for Students and Faculty – Summer Internships – Summer Institutes – Workshops – Faculty Visits • Contact information Distribution Statement A: Approved for public release. Distribution is unlimited.

The PET Program

• The User Productivity Enhancement and Technology Transfer (PET) Program is part of the Department of Defense (DoD) High Performance Computing Modernization Program (HPCMP).

• The PET activity is responsible for gathering and deploying the best ideas, algorithms, and software tools emerging from the national high performance computing infrastructure into the DoD user community. • Through: –

Technical Support

– – – – –

Productivity Enhancements Technology Transfer and Transition Support Training Content Community Development On-Site Support

Distribution Statement A: Approved for public release. Distribution is unlimited.

PET Organization

• • •

4 Components, 2 Prime contractors Components located at Major Shared Resource Centers (MSRCs) in

–

Dayton, OH

– – –

Aberdeen, MD Vicksburg, MS Stennis Space Center, MS Users interface via Functional Area (FA)

–

10 Computational Technical Areas (CTAs)

–

4 Cross-Cutting Areas

• Minority Serving Institutions (MSIs) work with FAs through EOTC Distribution Statement A: Approved for public release. Distribution is unlimited.

Climate/Weather/Ocean Modeling (CWO)

•Numerical simulation of the earth's climate •Varying space and time scales •Contact: Dr. Jay Boisseau, [email protected]

•

Application of Advanced Microwave Sounding Unit (AMSU) Products to NOGAPS Tropical Cyclone Initialization

PI: Dr. Tim Li, University of Hawaii Objective:

to test and transfer an AMSU-based new initialization scheme in the Naval Operational Global Atmospheric Prediction System (NOGAPS)

•

Technical effort focused on the following:

–

Decode raw AMSU data directly from the NRL-Monterey site

–

Code development for 3D temperature from the raw AMSU data

–

Validation against aircraft dropsonde data

–

Calculation of rotational wind component with nonlinear balance equation Hurricane Isabel (20030916) warm core structure retrieved from AMSU data.

–

Participants: T. Li, B. Fu, X. Zhang (UHawaii), M. Peng (NRLMRY), T. Zhu, F. Weng (NOAA/NESDIS).

Distribution Statement A: Approved for public release. Distribution is unlimited.

Computational Chemistry and Materials Science (CCM)

Contact: Dr.

Tony Rollett

, [email protected]

or Dr.

Nick Nystrom

[email protected]

• Predict basic properties of new chemical species and materials – molecular geometries and energies – spectroscopic constants – intermolecular forces – reaction potential energy surfaces – mechanical properties. Distribution Statement A: Approved for public release. Distribution is unlimited.

Computational Electromagnetics and Acoustics (CEA)

Contact:

Prof. Jian-Ming Jin,

[email protected]

or

Prof. Charbel Farhat,

[email protected]

• Computational Electromagnetics area covers the high-resolution, multi-dimensional solutions of Maxwell's equations. • Computational Acoustics area covers the high-resolution, multi dimensional solutions of the acoustic wave equations in solids, fluids, and gases. Distribution Statement A: Approved for public release. Distribution is unlimited.

Computational Electronics and Nanoelectronics (CEN)

Design, modeling, and simulation for: •Electronics •Nanoelectronics •Optoelectronics •Photonics •Computing components and systems Contact:

Prof. Stephen Goodnick

, [email protected]

Distribution Statement A: Approved for public release. Distribution is unlimited.

Computational Structural Mechanics (CSM)

Modeling of materials and structures subjected to state, dynamic, and impulsive loads.

Contact: Dr. David Littlefield Voice: 205-975-5882 Fax: 205-975-7217 [email protected]

Cleared hole dia. ~ 30 in

1.62M elements Concrete Reinforcing Steel

Distribution Statement A: Approved for public release. Distribution is unlimited.

Computational Fluid Dynamics (CFD)

Contact: Dr. Bharat Soni, [email protected]

Voice: 205-934-8460, Fax: 205-975-7217 • • • Validation, Verification, and Certification by Analysis / Hugh Thornburg / (MSU) Major Objectives : – Build confidence level for CFD applications of interest to DoD – Important factors: Discretization error, grid resolution, convergence – Develop quantitative measure of accuracy of unsteady simulations – Estimate time convergence metrics Participants: Roy Koomullil, Bharat Soni, and Robert Nichols (UAB), Cheng Xian Lin and P.V. Skudarnov (FIU) Distribution Statement A: Approved for public release. Distribution is unlimited.

CFD Project Overview (con’t)

• Comparison of CFD tools in terms of accuracy and range of application to quantify uncertainty • Approach – Select a few unsteady data sets – Run different flow solvers with different time-steps – Estimate time convergence index – Analyze time history using FFT to measure the unsteadiness – Apply method of manufactured solutions (MMS) for code verification • Selected data sets 1. Pitching airfoil 2. Trapped vortex combustor 3. Mechanical model of Hawkmoth wing 4. Vortex shedding from bluff bodies 5. Shock wedge interactions Distribution Statement A: Approved for public release. Distribution is unlimited.

Environmental Quality Modeling and Simulation (EQM)

High-resolution, three-dimensional Navier-Stokes modeling of hydrodynamics and contaminant transport through air, ground, and aquatic ecosystems Contact: Dr. Mary Wheeler [email protected]

Voice: 512-475-8625 Fax: 512-471-8694 QUICKEST temperature error distribution for the Chesapeake Bay model. top layer. Red indicates error above mean value. Distribution Statement A: Approved for public release. Distribution is unlimited.

Forces Modeling and Simulation (FMS)

Contact: Dr. David R. Pratt , [email protected] Voice: 407-243-3308 Fax: 407-243-3311 Provides large-scale simulations of complex military engagements to facilitate mission rehearsal/training, mission planning, and post-mission analysis.

bombers SAM battery Distribution Statement A: Approved for public release. Distribution is unlimited.

targets

Integrated Modeling and Testing (IMT)

Applies high performance computing software tools and techniques with live tests and hardware-in-the loop simulations for the testing and evaluation of DoD weapon components, subsystems, and systems in virtual and composite virtual-real environments.

Contact: Ashok Krishnamurthy [email protected]

Voice: 614-688-4803 Fax: 614-688-3184 Distribution Statement A: Approved for public release. Distribution is unlimited.

Signal and Image Processing (SIP)

Contact: Dr. Stan Ahalt , [email protected]

Voice: 614-292-9524, Fax: 614-688-3184 Provides for extraction and analysis of key information from various sensor outputs in real time.

Distribution Statement A: Approved for public release. Distribution is unlimited.

Enabling Technologies (ET)

Enabling technologies involve advancing the state of tools, algorithms, and standards for pre- and post-processing analysis on enormous datasets. Includes: • Data visualization • Data mining and knowledge discovery • Image analysis • Grid generation • Problem solving environments • Computational techniques • Methods for intelligent extraction of useful information from data. Contact: Dr. Robert Moorhead , [email protected]

Voice: 662-325-2850, Fax: 662-325-7692 Distribution Statement A: Approved for public release. Distribution is unlimited.

ET Project with MSI Participation

• Distributed Design Environment (DDE) for Solution of Large Scale Finite Element Models – PI: Andrew Scott, Alabama A&M University

Electrostatic field generated with Finite Elements. DDE coupled with ARL highly parallel molecular dynamics code, VXMD

Distribution Statement A: Approved for public release. Distribution is unlimited.

Project Goals

• Enable effective generalized finite element (FE) techniques in a distributed multi-disciplinary modeling environment • Increase modeling flexibility and capabilities in a number of simulation areas – promote efficient management and coherent maintenance of data – make efficient use of the distributed resources – reduce the architectural impact on configuration of the target software

Data mapping of a large scale finite element model for distributed solution using the DDE ~1,000,000 DOF

• Demonstrate capability on a highly parallel code – Visual eXtensible Molecular Dynamics (VXMD) – coupled with a FE electrostatics methodology Distribution Statement A: Approved for public release. Distribution is unlimited.

Computational Environments (CE)

• • • • Improve user productivity and application performance through effective programming tools in the following focus areas Programming environments – – – – – – Debuggers Libraries Solvers Higher order languages Performance analysis Prediction and optimization tools Computing platforms – – – – Common queuing Clusters Distributed data Metacomputing Reusable parallel algorithms User access tools – – Portals Web-based access to HPC resources Contact: Dr. David Cronk, [email protected]

Voice: 865-974-3735 Fax: 865-974-8296 Distribution Statement A: Approved for public release. Distribution is unlimited.

Project Overview

• Collection and Validation of Application Benchmarking and Performance Data • PI: Shirley Moore, UTK • Co-PI: Patricia Teller, UTEP • Technical work: – Automation of performance data collection using automated source code instrumentation, compiler scripts, and default hardware counter selection – Provision of performance database technology using MySQL, TAU PerfDMF, and DoD HPCMP performance data schema – Verification and interpretation of hardware counter data in context of applications; definition of derived metrics • Users: Benchmarkers, application developers and users Distribution Statement A: Approved for public release. Distribution is unlimited.

Collaborative and Distance Learning Technologies (CDLT)

Collaborative and distance learning technologies encompass not only the ability to conduct meetings without involving travel (virtual meetings) but also technology for on-line training, on-line consultation, information, and tutorials. Distribution Statement A: Approved for public release. Distribution is unlimited.

Education, Outreach, and Training Coordination (EOTC)

Furnish efficient and productive instructional content to the user community. Provide opportunities for Minority Serving Institutions' staff, faculty, and students; undergraduate and graduate students; postdoctoral and visiting scientist/engineer appointments; and the training of future DoD High Performance Computing Modernization Program users. Distribution Statement A: Approved for public release. Distribution is unlimited.

PET Summer Programs

• Summer Intern Program – 10-week program for graduate and undergraduate students • Summer Institutes – 2-week program at a Minority Serving Institution (MSI), primarily for undergraduates • Faculty Visits – 8- to 10-week program for MSI faculty to work at DoD facilities, collaborating with users Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Intern Program

• Students apply for competitive program • Students work with mentors (DoD contractors, PET staff, or DoD employees) • Located at one of the four Major Shared Resource Centers (MSRCs) - ARL, ASC, ERDC, NAVO, or one of the DCs • Students work on one or more specific problems important to users Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Intern Project Examples 2005

ASC:

• James Walker, and Andrew Wailes -

BattleCam 3D: Stealth Viewer for After Action Review

• Ryan Osterday and Steven Pinsky • Ben Johnson - SciVis Coding and Analysis

High Performance Gas Turbine Combustors Design and Development through Modeling and Simulation

• Phil Wheat

Cobra Code Grid Resolution Analysis for User's Guide Development and Multidisciplinary Grid Generation

• Clinton Smith

ACAD Quick Start Guide and Meshing Studies

• Marcus Gualtieri • Danny Brenner •Tanner Suttles

Automating Redundant Tasks for the HPC User Sonic Flow Over a Spherical Blunt Body Automation of Batch Job Submission Using a Graphical User Interface

Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Intern Project Examples 2004

•

NAVO: Allison Scogin,

WaveWatch III COAMPS & •

Gerald Franklin,

Orleans An ADCIRC Model Application to the MS River at Audubon Park, New Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Intern Project Examples • • • • • 2005 •

ERDC: Visualization of Wind Field Through New Orleans using OpenGL

Birmingham. Mentors: Paul Adams & Randall Hand. , Veronica A. Cornner, a Graduate Student in Mechanical Engineering at the University of Alabama in

Automation of Benchmark Data Acquisition and Processing

Fernandez. , Matthew Bennett, a Senior majoring in Computer Science at Mississippi State University. Mentor: Dr. Alvaro

Toward Automatic Grid Generation 2

, Si Loi Leung, a Senior majoring in Mechanical Engineering at the University of Hawaii. Mentor: Dr. Nathan Prewitt.

Analysis of Oracle-Based PET Training Evaluation Data and Creation of MSI Data Access Form

, Tanjala Purnell, a Senior majoring in Computer Science at Tougaloo College. Mentors: Reginald Liddell & John Mason.

Automating Sensitivity Analysis and Execution of Datasets

Hensley. , Corey Bordelon a Senior majoring in Computer Science at the University of Louisiana at Monroe. Mentor: Dr. Jeff

DSR 2: Automated Graphical Report

, Jian-Zhong Li, a Senior majoring in Computer Science & Engineering at Bucknell University, Pennsylvania. Mentor: James Cliburn. Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Intern Project Examples 2005

ARL:

• Tony Lee, Alabama A&M University, Electrical/Computer Engineering,

Numerical Approximation of Fermi-Dirac Statistics

• Eric Mack, Virginia Polytechbic Inst and State Univ, Computer Engineering

Performance Analysis Using Intel Trace Collector/Analyzer and TAU

•Brandy Langston, Norfolk State Universiity, Materials Science,

Organic Solar Cell Structure as Pertained to DoD Applications

• Eduardo Abed, Florida International University, Mechanical Engineering,

Cohesive Zones in Microstructures

• Andrew Hody: Virginia Polytechnic Institute and State University Mechanical Engineering,

Analysis of Stresses and Failures in Representative Volume Element (RVE) from a 3D Woven Composite

• Luke Seever, Florida International University, Mechanical Engineering,

Analysis of Stresses and Failures in Representative Volume Element (RVE) from a 3D Woven Composite

• Earlene Thompson, Jackson State University, Computer Science,

Performance Analysis on CrayX1 using NAS Benchmarks

Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Institutes

• Two-week program • Primarily for undergraduate students with an interest in HPC at MSIs where there is less opportunity for exposure otherwise • Introduces the students to the basics of HPC and scientific applications • Some of the students will go on to the Summer Intern Program • Long-term goal is enhancement of the DoD workforce pipeline Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Institutes

• Jackson State University – Each year in current PET contract….and even before!

Topics:

•

UNIX

•

Scientific Visualization

•

Graphical Information Systems

•

OpenGL

•

Distributed Network Storage Management

•

Web Portals Included:

•

Visit to MSU ERC

•

Student Projects

•

Access Grid Presentations

Contact: Dr. Shahrouz Aliabadi Email: [email protected]

Voice: 601-979-1821 Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Institutes

• Central State University – First one in 2003

Topics:

•

MPI Programming Fundamentals

•

Animated Parallel Algorithms

•

Linear Systems

•

Parallel MATLAB

•

Image Processing

•

Wave Motion Calculations

•

Data Visualization Included:

•

Visit to OSC

•

Student projects

Contact: Dr. Gerald Noel Email: [email protected]

Voice: 937-376-6598 Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Institutes

• University of Hawaii

PCs, Clusters, Supercomputers!

Topics:

–

How parallel machines work

– –

Basic Parallel Programming Submitting jobs to remote facilities

–

Visualizing your results Includes:

– –

Visit to MHPCC Hands-on building of Cluster Computer

Contact: Susan T. Brown Email: [email protected]

Voice: 808-956-2808 Distribution Statement A: Approved for public release. Distribution is unlimited.

Summer Institutes

• Florida International University

Topics:

•

Programming Environments and Languages

•

Development Tools

•

Computer Architectures

•

Modern Computers

•

Image Processing

•

Clusters

•

Data Visualization

•

MPI, OpenMP

•

Applications

Contact: Walter Conklin Email: [email protected]

Voice: 305-348-1809 Distribution Statement A: Approved for public release. Distribution is unlimited.

Faculty Visits

• Open to any faculty from a Minority Serving Institution • Posted at a DoD Facility (usually an MSRC) • Term from 8 to 10 weeks (negotiable) • Works with a DoD Mentor • Works on problems of interest to the DoD and that fits into the Faculty member’s research • Find and develop working relationships with DoD research staff – for more information, or an application, contact: Susan T. Brown Email: [email protected]

Phone: 808-956-2808 Distribution Statement A: Approved for public release. Distribution is unlimited.

More than just

Summer

Programs

•

Computational Science Workshop for Underrepresented Groups

• Held annually in January • January 4 – 10, 2006 • University of Southern California •

Topics: Hands-on experience in parallel computing

•

Construction of a parallel machine

•

Immersive and interactive visualization

Contact: Richard Clark Voice: 213-821-2662 Email: [email protected]

http://cacs.usc.edu/outreach/workshop.html

Deadline for Application extended until November 24, 2005

Distribution Statement A: Approved for public release. Distribution is unlimited.

Where to find more information

• Contact me if you have any questions about the PET program or if you have ideas on how to participate:

[email protected]

808-956-2808 Distribution Statement A: Approved for public release. Distribution is unlimited.

Acknowledgement

“This publication was made possible through support provided by DoD HPCMP PET activities through Mississippi State University under contract No. GS04T01BFC0060. The opinions expressed herein are those of the author(s) and do not necessarily reflect the views of the DoD or Mississippi State University.” Distribution Statement A: Approved for public release. Distribution is unlimited.