Transcript NEES 4th Annual Meeting Washington D.C., June 21-23, 2006 Current Status and Future Directions for NEES Cyberinfrastructure Anke Kamrath ([email protected]) Lelli Van Den Einde ([email protected]) Shannon.

NEES 4th Annual Meeting
Washington D.C., June 21-23, 2006
Current Status and Future Directions
for NEES Cyberinfrastructure
Anke Kamrath ([email protected])
Lelli Van Den Einde ([email protected])
Shannon Whitmore ([email protected])
Ahmed Elgamal ([email protected])
http://it.nees.org
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Overview
 Overview of the Year for NEESit (Anke Kamrath)
 NEES Cyberinfrastructure:Vision, Priorities, and People
 Accomplishments during FY06
 NEESit @ Annual Meeting
 Demonstration of Data and Telepresence Capabilities
(Lelli Van Den Einde & Shannon Whitmore)
 Background: Use Case Groups
 Case Study: Pre-NEESR Soil-Foundation-Structure-Interaction Project





NEES End to End Workflow
NEES Data Model
NEEScentral Overview
Telepresence Overview
Roadmap for Remainder of FY06
 Future Directions for NEES Cyberinfrastructure (Ahmed Elgamal)
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Overview of the Year for NEESit
Anke Kamrath
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
NEES Cyberinfrastructure
Vision and Priorities
 NEES CI Vision
 Drive the cutting-edge of fundamental and
transformative research in earthquake
engineering through the application of
information technology
 Broaden impact of research to researchers,
practice and education through IT.
 Information Technology Priorities
 Robust remote participation environment
 World class data repository
 Collaboratory to enable integration of wideranging tools and applications (through web
services) to facilitate new paradigms of
usage, collaboration, and discovery
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
NEES Cyberinfrastructure People Make it Happen
NEESinc BOARD
OF DIRECTORS
IT Strategy
Committee
NEESinc HQ
Executive Director
Chief IT Officer
Data Librarian
Web Master
NEES Cyberinfrastructure
Center:
SDSC & partners
Equipment Sites
1-2 IT Personnel
per site
SW Development
Telepresence,
Collaboration and QA
Software Architect
Production IT Support
Security Officer
Data Development
Infrastructure &
Outreach
SubKs
George E. Brown, Jr. Network for Earthquake Engineering Simulation
+ Contractor
Contractor SubK
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center,+ UCSD
NEES Cyberinfrastructure
Infrastructure &
Middleware:
DAQ Systems, Networks,
Storage, Servers,
Security, Middleware
EDcentral
Community Databases
& Data Collections:
Data management, sharing,
queries, mining and
preservation
People:
NEES consortium,
researchers, equipment
sites, practitioners, NEESit
NEES
Simulation:
HPC allocations, largescale data analysis,
simulation, and modeling
Cyberinfrastructure
Education:
Earthquake Engineering
education and training
RDV
flexTPS
Software:
Web Services, Tools,
Applications, and
Community Codes
Outreach:
Collaboration and
community leadership with
other large-scale projects
REU
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
FY06 Highlights
 NEEScentral: Growing data system with active
data management
 Significant NEEScentral Usage
 >450 Accounts, >40 Research Projects
 https://central.nees.org
 Database backend with growing metadata model and
user interfaces (Currently >100 fields)
 In-depth overview later in this session
 Collaboration and Outreach Tools:
 WebEx (https://nees.webex.com) deployed Oct 2005
 Quickly adopted as key planning tool for NEESR teams
 NEES Site Activities (NAWI) deployed Nov 2005
 https://central.nees.org/activities
 Watch what’s happening at all the equipment sites!
 Videoconferencing via Internet2 deployed May 2006
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
More Highlights
 High-end Computing
 200K Allocation received for SDSC DataStar and
Teragrid resources Oct 2005
 Active Usage from 12 research groups
 Largest run using 2048 processors
 OpenSees w/ custom domain objects and 25M elements
 Available to NEES community
http://it.nees.org/support/supercomputing/index.php
 Telepresence Enhancements:
 Expansion of tabular panel (spreadsheet style display of
sensors)
 Load/save a configuration
 Pan/Tilt/Zoom support for video
 In-depth overview later in this session
 Automated Build and Test Environment
 Deployed Jan 2006
 Support high-quality, iterative development process
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Highlights:Technology Outreach
 Community Code Repository (NEESforge)
 http://neesforge.nees.org (deployed Dec 2005)
 25 Hosted Projects and 41 Registered Users
 Environment for researchers to manage code on their own
 Bug / feature tracking and discuss forum / mailing list
 Version control system and documentation
 Download
 All open source
 Pipeline for bringing community development efforts into
NEES CI
 NEESit User Support Services
 Guaranteed one business day response
 Toll free #: 866-260-4100,
 Email: [email protected]
 Web: http://it.nees.org/support, https://central.nees.org/help
 All issues logged in Fogbugz tracking systems
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
More Outreach Highlights
 Strong International Partnerships
 E-Defense (Japan), SAMCO (EU), KOCED
(Korea), NCREE (Taiwan), and others
 All groups interested in standardized data
models for sharing data across distributed
data repositories
 Strong Interest in sharing software solutions
and joint development efforts
 EDcentral already deployed!
 EU leveraging NEES DataTurbine and
Telepresence solutions
 Strategy: Let’s not compete over the CI –
rather focus competition in research arena
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
NEESit @ Annual Meeting
 Booth:
 8:00am-5:00pm, Wednesday and Thursday.
 No booth on Friday.
 Demos: NEEScentral and RDV (punching bag)
 "Meet a NEESit Expert“
 Sign up sheet at the booth to schedule 10-15 minute meetings with
Lelli, Shannon, Wei
 Training Workshop:
 Friday 1pm-5:15pm
 Accepting reservations until COB Weds (Today). Stop by booth or
register on-line at
http://it.nees.org/support/workshops/workshop_enduser.php
 Overview of NEESit Software & Services, Organize and Manage Data,
Participate in a Remote Experiment, Collaborate in a Distributed
Project, Simulation and Hybrid Simulation
For more info about NEESit see http://it.nees.org
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Demonstration of Data and
Telepresence Capabilities
Lelli Van Den Einde & Shannon Whitmore
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Background
 Use Case Groups
 Data: SFSI pre-NEESR project
 Sharon Wood, Bruce Kutter, Dan Wilson, Adolfo Matamoros, Mahadevan
Ilankatharan (Lanka)
 Coordinated research project to study soil-foundation-structure interaction
 Test different components of a two-span bridge assemblage at different scales
with different boundary conditions
 Project utilizes 3 NEES Equipment Sites (Centrifuge, Shake Table, and Field),
Purdue Structural Tests, and UW and UC Berkeley Simulation
 Focus for June release: UC Davis Data Report
 Telepresence
 Sri Sritharan, Laura Lowes, Jerry Hajjar
 UMN-MAST pre-NEESR T-Wall test
 WebEx meetings with each group every 2 weeks
 Feedback informs development
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Prototype Structure
Computational Models
UW, UCB, & UCD
Data
Kansas
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Outreach
SJSU
Case Study: SFSI Pre-NEESR Project
Prototype Structure
Computational
Models
Centrifuge
Tests
Field
George E. Brown, Jr. Network for Earthquake
Engineering Simulation
Tests
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Structural
Tests
Shaking Table
Tests
Simulation
Experiment planning & prep
NEES End-to-End Workflow
Remote
researchers
Shake
Table Test
RDV
flexTPS
OpenSees
Internet2
WebEx
On site
researchers
SingleShot*
Share data, plan,
collaborate
SDSC/
Teragrid
compute
resources
Data Turbine
NEESdaq
flexTPS
DAQ
DAQ
NEES Site Activities
Field Test
Centrifuge Test
George E. Brown, Jr. Network for Earthquake Engineering Simulation
Public viewers
Organize
& Structure
NEES
Cyberinfrastructure
CenterData
at the San Diego Supercomputer Center, UCSD
Remote participation in experiment
NEES Data Model
 Goal: Preserve and organize all data necessary to
reproduce experiment
 Structured vs. Unstructured data
 Driving forces




SFSI Pre-NEESR project (emphasis on Centrifuge/UC Davis Data Report)
NEES Reference Data Model by Peng and Law
Geotechnical Data Model by Bardet/Swift/Kutter/Wilson
Tsunami Data Model by NACSE/OrSt
 ~70% of the model is common across all disciplines
 Current data model being passed around now…
 NEESit seeking feedback from researchers on this model
 What works? What is missing?
 Write down comments and return them to NEESit booth or send feedback to
[email protected]
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Page 3 of Handout
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Page 4 of Handout
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Page 5 of Handout
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Page 6 of Handout
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
NEEScentral Overview
 Facility (SSDB migrated to NEEScentral)
 Contact Info/Staff/Training and Certification
 Equipment
 Sensor Inventory and Calibrations
 Research
 Data IN
 Project metadata (Page 8 of Handout)
 Experiment metadata (Page 9 of Handout)
 Setup: Material Properties (Page 10 of Handout)
 Setup: Coordinate Spaces (Page 11 of Handout)
 Setup: Sensor Location Plan (Page 12 of Handout)
 Setup: Model (Page 12 of Handout)
 Setup: Equipment Inventory (Page 13 of Handout)
 Setup: Scale Factors (Page 14 of Handout)
 Trial metadata
 Setup: Channel List (Page 15 of Handout)
 Setup: Input Motion (Page 15 of Handout)
 Search Data (Page 16 of Handout)
 Experiment Report (Starting on Page 18 of Handout)
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Telepresence Overview
 Researcher and/or Outreach Tools
 NEES Activities Web Interface (NAWI)
 Promotes outreach of NEES research
 Integrates real-time video streams via
flexTPS
 https://central.nees.org/activities
 flexible TelePresence System (flexTPS)
 Real-time video from an equipment site
 Developed by Christopher Stanton
 http://assam.mast.umn.edu/portal
 Real-Time Data Viewer (RDV)
 Real-time data viewing during an experiment
 Collaborative development effort between
NEESit and University at Buffalo (Jason
Hanley)
 http://it.nees.org/software/rdv/index.php
 Telepresence Middleware
 Data Turbine
 NEESdaq
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Telepresence Kudos
 MAST pre-NEESR T-Wall test
 Invited remote researchers to participate in various phases of testing
 Industry Partner (Susie Nakaki)
 “With guidance from Wei, I found RDV very easy to use, and especially like the “drag
and drop” plots that allowed me to look at information that interested me,
independent of what the research team was viewing. This tool allowed me to
participate over the course of several days, with minimal disruption to my business.”
 European Union: ELSA Laboratory, Italy
(Pierre Pegon)
 “I am very happy with this version of RDV. I am
now using telepresence for almost every test we
are performing.”
 University of Auckland, NZ
 From Sri Sritharan: “The Auckland faculty were
impressed” <when they participated in the MAST
test via WebEx, watching Wei's demonstration of
RDV>
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Feedback from Use Case Groups
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Roadmap for Remainder of FY06
Data Management Highlights
NEEScentral 1.6 (August)
 Support for field data model
 Support for simulation data model
 Bulk upload phase I
 Sensor location plan
 Channel List/DAQ
 Significant extension of web services
 To enable equipment site specific software
for data ingestion
 Advanced reporting capabilities
 Generate Data Report in different
formats (PDF, Excel, etc)
 Generate spreadsheet from any
table
 Print from any web page
NEEScentral 2.0 (October)




Support for shake table data model
Support for tsunami data model
Curate and publish experiment
Improved structured search
 More metadata search options
 Advanced unstructured search
 Search files using Google search engine
 Bulk upload phase II
 Coordinate Spaces
 Others as needed
 Bulk download
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Roadmap for Remainder of FY06
Telepresence/Hybrid Simulation Highlights
DataTurbine 3.4 (July)




RDV 2.0 (October)
Extracted from NEESpop distribution  High Resolution Still Images
 Time-lapse movies
Repackaged as RPM
 Extract X frames/second
Bug fixes to Server and NEES utilities  Integration with NEEScentral
 Save experiment data to repository
Significant improvement to
 Replay experiment data from repository
documentation
RDV 1.4 (August)
 Discontinuous timeline
 Filter downtime from display
 Replay archived experiment data
 Event Annotations
Hybrid Simulation
 Communications Framework
(September)
 Protocol
 Library
 Server
 Mark events of interest
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Looking For Feedback
 Return comments on data model
 Contact Us!
 [email protected]
 Toll Free: 866-260-4100
 Submit bugs/feature requests: http://it.nees.org/support
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD
Future Directions for NEES
Cyberinfrastructure
Ahmed Elgamal
George E. Brown, Jr. Network for Earthquake Engineering Simulation
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD