Transcript NEEShub

Ellen M. Rathje
University of Texas at Austin
NEEScomm IT Development Team



Introduction (Ellen Rathje)
Procedures for Data Archiving and Sharing
Data Management and Curation Process
◦ Standa Pejsa (NEEScomm Data Curator)

Tools for Data Management
◦ Project Warehouse/Project Editor (Gaby Ou)
◦ Specimen Authoring Tool and inDEED (Kari Nasi)
◦ Project Explorer for NEES (Rachelle Howell)

Tools for Collaboration (Santiago Pujol)
◦ Group Space
◦ SynchroNEES
Post-webinar survey
We’ve got a
HUB for that!
There are different levels of sharing and collaboration within NEEShub
NEEShub
Personal
Workspace
(private)
Group
Spaces
(restricted)
Project
Warehouse
(private/ public)
A centralized data repository for managing, sharing, storing, and publishing research data
Search
Search Results
inDEED Data Viewer
Project Display
A centralized data repository for managing, sharing, storing, and publishing research data
Descriptions
Data
Photos
Drawings
Mat’l Descriptions
Publications
Every project is created
with the same structure
This provides consistency between projects and
aids in the navigation of project information
The model governing the organization of data within a project


Project
Experiment
Trial
Repetition
A project represents an entire research project,
which consists of a suite of tests and associated
simulations

Each test is set up as an individual experiment

Within each experiment there are several trials or
separate events for which data is measured

If the same trial is performed more than once, it
may have multiple repetitions
The model governing the organization of data within a project
Project
NEES-GC: Seismic Risk Mitigation for Port Systems
Experiments
Trials
Repetitions
Centrifuge Test
of PV Drains
Mar 2007
Pile-Wharf
Connection Test
Sept 2007
Crane Shake
Table Test
Nov 2009
Sine1
Sine2
Sine3
Cyclic Load
Shake1
Shake2
Rep1
Rep1
Rep1
Rep1
Rep1
Rep1
The model governing the organization of data within a project
A centralized data repository for managing, sharing, storing, and publishing research data
Remember the data within the Project Warehouse is PUBLIC

For each repetition within a trial, there are four
data folders that are automatically created
1. Unprocessed data

Raw voltages, channel names, potentially non-standard
formats (e.g., binary files)
ASCII tab
2. Converted data

Measurement units, instrument names
3. Corrected data

delimited files
recommended
for all sensor
data
Filtering, baseline corrections, removal of bad data
4. Derived data

Corrected data plus values derived from measured
units (data not directly measured).
Data cannot be shared without proper documentation

Experiment Documentation
◦ Metadata fields within the Project Display
◦ Experimental Setup Report placed in
Documentation folder

Uploaded by
Researcher
within 6 months
of experiment
Sensor Measurement Data
◦
◦
◦
◦
Unprocessed
Converted
Corrected
Derived
Uploaded by Site within 1-week of experiment
Uploaded by
Researcher
within 6 months
of experiment
Requirements and definitions have the
goal of making data EASILY re-useable
The nuts and bolts

The Project Editor
◦ Create, edit, and update projects
◦ File uploads through web interface

The Project Explorer for NEES (PEN)
◦ Efficient upload/download for bulk file management
◦ Direct file upload (not a web interface)
◦ Files organized offline and then uploaded

inDEED Data Viewer
◦ Facilitates browsing/viewing/investigating data within
Warehouse without download
Projects are created
using the Project Editor
Enhancing bulk upload of files
Facilitating data queries
Projects with Data Visualization
Projects with Data Visualization

Definition of Enhanced
◦ Metadata fields in Project Display are complete
(including drawings, material properties)
◦ Project includes at least one visualization of data
◦ inDEED is currently the only visualization tools that
allows for viewing data within the NEEShub without
download
An easy way to share content and conversation

Groups can be:
◦ Public, restricted, or private

Purpose
◦ To facilitate conversation, collaboration, and data
sharing between group members. Discussions, wiki
posts, and files are in one central location available
to all group members.

Features
◦ Wiki, messaging, discussion boards, and file
sharing via the dropbox
An easy way to share content and conversation
The nuts and bolts

SynchroNEES
◦ A graphical user interface
for transferring files
 Local PC to NEES
group workspace
 NEES Personal workspace
to NEES group workspace
The first time you use them
Tools & Resources > Tools
Tools that you use most often will appear on your “My NEEShub” page
Your
current
sessions
The tools
you use
most often
My NEEShub

Data Documentation Wiki (under construction)
nees.org/topics/DataDocumentation
◦ For documents describing recommended procedures
for data sharing and archiving


NEEScomm IT Director Dawn Weisman
([email protected])
Data Curator Standa Pejsa ([email protected])
◦ Standa is a resource for assisting in sharing and
archiving your data