Transcript www.eos.ucar.edu

Aura DSWG Meeting
ESDIS Status
09/27/10
Alfreda Hall
ESDIS DAAC Engineer
NASA GSFC Code 423
[email protected]
301-614-5147
1
EOSDIS Facilities
Data centers, collocated with centers of science discipline
expertise, archive and distribute standard data products
produced by Science Investigator-led Processing Systems
(SIPSs)
ASF DAAC
SAR Products
Sea Ice, Polar
Processes
SEDAC
CDDIS
Crustal Dynamics
Solid Earth
NCAR, U of Col.
LP DAAC
HIRDLS, MOPITT,
SORCE
Land Processes
& Features
GSFC
GLAS, MODIS,
OMI, OBPG
GES DISC
Key
Atmos Composition &
Dynamics, Global
Modeling, Hydrology,
Radiance
NSIDC DAAC
Cryosphere, Polar
Processes
Data
Center
OBPG
Ocean Biology &
Biogeochemistry
JPL
MLS, TES
ORNL DAAC
LAADS/
MODAPS
Biogeochemical
Dynamics, EOS Land
Validation
SIPSs
LaRC
ACRIM
Ocean Circulation
Air-Sea Interactions
Atmosphere
CERES,
SAGE III
San Diego
PO.DAAC
Human Interactions
in Global Change
GHRC
Hydrological Cycle &
Severe Weather
ASDC
GHRC
AMSR-E, LIS
EOSDIS Data Centers
12
Science Investigator-Led Processing Systems (SIPSs)
14
Radiation Budget,
Clouds, Aerosols,
Tropo Chemistry
2
EOSDIS Products Delivered: FY00 thru Aug 2010
(in Millions)
375
34,841 K
350
325
300
275
250
225
200
175
150
125
100
75
50
25
0
FY00
FY01
FY02
FY03
FY04
FY05
FY06
FY07
FY08
FY09
FY10
3 to
date Aug
EOSDIS Performance
EOSDIS
Aura
Instruments
Unique Data Products
> 4000
155
Distinct Users of EOSDIS Data and Services
> 910K
5,056
> 1M
---
1.8 TB/day
55.26 GB/day
Total Archive Volume
4.2 PB
95,841 GB*
End User Distribution Products
> 254M
5M
6.7 TB/day
143.09 GB/day
FY09 Metrics
Web Site Visits of 1 Minute or more
Average Daily Archive Growth
End User Average Daily Distribution Volume
--- = DAAC specific metric
* = as of 8/31/10
4
EOSDIS ACSI Customer Satisfaction Survey 2009:
Relative Rankings
EOSDIS sponsors an annual independent customer survey in
conjunction with the American Customer Satisfaction Index (ACSI)
EOSDIS consistently exceeds the Federal Government average
Ratings in the mid to upper 70s are considered “very good” by the
rating organization, the CFI Group
2009 Survey results based on 3842 responses (10%)
Federal Government
Overall
69
NASA EOSDIS
77
E-Business News &
Information
(Public/Private Sectors)
73
30
40
50
60
70
80
5
Status of ICDs
Title / Book Boss
ICD between GES DISC S4PA and
SSE /
Alfreda Hall and Bruce Vollmer
Appendix A. MLS Data Flows /
Karen Michael and Alfreda Hall
Appendix B. HIRDLS Data Flows /
Alfreda Hall
Appendix C. OMI Data Flows /
Alfreda Hall
Appendix D. ODPS Data Flows /
Alfreda Hall
Appendix H. GMAO Data Flows /
Alfreda Hall
Appendix L. GES DISC – ECS
ASDC Data Flows /
Karen Michael
ICD between ECS and SIPS,
Volume 0
Karen Michael
ECS-TES SIPS ICD /
Brian Krupp
Status
Original July 2007. No CCRs pending.
Original July 2007. Updated 11/12/2008. No
CCRs pending.
Original July 2007. Updated 11/12/2008. No
CCRs pending.
Original July 2007. Updated 01/26/2009. No
CCRs pending.
Original July 2007. Updated 04/30/2009. No
CCRs pending.
Original January 2008. No CCRs pending.
Original July 2007. Published 03/03/2009.
No CCRs pending.
Revision J October 2008. No CCRs
pending.
Revision C April 2010. No CCRs pending.
6
What’s Coming Up
•
•
•
•
•
•
•
•
•
•
The Land, Atmosphere Near-real-time Capability for EOS (LANCE)
– CCR in formal review to baseline the requirements
EOSDIS Network ICDs being replaced with a core document with each
elements’ requirements specified in separate appendices:
– ICD Between the EOS Networks and the EOSDIS Elements (core
document). Baselined – February 2010
Initial planning for long term data retention and preservation for EOSDIS data
Data centers infusing technologies to improve core capabilities of EOSDIS in
the near-term (FY10-FY11)
Uniform user registration system being developed and implemented across
DAACs
Distribution and management of MEaSURES datasets as they mature
Continuous focus on improved EOSDIS data access and interoperability within
the next year
Advance planning science system support for Decadal Survey missions
Earth Science Data System Working Groups (ESDSWG) Meeting; New
Orleans, LA – October 20-22, 2010
A-Train Symposium, New Orleans, LA – October 26-28, 2010
7
The Land, Atmosphere Near-real-time Capability for EOS
(LANCE)
• Building on existing EOSDIS elements provides data from MODIS, OMI, AIRS,
MLS, and AMSR-E instruments in near real-time (< 3 hours from observation)
• Utilizes PGE Code from Standard Science Products, but relaxes requirements for
ancillary data inputs
• Applications of LANCE data
include:
– Numerical weather & climate
prediction/forecasting
– Monitoring of Natural Hazards
– Disaster Relief
LANCE Architecture
EDOS
Level Zero Processing Facility
• High operational availability
GES DISC
Format: RBD
Format: RBD
Format: S-PDS
Format: RBD
Observation to availability latency: 30-180 min.
– Homeland Security
MODIS*
OMI
Users
GMAO
Protocols: HTTP/FTP
Data Available:
-MODIS L1, L2, L2G*
and selected L3*
-AMSR-E L1, L2 and L3
AMSR-E
OMI SIPS
Format: RBD
Data Available:
-AIRS L1 and L2
-MLS L2
MLS
MODAPS
– Agriculture
– Air quality
AIRS
Protocols: HTTP/FTP
NRL
SPoRT
UMBC
USGS
Protocols: HTTP/FTP
Others
Data Available:
-OMI L1B and L2
Transfer latency: bandwidth dependent
LANCE Element Under Development
Operating LANCE Element
RBD: Rate Buffered Data
S-PDS: Session Based Production Data Set
* L2G and L3 daily products have latency of 27-28 hours. The Climate Modeling Grid (CMG) is the only L3 MODIS product produced by
LANCE.
8
User Registration
• EOSDIS will implement a system-wide user
registration system in the near-term
– One set of credentials to access data
– Users will self-register with username and
password recovery
• Prototype capability exists for the LANCE
systems
• Development is underway by Raytheon.
Phase I rolls out to LP and NSIDC DAACs
(late Spring 2011)
9
ECHO/WIST/GCMD Status
•
•
•
•
Warehouse Inventory Search Tool (WIST): ECHO’S general purpose,
web-based WIST client allows users to submit cross-discipline
queries using spatial and temporal criteria
Current Holdings:
– 3,092 Collections, with 87 million Granules, and 57 million Browse
products
– Data Partners: ASF, GHRC, GSFC, LAADS, LARC ( ECS &
ANGe), LPDAAC, NSIDC, ORNL, SEDAC,USGS/ Landsat, PO
DAAC
Enhancements status:
– Improved operational availability by deploying a fully redundant
system with automated failover
– New general purpose web-based client employing new
technology coming available May 2011
– Simplifying end-user Client development by providing pre-built
components to allow for rapid, low cost client deployment
Global Change Master Directory (GCMD) Holdings:
– >30,000 descriptions of Earth science data sets, services and
ancillary descriptions covering all aspects of Earth and
environmental sciences
– More active than ever….>100 portals already in use
10
– URL: http://gcmd.nasa.gov
ESDIS Project
Project Manager
Project Support
Lucia Gayhart
Financial Manager
Diane Hronek
Resource Analysts
Deputy Project Manager
Jeanne Behnke
Deputy PM/Resources
J. Steve Metcalf
Science Systems
Development Office
Dan Marinelli
System Engineer
Dan Marinelli (Acting)
Hardware Engineer
Chris Bock
Advanced Planning
& Interoperability
Frank Lindsay
Assistant Project Manager
H. K. “Rama” Ramapriyan
Barbara Haskell
Systems
Engineering
System Manager
Karen Michael
Dawn Lowe
Development
& Sustaining
Engineering
Evolution/SW Dev Mgr
Vacant
ECHO Development & Ops
Andrew Mitchell
Science Operations Office
Jeanne Behnke
Data Center
Engineers
Alfreda Hall
Networks
Engineer
Kevin Kranacs
Outreach/
User Support
Carol Boquist
John Moses
Anne Koslosky
Kevin Murphy
Drew Kittel
11