Transcript Current MODIS Data System: Processing, Archiving and Distribution Shaida Johnston July 13, 2004

Current MODIS Data System:
Processing, Archiving and Distribution
Shaida Johnston
July 13, 2004
7/13/04
Shaida Johnston
MODIS Science Team Meeting
1
Contents
•
•
•
•
•
•
•
•
Overview of MODIS data system
What are the current MODIS products?
Where are MODIS products processed?
Which data products are in the MODIS archives?
Through what mechanisms are MODIS data distributed?
What tools and services are available to MODIS data users?
Who can one contact with questions?
Acronym list
7/13/04
Shaida Johnston
MODIS Science Team Meeting
2
DAACs
MODIS Data Flow
Terra
Aqua
GMAO
Data
GMAO
EDOS
Process L0
NOAA
& FDD
L0 Data
72 GB
Ingest
GMAO Data
Ingest L0,
Archive &
(Re)Process
L1
Ancillary
Data
L1
Data
GMAO &
Ancillary Data
MODAPS
L1 Data
220 GB
QA
Metadata
Update
MCST
Calibration &
L1 Validation
SeaWiFS/OCDPS
Process, Archive &
Distribute
Aqua Ocean Color
7/13/04
Archive &
Distribute
Land Data
GES DAAC
NOAA/
Bent Pipe
at GSFC
RT Users
LP DAAC
L2+
Data
(Re)Process
L2+
410 GB
L1,
L2+
Data
QA
Metadata
Update
SCFs
L2+
Validation
GES DAAC
Archive &
Distribute L1,
Ocean SST,
Atmosphere L2+
and GMAO,
ancillary data
NSIDC DAAC
-BU(2) -UMD(3)
-UCSB -GSFC(3)
-UMiami
Data volumes represent forward processing
of 1 MODIS instrument (1x) per day
Shaida Johnston
MODIS Science Team Meeting
Data Products
Archive &
Distribute
Snow & Ice
Ocean Color Products
3
Current Products - Level 1
Product
Product
Designator
Level 1A - Radiance coun ts
Terra MOD01
Aqua MYD01
Level 1A Subset – 20 Ocean bands
MOD01SS
Level 1B – calibrated, geolocated,
MOD021KM
at-aperture radiance – all bands
Level 1B – bands 1-7
MOD02HKM
Level 1B – bands 1 &2
MOD02QKM
Level 1B Subsampled – all band s
MOD02SSH
HDF –EOS format
Level 1B Subsampled - all band s
MOD02SSN
Binary format
On-board calibrator (OBC) & eng. data MOD02OBC
Geolocation fields
MOD03
7/13/04
Shaida Johnston
MODIS Science Team Meeting
Temporal
Resolution
5-min swath
Spatial
Resolution
Raw counts
5-min swath
5-min swath
Raw counts
1km
5-min swath
5-min swath
5-min swath
500 m
250 m
5 km
5-min swath
5 km
5-min swath
5-min swath
1 km
4
Current Products - Atmosphere
Product
Aerosols
Precipitable Wa ter Vapor
Product
Designator
Terra  MOD04_L2
Aqua  MYD04_L2
MYD05_L2
Cloud Properties
MYD06_L2
Atmospheric Profiles (Temp. & Water Vapor) MYD07_L2
Cloud Mask
MYD35_L2
7/13/04
Joint Cloud/Aerosol/Water Vapor & Profile
MYDATML2
Joint Aerosol/Water Vapor/Cloud/ Ozone –
Global, gridded
MYD08
Shaida Johnston
MODIS Science Team Meeting
Temporal
Resolution
5-min swath
Spatial
Resolution
10 km
5-min swath
1 km
5 km
5-min swath 1 km
5 km
5-min swath 5 km
5-min swath 250 m
1 km
5-min swath 5 km
10 km
(L3) daily, 8 - 1º CMG
day, monthly
5
Current Products - Land
Product
Product Designator
Surface Reflectance
MOD09
Land Surface Temp.
& Emis sivity
MOD11
Land Cover Chang e
Land Cover Typ e
Vege tation Indices
MOD12/MCD12
(no MYD12 )
MOD13/MCD13
Ther mal Ano malies
/Fire
MOD14
Burn Scar
BRDF/Albedo (3)
LAI/FPAR
MOD43/MCD43
(no MYD43 )
MOD15
Evapo transpiration /
Surface Resis tance
Net Photo synthes is
Net Primary Produc tion
MYD16 only
Veg. Cover Conv ersion
Veg. Continuou s Fields
MOD44 only
7/13/04
MOD17
Temporal Resolution
(L2G) daily
(L3) 8-day
(L3) daily
(L2) 5-min swath
(L3) daily
(L3) 8-day
(L3)daily, 8-day, monthly
(L3) 96-day
Spatial Res.
Projec.
(L4) 8-day
(L4) 32-day
(L4) 8-day
250m, 500m
250m, 500m
.05º
1 km
1 km, 5 km
1 km
.05º
1 km
.05º
250m, 500m, 1km
1 km
.05º
1 km
1 km
.05º
500m
1 km
.05º
1 km
.05º
1 km
SIN
SIN
CMG
SIN
SIN
CMG
SIN
CMG
SIN
SIN
CMG
SIN
CMG
SIN
SIN
CMG
SIN
CMG
SIN
(L4) 8-day
(L4) 32-day
(L4) yearly
(L3) 32-day
(L4) yearly
1 km
.05º
1 km/.05º
250 m
500 m
SIN
CMG
SIN/CMG
SIN
SIN
(L3) 16-day
(L3) monthly
(L3) 16-day, monthly
(L2) 5-min swath
(L3) daily, 8-day
(L3) 32-day
(L3) 16-day
(L3) 16-day
Shaida Johnston
MODIS Science Team Meeting
6
Current Products - Cryosphere
& Intermediate Land
Product
Snow Cover
Product
Designator
MOD10/MYD10*
Sea Ice
MOD29/MYD29*
Sea Ice Extent and
Surface Temperature
Geolocation Angles
Observation Pointers
MODMGGAD
MODPT
Temporal
Resolution
(L2) 5-min swath
(L3) daily, 8-day
(L3) daily, 8-day
(L2) 5-min swath
(L3) daily (day/n ight)
(L3) daily
Spatial
Resolution
500m
500m
.05º
1 km
1 km
4 km
Projection
SIN
CMG
EASE-grid
EASE-grid
(L2G) daily (day)
(L2G) daily (day)
(L2G) daily
1 km
1 km
250m, 500m
SIN
SIN
SIN
* Terra and Aqu a products are not identically p roduced due to problems with Aqua Band 6
7/13/04
Shaida Johnston
MODIS Science Team Meeting
7
Terra Ocean Products
Feb. 2000 - Jan. 2004
*
*
* Feb. 2004 - Present
7/13/04
Shaida Johnston
MODIS Science Team Meeting
8
Ocean (Standard) Product Parameters
1
2
3
4
5
6
7
8
9
10
11
12
13
14
13
16
17
18
19
20
nLw_412/Normalized water-leaving radiance at 412 nm
nLw_443/Normalized water-leaving radiance at 443 nm
nLw_488/Normalized water-leaving radiance at 488 nm
nLw_531/Normalized water-leaving radiance at 531 nm
nLw_551/Normalized water-leaving radiance at 551 nm
nLw_667/Normalized water-leaving radiance at 667 nm
nLw_678/Normalized water-leaving radiance at 678 nm
Tau_869/Aerosol optical thickness at 869 nm
Eps_78/Epsilon of aerosol correction at 748 and 869nm
aer_model1/Aerosol model identification number 1
aer_model2/Aerosol model identification number 2
eps_clr_water/Epsilon of clear water aerosol correction at 531
and 667 nm
CZCS_pigment/Chlorophyll-a + pheopigment (fluorometric,
empirical)
chlor_MODIS/Chlorophyll-a concentration (HPLC, empirical)
pigment_c1_total/Total pigment concentration (HPLC, empirical)
chlor_fluor_ht/Chlorophyll fluorescence line height
chlor_fluor_base/Chlorophyll fluorescence baseline
chlor_fluor_effic/Chlorophyll fluorescence efficiency
susp_solids_conc/Total suspended matter concentration in ocean
cocco_pigmnt_conc/Pigment concentration in coccolithophore
blooms
21
22
23
24
25
26
27
28
29
30
30
31
32
34
35
36
37
38
39
40
cocco_conc_detach/Detached coccolithophore concentration
calcite_conc/Calcite concentration
K_490/Diffuse attenuation coefficient at 490 nm
phycoeryth_conc/Phycoerythrobilin concentration*
phycou_conc/Phycourobilin concentration
chlor_a_2/Chlorophyll-a concentration (SeaWiFS analog - OC3M)
chlor_a_3/Chlorophyll-a concentration (semianalytic)
Ipar/Instantaneous photosynthetically available radiation
Arp/Instantaneous absorbed radiation by phytoplankton for
fluorescence
absorp_coef_gelb/Gelbstoff absorption coefficient at 400 nm
chlor_absorb/ Phytoplankton absorption coefficient at 675 nm
tot_absorb_412 /Total absorption coefficient at 412 nm
tot_absorb_443 /Total absorption coefficient at 443 nm
tot_absorb_488/Total absorption coefficient at 488 nm
tot_absorb_531/Total absorption coefficient at 531 nm
tot_absorb_551/Total absorption coefficient at 551 nm
SST (daytime), 11 µm
SST (daytime), 4µm
SST (nighttime), 11 µm
SST (nighttime), 4 µm
Angstrom_531/ Angstrom coefficient, 531-869 nm
* Not maintained
7/13/04
Shaida Johnston
MODIS Science Team Meeting
9
MODIS Data Processing
Level 1
GES DAAC
• Level 1A
• Level 1A subset
• Level 1B (1km, 500m , 250m)
• Level 1B sub-sampled
• Geolocation
Ocean
Atmosphere
Land
Cryosphere
7/13/04
• Cloud Mask
• Atmospheric Profiles
MODAPS
• Terra SST
• Aqua SST
• Aerosols
• Precipit able Water Vapor
• Cloud Properties
• Joint Atmos. Products
• Surf. Reflectance
• Land Surf. Temp
• Land Cover
• Vegetation Indices
• Thermal Anom./Fire
• BRDF/Albedo
• LAI/FPAR
• Evapotranspiration
• Net Primary Prod.
• Veg. Cover Conv.
• Snow Cover
• Sea Ice
Shaida Johnston
MODIS Science Team Meeting
OCDPS
• Level 1A subset
• Level 1B_OC (subset)
• Aqua Ocean Color
• Aqua SST (quicklook)
10
Archives of MODIS Data
LP DAAC ~ .7 PB
(Sioux Falls, SD)
NSIDC
(Boulder, CO)
Level 1
Ocean
Atmosphere
Data Pools*
Land
Cryosphere
* L3 Land Produc ts (12 mos)
* L2G Su rf. Refl. ( 4 days)
* Recently
inge sted granu les
GES DAAC ~ 1.4 PB
(Greenbelt, MD)
• All Leve l 1
• Terra OC & SST (2/00 -2/04)
• Aqua OC (6/02-2/04)
• Aqua SST (6/02-7/04)
• Cloud Mask
• Aerosols
• Precipitable Water
• Cloud Properties
• Atmos. Profiles
• Joint global atmos. produc t
* Geolocation (1 mo)
* All L1B sub- sampled + L1B (10 days )
* L2 SST (1 mo)
* L3 Mapped T(4/00-7/04) + A(1/03-7/04)
* All Atmosphe res L2 + L3
OCDPS
(Greenbelt, MD)
• Leve l 1A sub set
- Aqua + Terra
• Aqua OC
(6/02-7/04)
• Surface Reflectance
• Land Surface Temp
• Land Cover
• Veg. Indices + US tim e series mosaic
• Ther mal Ano malies/Fir e
• LAI/FPAR
• Net Primary Produc tion
• BRDF/Albedo
• Vege tation Cover Conve rsion
• Snow Cove r
• Sea Ice
*Data Pools are ‘rolling’ archives of fresh or high-interest data on disk
7/13/04
Shaida Johnston
MODIS Science Team Meeting
11
Product Collections
(Reprocessing Events)
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
Collection 1
Coll. 3
Collection 4
Collection 5
Collection 6
Collection 7
Terra
Aqua
Collection 3
Collection 4
Collection 5/Combined
Collection 6/Combined
Collection 7/Combined
Solid Color=Reprocessing
Dashed Color=Forward Processing
Dates represent Data Dates
7/13/04
Shaida Johnston
MODIS Science Team Meeting
12
Distribution Mechanisms
LP DAAC
User Interface/Features
EOS Data Gateway (EDG)
Media & FTP delivery
Subscription
Browse (visualization)
Search by data attributes
Access to all DAACs
On-line access note
MTMGW (for large volume transfers)
Spatial subsets (HEW)
Web H ierarchical Ordering Mechanism
Browse (visualization)
Spatial Subscriptions
On-demand subsetting (Oceans L1B/L2)
On-the-fly subsetting (19 ocean basins-L3)
LP DAAC Client/MODIS-specific Client
Subsetting, Reformatting, Reprojection
Data Compression
NSIDC Data Pool
Browse
Subsetting, Reformatting, Reprojection
SNOWI/ MO DIS SNOW I
SeaWiFS Web Interface
FTP Delivery
Subscription
Browse (visualization)
Regional subsets
7/13/04
Archive Data Pool
X
X
9/04
X
X
GES DAAC
Archive
Data Pool Archive
X
X
some
X
X
X
X
NSIDC
Data Pool
X
X
X
X
X
X
X
X
X
X
OCDPS
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
Shaida Johnston
MODIS Science Team Meeting
13
In the Works
• EOSDIS Clearing HOuse ECHO
– MODIS granules to populate by 8/04 at LP DAAC
• Open Data Access Protocol (Open DAP, formerly DODS)
– L3 & L4 gridded data accessible
• http://daac.gsfc.nasa.gov/services/dods/DODS.html
– Supports subsetting
– Matlab and IDL Clients
• MODIS On-line Visualization and Analysis System (MOVAS)
– On-line atmospheres data
– Emphasis on time series
– Subsetting capability
• Near-Archive Data Mining (Experimental)
7/13/04
Shaida Johnston
MODIS Science Team Meeting
14
Data Tools Available for Users
» http://edcdaac.usgs.gov/datatools.asp
» http://nsidc.org/data/tools/
•
•
•
•
•
•
•
MODIS Reprojection Tool (MRT)
MODIS Land Data Operational Evaluation (LDOPE)
MODIS Swath Reprojection Tool (MRT Swath)
MODIS Atmospheres Tools
MODIS Swath-to-Grid Toolbox (MS2GT)
HDF-EOS to GeoTIFF Conversion Tool (HEG)
HEW Subsetting Appliance (HSA)
7/13/04
Shaida Johnston
MODIS Science Team Meeting
15
Data Access
EOS Data Gateway (EDG) - http://redhook.gsfc.nasa.gov/~imswww/pub/imswelcome/
NSIDC EDG: http://www.nsidc.org/~imswww/pub/imswelcome/
WHOM (for GES DAAC) - http://daac.gsfc.nasa.gov/data/
GES DAAC MODIS Data Support - http://daac.gsfc.nasa.gov/MODIS/
LP DAAC - http://edcdaac.usgs.gov/main.asp
Mosaic of MOIDS Veg. Indices - http://seamless.usgs.gov
NSIDC - http://nsidc.org/data/modis/
NSIDC data pool: http://www.nsidc.org/data/data_pool/
SNOWI: http://www.nsidc.org/data/snowi/
MODIS SNOWI: http://www.nsidc.org/data/modis_snowi/
Ocean Color - http://oceancolor.gsfc.nasa.gov
7/13/04
Shaida Johnston
MODIS Science Team Meeting
16
Contacts
Contact
Phone
MODAPS
Ed Masuoka, Scien ce Data Support Team Lead
Mike Teague, MODAPS Operations Manager
GES DAAC
Steve Kempler, GES DAAC Manager
GES DAAC Help Desk
LP DAAC
Tom Kalvelage, LP DAAC Manager
LP DAAC User Services
7/13/04
301-614 -5515
301-614 -5498
[email protected]
[email protected]
301-614 -5765
301-614 -5224
1-877-422-1222
[email protected]
[email protected]
605-594 -6116
1-866-573-3222
NSIDC
Ron Weaver, NSIDC DAAC Manager
Marilyn Kamin ski, Product Team Lead
Greg Scharfen, Science Lead
Donna Scott, User Services Rep.
OCDPS
Charles McLain, Ocean Color Team Lead
Gene Feldman, Ocean Color Processing Lead
E-mail
kalvelag [email protected]
[email protected]
303-735 -5408
303-492 -6197
303-492 -6360
[email protected]
marilynk @nsidc.org
[email protected]
[email protected]
301-286 -5377
301-286 -9428
Charles.R.McClain@n asa.gov
[email protected]
Shaida Johnston
MODIS Science Team Meeting
17
Acronyms
BRDF - Bidirectional Reflectance Distribution Function
BU - Boston University
DAAC - Distributed Active Archive Center
ECHO - EOSDIS Clearing HOuse
ECS - EOSDIS Core System
EDG - EOS Data Gateway
EDOS - EOS Data Operations System
EOS - Earth Observing System
EOSDIS - Earth Observing System Data Information System
ESDIS - Earth Science Data and Information System (Project)
FDD - Flight Dynamics Division
FPAR - Fraction of absorbed Photosynthetically Active Radiation
FTP - File Transfer Protocol
GES DAAC - Goddard Earth Science DAAC
GMAO - Global Modeling and Assimilation Office
GSFC - Goddard Space Flight Center
HDF - Hierarchical Data Format
HEW - HDF-EOS Web-based subsetter
L0, L1, L2, L3, L4 - Level 0,1, 2, 3, 4 (processing levels)
LAI - Leaf Area Index
7/13/04
LDOPE - Land Data Operational Evaluation
LP DAAC - Land Processes DAAC
MCST - MODIS Characterizaton Support Team
MODAPS - MODIS Adaptive Processing System
MODIS - Moderate Resolution Imaging Spectroradiometer
MTMGW - Machine-to-Machine Gateway
NOAA - National Oceanographic and Atmospheric Administration
NSIDC - National Snow and Ice Data Center
OBC- On-board Calibrator
OC - Ocean Color
OCDPS - Ocean Color Data Processing System
QA - Quality Assurance
SCF - Science Computing Facility
SDST - Science Data Support Team
SST - Sea Surface Temperature
UCSB - University of California, Santa Barbara
UMD - University of Maryland
USGS - United States Geological Survey
WHOM - Web Hierarchical Ordering Mechanism
Shaida Johnston
MODIS Science Team Meeting
18