NASA Direct Readout Laboratory

Preparing for NPP HRD

-

NISGS Update

-

Patrick Coronado NASA/GSFC

What is the NISGS ?

• The NPP In-Situ Ground System (NISGS) is an Element of the NPOESS Preparatory Project (NPP) • NISGS directly supports the Technology Insertion and NPOESS Risk Reduction objectives: – Provides technology insertion for NPOESS, which will assure that the NPOESS High Rate Data (HRD) design will be readily usable for Field Terminal users.

– Enables the user community to readily transition from existing POES/Terra/Aqua DB data to NPP and NPOESS HRD data.

• Emphasis on modularity for “freedom of choice” October 6, 2005 2

Ensuring Direct Broadcast to HRD Continuity

October 6, 2005 3

NISGS Support Model

NISGS is also a bridge between the mission and the DB community

October 6, 2005 4

NISGS Deliverables

• Direct Broadcast Science Data Record (SDR) Algorithms for all NPP Instruments – Standalone with common interface • Technology Tools to enable ingest, pre processing and real-time monitoring of any Direct Broadcast Data Record (xDR) • Provide version 1.0 of deliverables 1 yr prior to launch October 6, 2005 5

Design Objectives

• Develop a Direct Readout technology suite that is free to “anyone” • Key design criteria are: – Scalability – Extensibility – Portability – Ease of Use •

These “individual” technologies will be tested within a functional system environment

– Including verification with NPP spacecraft prior to launch October 6, 2005 6

NISGS Architecture

October 6, 2005 7

NISGS Front End System (NISFES)

NISFES Antenna ACU MMS Downconverter Receiver EDT interface Hardware Software

October 6, 2005

Key Data path Control EDT input RT-STPS RDR Simulcast Simulcast Clients

8

Multi-mission Scheduler (MMS)

• Controls NISGS Front End System (NISFES) • Serves as the interface to front end hardware and software • Calculates satellite pass schedules and resolves conflicts • Configures hardware and software to capture satellite data • Retrieves Two-line Elements (TLEs) from Information Services (IS) • Registers Level 0 products or Raw Data Records (RDRs) with the Data Storage Manager (DSM) October 6, 2005 9

Multi-mission Scheduler (MMS)

GUI Status/ Command ACU Downconverter Receiver RT-STPS RT-STPS Simulcast

October 6, 2005

MMS Core DSM Information Services

10

RT-STPS

RT-STPS is a standalone processing software system that takes a raw satellite data stream from the output of the receiver and processes it to EOS Level-0 or an RDR. Functionally, this system will take packets/frames and do the following: • Frame synchronize • PN decode • Reed-Solomon decode • Packet process • Time order • Separate instrument data streams into independent files • Write to socket for real-time data relay • Process data to EOS Level-0 or RDR October 6, 2005 11

Real-time Software Telemetry Processing System (RT-STPS)

Raw Telemetry Frames CADUs VCDUs B_PDUs Packets Acquisition Board Frame Synchronizer Server Core RS/CRC/PN Decoders CCSDS Services Remote User Interfaces Editor Setup Files Status Setup Status Viewer Web Files Network Ports

October 6, 2005 12

Simulcast

• View instrument data in real time • Replay recent satellite passes • Support multiple instrument types • Support many clients (scalable) • Support remote clients • Java implementation • Version 2 now available at http://directreadout.gsfc.nasa.gov

• Version 3 will add real-time geolocation and projection and mozaic capability October 6, 2005 13

Simulcast Client

MODIS Image of Hurricane Rita, September 23 October 6, 2005 14

Simulcast Client

MODIS Image of Hurricane Rita, September 24 October 6, 2005 15

Data Storage Manager (DSM)

• Primary job is to serve the NISDS Control System (NCS) • Stores references to products and ancillary files in the database • Finds specific products by product type, time, and other user defined criteriae • Moves files between computers • Deletes obsolete products • Components include a MySQL database, a Java library, a maintenance agent and a mover agent October 6, 2005 16

Data Storage Manager (DSM)

NCS STATIONS DSM LIBRARY NCS STATIONS DSM LIBRARY STORE PRODUCTS, QUERIES STORE PRODUCTS, QUERIES STORE DATABASE QUERY SERVER CLEANER

October 6, 2005

CLEANER PRODUCT MOVER COMPUTER 1 PRODUCT MOVER COMPUTER 2 COMPUTER 3 COMPUTER n

17

NISDS Control System (NCS)

• Controls product generation • Acts as the interface between the Data Storage Manager (DSM) and the Science Processing Algorithms (SPAs) • Retrieves SPAs input products from the DSM • Creates environment for SPA programs, and registers output products with the DSM • Scalable to accommodate indefinite increasing processing loads • Easily accommodates addition of new SPAs October 6, 2005 18

NISDS Control System (NCS)

DATA STORAGE MANAGER DSM/NCS Interface NCS CONTROL PROGRAM Build Environment Execute Application Environment Command Line Application Program Products Product References

October 6, 2005 19

Information Services (IS)

• A passive repository for in-house (GSFC) products for NISGS • A passive repository for DSM-registered ancillary and auxiliary data • Functions as a permanent repository of global ancillary and auxiliary data available to the Direct Readout community • Satisfies legacy and script users of Direct Readout community October 6, 2005 20

Information Services (IS)

NISGS Gigabit Internet Information Services FTP Server GSFC Direct Broadcast Server Community IS Server Community IS Server Community IS Server Gigabit Internet

• • •

Global Ancillary Server Global Auxiliary Server Special Operation Data Linux Operating System

October 6, 2005 21

NISGS Status/Event Logging System (NSLS)

• Logs status events that occur • Allows real-time display of events • Supports filtered searching of past events • Provides a real-time diagnostic tool

October 6, 2005

NISGS Status/Event Logging System (NSLS) October 6, 2005

A Common Science Processing Algorithm (SPA) Wrapper SPA Wrapper Model For any data system to be efficiently extensible there has to be a way to take an arbitrary algorithm and add it to ‘a’ processing environment.

Input Files

Label

attitude ephemeris imagedata

File

att.hdf

eph.hdf

img.hdf

TLE LUT DEM Algorithm Output Files

Label

Veg. Index VI Image

File

ndvi.hdf

vi.tiff

Param s Wrapped Algorithm •

For the EOS SPAs, the DRL wrappers are implemented in Java (like everything else within the NISGS model). Simple implementation: can be instantiated from a command line

•

NISGS Testbed Build 2 SPAs are fully SPA Wrapper Compliant

•

All future SPAs located on the Direct Readout Web Portal will comply with the SPA Wrapper Model

October 6, 2005 24

With a ‘Common’ Wrapper Comes Challenges- NPP/NPOESS

Label

Input Files

File

attitude att.hdf

ephemeris eph.hdf

imagedata img.hdf

Wrapper XML C++ Wrapper core

Label

Output Files

File

Veg. Index ndvi.hdf

VI Image vi.tiff

Memory data field Memory data field Memory data field I-P-O Algorithm Memory data field Memory data field Memory data field Input/outpu t Refers to Wrapped I-P-O Algorithm

All ‘goals’ established for EOS SPAs may be implemented for the IDPS OPS Code, but… It is desired to have one set of SPAs for all the right reasons, so: The NPP Science Team, NPOESS Cal/Val Team and the DRL are working ‘together’ to establish criteria for common wrapper model for NPOESS Success can be achieved with full SSPR cooperation

October 6, 2005 25

Algorithm Validation Process

October 6, 2005 26

NISGS Status

• NISGS Build 1 completed April 2005 • NISGS Build 2 completed September 2005, and will be demonstrated later this month at the PolarMax Conference • NISGS Build 3 now underway October 6, 2005 27

Test Data Sets

• CADU-level raw data set • APID structure – all 4 instruments – First data set will allow testing of your protocol processing/ingest system • Available next summer via Directreadout web portal • Spacecraft to Direct Readout Station Interface Control Document now available.

http://directreadout.gsfc.nasa.gov

under Documents in Links section October 6, 2005 28

EOS Science Code Availability

• MODIS Level 1 & LUTs for Terra/Aqua – Available http://oceancolor.gsfc.nasa.gov/seadas/modisl1db/ • Oceans Algorithms Available Source code within SeaDAS at: http://oceancolor.gsfc.nasa.gov/seadas/ • Land and Atmosphere Algorithms – Available Jan 2006

NASA Public release site:

http://opensource.gsfc.nasa.gov/ October 6, 2005 29