Transcript Slide 1

Science Data Capture
Jim Aloise
System Programmer
[email protected]
Nov 16 - 17, 2004
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 1
DMR – SOC Requirements
• 8000.2.4 Science Data Processing, Archiving and
Distribution
•
Each SOC shall provide the necessary facility, software, hardware and
staff to receive, process, archive and distribute the science data
generated by its instruments.
•
Implementation is a Joint SOC (JSOC) for HMI and AIA
•
Emphasis here is on Science Data Capture
My Documents\DMR_SOC_Req.ppt
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 2
SDO Ground System Architecture
SDO Ground Site #2
White Sands
S band
Ground System
Same Interfaces as Prime Ground Station
Ka band
Ground System
S-Band:
Cmd &
HK Tlm
Ka-Band:
150 Mbps
Science Data
SDO Ground Site #1
White Sands
Observatory Commands
S band
Ground System
Station Control
SDO Mission Operations Center
Acquisition Data
Housekeeping Telemetry
Ka band
Ground System
Telemetry & Command
System
Flight Dynamics
System
Ground Station
Control System
Mission Planning
DDS Control System
Trending
Tracking Data
Station Status
Ka Science Data
DDS Control
Data Distribution
System
HMI Science Data
55 Mbps
DDS Status
Science Planning
and FDS Products
HMI & AIA Instrument
Commands and Loads
AIA Science Data
67 Mbps
HMI, AIA & S/C
Housekeeping Telemetry
Stanford University
Science Data Processing
Lockheed Martin
Instrument Operations
HMI and AIA
Joint Science Operations Center
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 3
Network Context Diagram
WSGT Ka-band
STGT Ka-band
SDOGS
WSGT S-band
STGT S-band
FEP
FEP
FEP
FEP
RRCP
RRCP
RRCP
RRCP
SDODDSsr-4a
SDODDSsr-4b
SDODDSsr-5a
SDODDSsr-5b
SDOGSsr-1a
SDOGSsr-1b
SDOGSsr-3a
SDOGSsr-3b
ant.
ctlr
Fibre
Channel
SDOGSsr-6a
30-day archive
SDODDSsr-3a
DDS
SDODDSsr-3b
SDOr14-1a
SDOr14-1b
SDOsr14-4a
SDOr14-2a
SDOsr14-4b
R/T #1
SDOsr14-5a
MOC
SDODDSr-1a
SDOr14-2b
SDOsr14-5a
R/T #2
firewall-a
SDODDSr-2a
Support segment
SDOsr14-3a
DMZ
SDOsr-6a
SDOsr14-3b
SDOsr-6b
firewall-b
FlatSat
Open IOnet
SDOJSOCr-2b
SDOJSOCr-2a
SDOEVEr-2a
SDOJSOCr-1b
SDOJSOCr-1a
SDOEVEr-1a
SDOEVEr-1b
Legend
HMI
AIA
JSOC Stanford
SOC SDP
EVE
HMI
AIA
EVE
JSOC Lockheed
SOC T&C
SDO Network Devices
HMI Critical Design Review – November 16-17, 2004
OC3
fiber Ethernet
Ethernet
T3
T1 / FT1
Draft v13e last updated 10/18/04
HMI00845 - Page 4
SOC SDP Data Flows
WSGT Ka-band
STGT Ka-band
SDOGS
WSGT S-band
STGT S-band
FEP
FEP
FEP
FEP
RRCP
RRCP
RRCP
RRCP
SDODDSsr-4a
SDODDSsr-4b
SDODDSsr-5a
SDODDSsr-5b
SDOGSsr-1a
SDOGSsr-1b
SDOGSsr-3a
SDOGSsr-3b
ant.
ctlr
Fibre
Channel
SDOGSsr-6a
30-day archive
SDODDSsr-3a
DDS
SDODDSsr-3b
SDOr14-1a
SDOr14-1b
SDOsr14-4a
SDOr14-2a
SDOsr14-4b
R/T #1
SDOsr14-5a
MOC
SDODDSr-1a
SDOr14-2b
SDOsr14-5a
R/T #2
firewall-a
SDODDSr-2a
Support segment
SDOsr14-3a
DMZ
SDOsr-6a
SDOsr14-3b
SDOsr-6b
firewall-b
FlatSat
Open IOnet
SDOJSOCr-2b
SDOJSOCr-2a
SDOEVEr-2a
SDOJSOCr-1b
SDOJSOCr-1a
SDOEVEr-1a
SDOEVEr-1b
Legend
HMI
AIA
JSOC Stanford
SOC SDP
EVE
HMI
AIA
EVE
JSOC Lockheed
SOC T&C
SDO Network Devices
HMI Critical Design Review – November 16-17, 2004
OC3
fiber Ethernet
Ethernet
T3
T1 / FT1
Draft v13e last updated 10/18/04
HMI00845 - Page 5
Stanford/Lockheed Connections
Stanford
DDS
World
JSOC Disk array
Front End
Firewall
Sci W/S
Pipeline
Router
Router
Firewall
Firewall
NASA
AMES
LMSAL
1 Gb
Private line
MOC
CMD
Router
Display
Pipeline
Router
Router
JSOC Disk array
Firewall
HMI Critical Design Review – November 16-17, 2004
LMSAL W/S
“White”
Net
Firewall
HMI00845 - Page 6
JSOC Data Capture Front End
Duplicate Front
End
Back End
Data Base Server
Analysis Cluster
Front End Server
[etc.]
OC3 AIA
IDC
DDS
Dedicated
LAN
OC3 HMI
Analysis Server
Tape Robot
LAN
Disk array
Relational Database
40TB (30days)
Tape Robot
HMI Critical Design Review – November 16-17, 2004
jim\My Documents\datacapture_frontend
HMI00845 - Page 7
JSOC Data Capture Front End
•
Two OC3 lines from DDS for AIA and HMI science data
•
Lines can be switched to either of two redundant Data Capture Front Ends
•
Tape robot will create a copy of input tlm files for offsite storage
•
Telemetry data is passed to the back end server where it is again archived to
tape and cataloged in a database
•
Telemetry data is not marked delete pending until an ack is received from both
the offsite location and the backend archiving
•
Disk array can retain 30 days of data online
•
Relational data base tracks tlm file datasets and tape locations
•
Separate dedicated LAN for front end machines
•
A backend pipeline creates lev0 and higher data products
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 8
EGSE Configuration Screen
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 9
EGSE Run Screens
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 10
EGSE Run Screens
•
The egse run screen shows the files as they are received from the SSIM
(/egse/ssim2soc)
•
These file are moved into the SOC for processing (/egse/soc2soc)
•
The telemetry files are cataloged and decoded and the level 0 images are made
and cataloged
•
A third screen displays the status as images are complete or abnormal
conditions occur
•
The “Display log” button will put up a separate window showing all the logging
activity of the program
•
The “Readme” button is an extensive man page and background charts
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 11
EGSE Raw and Lev0 Datasets
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 12
EGSE Raw and Lev0 Datasets
•
Two types of datasets are created in the EGSE. One is level:raw the other is
level:lev0
•
The series name is “egse_[hostname]”
•
The level:raw consists of the .tlm and .qac file that is sent by the SSIM every
minute. Its series number is a unique index number of seconds since 2000
•
The level:lev0 is a fitz file for a filtergram and an empty file giving the dataset
name. The series number is the unique filtergram serial number (fsn) associated
with evey filtergram
hmi0:/PDS1/D46470> ls -l
total 136
-rw-r--r--
1 production SOI
135168 Nov 1 12:16 000035.fitz
-rw-rw-r-- 1 production SOI
0 Nov 1 12:16
prog:hmi_ground,level:lev0[42],series:egse_hmi0[35]
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 13
Decode Image
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 14
EGSE Archiver
csh> egsearc
Usage: egsearc [ -v] [-d] [-q] [-a archive_dir] database_name
-v = verbose mode
-d = run in debug mode
-q = query only to see what's available for archive
-a = give the dir to cp the archived ds to
the default archive_dir is /hmi0/archive
Use /dev/null to not archive but make del pend
Use /dev/mt to write to tape
csh>
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 15
EGSE S/W Components
egse (perl/tk gui)
hmi_lev0 (c process)
hmicomp
soi
keyword
lib
lib
lib
pvm (process control,
IPC)
dsds_svc
Oracle RDBMS
datasets
HMI Critical Design Review – November 16-17, 2004
storage
keywords
HMI00845 - Page 16
JSOC Service Structure
HMI Critical Design Review – November 16-17, 2004
HMI00845 - Page 17
Test Schedule
Milestones
Ground System Integration and Testing Tasks and Start Dates
Delivery of First EGSE SDP
Testing with DDS Prototype
Delivery of Flight EGSE SDP
SOC Integration with MOC
Prototype Data Capture System Ready
GSRT#1- Telemetry and Command Test
AIA SOC White Sands Complex(WSC)
Production Data Capture System Ready
SOC Network Ready
DDS-SOC Testing
GSRT#2- Science Data Processing Test (Ka-band)
HMI Connectivity, Dataflow, Retransmissions Test
AIA Connectivity, Dataflow, Retransmissions Test
GSRT#3-Mission Operations& RF Communications Test
GSRT#4-Fully Integrate Ground System
Ground System Freeze
GSRT#4-Launch Readiness Test
Launch Site End-to-End Test
HMI Critical Design Review – November 16-17, 2004
10/04/04
02/07/05
06/06/05
03/27/06
06/05/06
06/19/06
07/25/06
09/04/06
12/01/06
12/04/06
01/31/07
02/07/07
02/14/07
02/26/07
02/26/07
01/18/08
02/01/08
03/14/08
HMI00845 - Page 18