Transcript level-0_flow_details.ppt

DDS
Level-0
HSB image
Immediate or
Retransmitted,
permanent
JSOC
IOPS
Mech Tables
DDS
Level-0 HK
HSB HK
e.g. ISP
HK via
MOC
Immediate
JSOC-OPS
quicklook,
Temp, 5d
Level-0.1
HK 1553
Other APID
Level-0
Process ISP and
Lookup info from
upload tables
Select nearest
or average
JSOC
IOPS
Command logs
if needed
MOC
FDS predict data
dayfiles
MOC
FDS final data
dayfiles
FDS series,
temp
MOC
HK 1553 APID
dayfiles
Level-0 HK,
temp
MOC
SDO HK dayfiles
From MOC
Level 1.0q
Flat fielded and
bad pixel list included,
Temp 1d
Level-0.3
FDS series,
temp
SDO HK lev0 temp
Few minutes lag
Level 1.5q
Quicklook Observables,
Temp, 5d
Level 1.5p
Most complete observables,
Links to best avail
Level 1.5
Final Observables,
permanent
Level-0.5
Day lag
Level 1.0
Flat fielded and
bad pixel list included,
Temp 60d
hmi_lev0_1
lev0.1_newest = hmi.lev0_1[:#$].fsn
last_done = hmi.lev0[lev0.1_newest].recnum
last_avail = hmi.lev0[max recnum].recnum
for (rec=last_done+1, rec<=last_avail, rec++)
new_fsn = hmi.lev0[:#rec].fsn
waitfor hmi.lev0_ISP[new_fsn]
hmi_make_lev0.1 new_fsn
sleep 60 then repeat
Sample PUI commands
hmi.lev0[fsn]
Key: fsn
Seg: permanent, 30d
hmi.lev0_ISP[fsn]*
Key: fsn
Seg: none
hmi_make_lev0.1
Arg: fsn
Copy keys, add
ISP keys, lookup
mech values, link
to image segment
mech tables
* hmi.lev0_ISP is the current version from e.g. hmi.lev0_0445_<version> or
from e.g. hmi.lev0_<other isp apid>_<version>
hmi.lev0_1[fsn]
Key: fsn
Seg: link to hmi.lev0[fsn]
hmi_lev0_3
lev0.3_newest = hmi.lev0_3[:#$].fsn
last_done = hmi.lev0_1[lev0.3_newest].recnum
last_avail = hmi.lev0_1[max recnum].recnum
for (rec=last_done+1, rec<=last_avail, rec++)
new_fsn = hmi.lev0_1[:#rec].fsn
new_time = hmi.lev0_1[:#rec].t_obs
hmi_gather_0.3HK new_fsn new_time
hmi_gather_0.3FDS new_fsn new_time
hmi_make_lev0.3 new_fsn
sleep 5 then repeat # throttled by lev0.1
Hmi.lev0_1[fsn]
Key: fsn
Seg: link to hmi.lev0[fsn]
hmi.lev0_HK_XXX[pktime]
Key: packet_time
Seg: none
Transient Series maybe
hmi_gather_0.3HK
Arg: fsn, time
Extract time averages
Or samples of a list
Of telem points, store
By FSN
hmi.lev0_HK_XXX[fsn]*
Key: fsn
Seg: none
Transient Series
hmi_make_lev0.3
Arg: fsn
Copy keys, add
HK keys, add FDS
keys, link to image
segment
* hmi.lev0_HK_XXX[pktime] is created from the 1553 real time
stream (LMSAL) for a given APID. Data is collected from this series,
indexed by time, to make a transient record indexed by FSN
containing sampled or running mean values of various telemetry
points, e.g. CCD temp, oven temp, etc.
FDS data
hmi_gather_0.3FDS
FDS data processing similar to HK_XXX data
FDS temp
Hmi.lev0_3
Key: fsn
Seg: link to hmi.lev0[fsn]
Issues / questions
• Do not know how to make temp records where they are logically part
of a continuing series but only need to survive a few minutes or days.
If the series is just kept and expands then we have a number of
growing series, some of which can be large, which contain records not
expected to be ever used after the first access. “delete records” would
be nice here. {this is what happens with non-archived records with
small retention times!}
• Do not know blocking of lev0.1 or higher in terms of slots per SU.
Would seem reasonable to make c. 1-minute chunks since that would
not increase the latency much. But we should leave as 1 so each
image is stand alone as it arrives.
• Do not know how to get the temporary series from real time 1553 HK
data.
• In e.g. lev0.3 should the ancillary processing be caused by the need
or run asynchronously and waited for by PUI as the sample for ISP in
lev01. If waited for, how to deal with timeouts.