STScI TIPS, 15 January 2004 MultiDrizzle Overview - Anton Koekemoer MultiDrizzle Status and Development Overview Anton Koekemoer, ACS+WFPC2 Branch Project Overview – Forum: Dither Working.
Download
Report
Transcript STScI TIPS, 15 January 2004 MultiDrizzle Overview - Anton Koekemoer MultiDrizzle Status and Development Overview Anton Koekemoer, ACS+WFPC2 Branch Project Overview – Forum: Dither Working.
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
MultiDrizzle Status and Development Overview
Anton Koekemoer, ACS+WFPC2 Branch
Project Overview
– Forum: Dither Working Group
– Software Development Mechanism
– Development Timeline to Date
MultiDrizzle Requirements
– General
– Instrument-Specific Considerations
MultiDrizzle Testing
– General Overview
– Instrument-Specific Considerations
Priorities and Timescales
– Development and Testing
– Documentation
– Community Feedback
Roadmap for Future Development
1
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
MultiDrizzle Project Overview
Forum - Dither Working Group (established January 2002):
– Purpose:
Coordinate development & implementation of fully integrated software
to automatically register, CR clean and combine dithered HST images
(software intended as successor to CL-based STSDAS “dither” pkg)
– Process:
Provide forum for dialog between INS, SSB, and dither software users
Define requirements and set priorities for development and testing
Determine roadmap for implementation, distribution, documentation
– Membership:
Representatives from INS, SSB, + others attending as needed
Development Mechanism:
– MultiDrizzle requirements initially developed through discussions
within Dither Working Group and interations with users
– MultiDrizzle prototype (Koekemoer, Fruchter, Hook et al.) developed
to demonstrate desired functionality; beta release under STSDAS
– SSB redesigns the code, reproducing the functionality of prototype
– Continual testing by SSB and INS, and dialog with external users
2
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
MultiDrizzle Project Organization
3
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
MultiDrizzle Development to Date
Jan - May 2002:
– Definition of MultiDrizzle requirements in Dither Working Group
– Initial prototype MultiDrizzle (Koekemoer, Fruchter, Hook et al.)
Jun - Sep 2002:
– Distribute prototype to variety of GOs: GOODS, GEMS, High-Z SNe,
GRBs, APPLES, Helix Nebula; external GOs at GSFC, CfA, Caltech,...
Oct - Dec 2002:
– Announce general availability to GOs on beta-test basis (Cal Wkshp)
– Initial suite of ACS, WFPC2 test datasets
Jan - Jun 2003:
– Hand over prototype to SSB for inclusion in STSDAS (Hack et al.)
– More user feedback, improve robustness, refine testing
Jul 2003 to present:
– SSB redesign of MultiDrizzle code (Hack, Hanley et al.) using
prototype MultiDrizzle as a basis for defining functionality
– Develop formal regression test suites
4
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
MultiDrizzle Requirements - General
Fundamental Requirements:
–
–
–
–
–
–
Combine arbitrary collections of images (including single-group)
Automatically calculate required output image size
Determine shifts from headers
[Optionally refine shifts or allow input delta-shifts]
Carry out sky subtraction on input images
Automatically perform CR rejection:
Drizzle input exposures onto separate, registered output images
Create a clean “median” image
Blot the clean image back to frame of each individual exposure
Run deriv, driz_cr to create cosmic ray masks
Use CR masks in final drizzle combination
– Allow external bad-pixel masks to be imported
– Allow individual steps to be selected when running
Overall philosophy:
– Allow user freedom in specifying behavior via parameters
– Defaults must enable good results from “one-touch” operation
5
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
Requirements – Instrument-Specific
ACS
–
–
–
–
WFPC2
–
–
–
–
Accurately handle WFC, HRC, SBC imaging data
Single-group images (eg only [sci,1])
Sub-array data
Include new geometric distortion-residual images (Anderson)
Handle 4-group WFPC2 GEIS as well as FITS format files
Single-group images (eg WF3 only)
Sub-array data
Include updated geometric distortion (Platais et al)
NICMOS
– NIC1, NIC2 or NIC3 imaging
– Ability to handle multi-accum datasets
STIS
– CCD as well as FUV, NUV-MAMA datasets
– Imaging (initially) as well as 2d spectroscopy data (later)
6
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
MultiDrizzle Testing- General Overview
Basic Functionality:
– Do new versions run successfully for small subset of test datasets?
Extended functionality:
– Do new versions work for the full range of datasets?
Functionality tests can be automated by regression:
– Run automatically on a periodic basis
– Comparison performed automatically with reference test images,
and results reported in summary form
Scientific integrity:
– Do functional versions deliver scientifically valid results?
– Different target types:
Sparse extra-galactic fields, crowded stellar fields
Large extended objects or diffuse emission across entire field
Scientific tests require additional analysis, eg:
– PSF measurements of stars to ensure shifts, etc are correct
– x,y position comparisons to verify correct astrometry
7
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
Testing – ACS + WFPC2
ACS WFC, HRC, + WFPC2:
– Basic datasets:
2-point line dither
4-point box dither (single-visit)
– More advanced datasets:
Single-visit, small offsets, higher number of dithers
Single-visit, large offsets (comparable to chip size)
Multi-visit, small + large offsets
– Number of images:
Small datasets (2-3 exposures total)
Medium datasets (4-6 exposures total)
Large datasets
ACS testing lead: Shireen Gonzaga
WFPC2 testing lead: Vera Platais
8
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
Testing (cont’d) - NICMOS, STIS
NICMOS:
Imaging - NIC1, NIC2, NIC3:
– Multi-accum datasets
– Different dither patterns (spiral)
– Large-scale + small-scale dithers to account for chip defects
NICMOS testing lead: Megan Sosey
STIS CCD + MAMAs:
Imaging:
– Mostly large-scale dithering
Spectroscopy:
– Dithering along slit
– Dithering along spectral direction
– CTE: CRs, bad pixels are a major issue (since low background)
STIS testing lead: Linda Dressel
9
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
Priorities and Timescales
Development and Testing:
Near-term (+ 1 month):
– INS: Identify test datasets and create baseline results
– SSB: Include tests in regression mechanisms
– SSB: upgrade current beta-release MultiDrizzle to fully supported
Long-term:
– Maintain database of reference results
– Update test database when warranted by code changes
– SSB release redesigned MultiDrizzle: for users and HST pipeline
Documentation:
– Release TIR describing development plans for MultiDrizzle
– Release updated Dither Handbook V3.0 to user community, with full
description of the use of MultiDrizzle
Community Feedback:
– Continue to collect suggestions and feedback from users
– Incorporate into regular prioritization planning
10
STScI TIPS, 15 January 2004
MultiDrizzle Overview - Anton Koekemoer
Proposed Roadmap for Future Development
Mar 2004:
– SSB to upgrade original “prototype” MultiDrizzle to a fully supported
version (eg via patch release, and/or from STSDAS website)
– INS to release updated Dither Handbook V3.0 with full description
of the use of MultiDrizzle software
Jan - Jun 2004:
– INS provide test datasets to SSB (near-term), update as necessary
– SSB to complete the redesigned MultiDrizzle as user software
– SSB to release redesigned MultiDrizzle in Summer 2004 STSDAS
Jul - Sep 2004:
– SSB, INS work on more robust, streamlined MultiDrizzle for fully
automated use in HST Pipeline Operations
– Continue to incorporate feedback and usage patterns from GOs
Oct 2004 onwards:
– Continuing algorithmic development to improve software, eg:
tweakshift (automated catalog-based shift refinement)
more robust CR rejection techniques for few-exposure datasets
11