Transcript Systems of Systems Observatory
Observatory System of Systems
MSC NVO
LSST
Mauna Kea Observatories Internet 2
Observatory Systems of Systems
OVERVIEW
Goal: Leverage astronomical community’s plan to develop a: synoptic survey telescope interactive web-based access to massive archival databases world’s premiere observation site and largest in-place telescope investment wide-band remote access to telescopes, computing centers, and databases state-of-the-art high performance computing center into a new model of a
system-of-systems observatory
generate a dramatic change in both: how observational astronomy is conducted, and what we understand of our universe.
(LSST) (NVO) (Mauna Kea) (Internet2) (MHPCC) that would Request: $5M in FY-02 to provide developmental funding to capture a ~ $200M out-year program for Hawaii-based organizations.
FY-03 and 04 needed funding would be approximately $10M each year to bring the initiative to fruition.
2
Observatory Systems of Systems
Components
Systems: LSST - Large-aperture Synoptic Survey Telescope NVO - National Virtual Observatory Mauna Kea family of Observatories Infrared Telescope Facility Canada-France-Hawaii Telescope United Kingdom Infrared Telescope Keck I & II Subaru telescope Gemini North Maui Supercomputer Center Internet 2 Observatory complex system of systems for which the telescope and instrument is only the front-end MSC NVO LSST Internet2I Mauna Kea Observatories (6.5M) (Petabytes of data) (3.0M) (3.6M) (3.8M) (10M/10M) (8.3M) (8M) (2.2 teraflops) (bandwidth) 3
Observatory Systems of Systems
Concept
Mauna Kea Field of View
IfA MSC LSST - all sky survey NVO - archival reference Internet 2 - nodal connectivity LSST Mauna Kea MSC - change detection, dynamic database Mauna Kea - rapid & detailed follow-up World-wide observatories - detailed follow-up Astronomical Community professional - off-site participation educational - teaching resource amateur - database access Astrophysical Community IfA - Observatory System of Systems administration World wide Observatories
Merge Astrophysical
and
Information Technologies
4
Observatory Systems of Systems
LSST - overview
Parameters Telescope Class Instrument Data Rate Data Storage Cost 6.5 meter class (50m 2 collecting area) , 3 deg FOV 24 magnitude sensitivity, 50,000 x 50,000 pixels 20,000 deg 2 /week, terabytes/day 1+ petabyte ~$150M, funding - NSF/NASA/other non-government Area of Investigation opens up the field of time-domain astronomy - revolutionize knowledge of astronomical source that vary or move on short time-scales (e.g. - movies versus still photos) 10,000,000,000 objects within grasp, 10,000,000 variable objects expected real-time data stream to astronomical community - professional, academic, amateur 5
Observatory Systems of Systems
LSST - knowledge generation
Asteroids / NEOs - 90% of 250-meter class within first decade, 100’s/day to be detectioned - understand the origin, relationships, and fate of small bodies in the Solar System Kuiper Belt and Trans-Neptunian Objects 10,000 orbital maps, complex dynamic structure, gross physical characterization Planet Search 100,000,000 stars investigated using occultation(gas-giants) and micro-lensing (Jupiter-size) planets Super Novas - discover ~ 100,000 year, addresses question of heavy element abundance Galactic Halo low-luminosity White Dwarfs of ~0.5 solar masses Dark Matter synthesize optics, software, high throughput data analysis to image and map non-luminous mater Active Galactic Nuclei construct complete sample of types Celestial Archive - Transients / temporal dimension- gamma ray burst (rising light curve), eclipsing binaries, lensed quasars, - Vast new discovery space of optical transients -’ unknown unknowns’ - Digital Sky Map - co-adding repeated scans to generate limiting magnitude of 26.5
- Support observations at all wavelengths via participation in National Virtual Observatory 6
Observatory Systems of Systems
NVO
National Virtual Observatory: integration of all major astronomical archives into a interoperable system of federated multi-wavelength data bases exploit potential for scientific discovery afforded by LSST and other survey programs focus for development of capabilities that do not yet exist realize full potential of petabyte datasets establish statistical correlations, discover significant patterns and temporal variations understand complex astrophysical systems, interactive numerical simulations & statistically complete multivariate bodies of data Tool Sets processing distributed storage image libraries dynamic range software data analysis visualization grid computing ~ tera scale ~ petabyte ~ 500,000,000 point sources / 1,000,000 extended sources rapid querying of large scale catalogs ~ 11 mag real time collaboration Digital Sky & GIOD technologies, XSIL, new computational tools multivariate patterns 7
Observatory Systems of Systems
Maui Supercomputing Center
Computational Characteristics of Observatory System of Systems: Tera-byte / night of data process data-stream in near real-time detect, characterize, classify objects / events retrievable achieve - data structures Applications: tuned-change detection algorithms scaling - data storage of world’s largest non-proprietary database real-time data mining / farming tool-set Access-query user-interface & analysis data-visualization aids Functions: Curator of existing data sets support multiple types of queries Interconnection to other NVO sites 8
Observatory Systems of Systems
Mauna Kea Observatories
Site Characteristics: elevation favorable climatic conditions - smooth Pacific air flow, mountain dryness equatorial proximity - northern & southern hemisphere viewing provides US astronomers with special advantage - generating leadership position significant infrastructure already in place, recent publication of site master plan (w/o LSST as tenant) Observation Capability: - world’s largest observational site, most power collection of optical/infrared and sub-millimeter telescopes ___% of nation’s observation capability 9
Observatory Systems of Systems
Internet 2
Accessibility - User Explosion: Professional: front-line astronomers, need breeds of ‘archival’ astronomers The Public / Educational user Amateur Tool Set; vBNS - very high speed backbone network service ATM - asynchronous transfer mode GigaPOP Middleware OC192 / 9.6Gbps
quality of service regional high performance aggregation points Glueworks Distributed Storage Remote Operations Virtual Laboratories Manoa as Infrastructure anchor point GLOBUS AURA / SPARC Internet of the future billions of Internet 2 users, convergence applications, embedded systems, unknown killer apps Technology availability for critical Observatory System of Systems functions by 2005 10
Observatory Systems of Systems
Systems Concept
DRIVER: ability to conduct all-sky survey with high sensitivity instrument good for IfA areas of inquiry LSST ENABLERS: NVO / MSC / Internet 2 NVO technology/approaches to capturing, warehousing, mining, and disseminating data MSC - good mission fit, looking for strategic sponsor, currently has cycles-to-burn, ability to scale-up to LSST/NVO long-term demand Internet 2 - UH as node HARVESTER: Mauna Kea Observatories (and others) ability to convert LSST/NVO alerts into new discoveries new paradigm for observational astronomy -- near real-time response to celestial anomalies, vice attempting to predict where they might be observed 11
Observatory Systems of Systems
Technical Issues
LSST: site, telescope, instrument/detector, data processing, internal system operation hardware performance, software performance MSC / NVO (SOSO sub-set): terascale pipeline processing data acquisition, calibrations/registration, QA, pipelining, archiving, data mining, data farming, retrieval computational hardware / software / exchange protocols, cross-correlation tools, metadata standards data access layer, query and computing services, data mining, data farming, data analysis / visualization Mauna Kea Observatories: LSST and Master Plan Internet II: communication architecture VBNS, GigaPOP, GLOBUS System of Systems concept of operations, systems engineering / integration 12
Observatory Systems of Systems
Funding Issues
Potential Funding conduits: NASA, NSF, DOE DoD - Naval Observatory, NRL, AFRL/DE, NRO Private Near-Term Effort (with Congressional Support): bridge funding to jump-start Observatory System of Systems architecture development development of A-spec for LSST selected technology risk reduction Mid-Term (based on historical trends): National Research Council - Astronomy & Astrophysics in the New Millennium 5th in a series of decadal reports 21 new equipment initiatives based on scientific merit, technical readiness, cost effectiveness $4.67B in scope SOSO #2 (under combined projects of LSST, NVO, WAVE) Trends increase in international projects increase in university-based consortia to build and operate midsized-to-large telescopes general increase in the size of research groups pursuing large/long-term programs NASA - 60%, NSF - 30%, Private - 10+% 13
Observatory Systems of Systems
Cost Issues
Long-term Funded program: LSST telescope Instrumentation - EO Instrumentation - IR Operations ($3M for 10 years) NVO/MSC (SOSO/LSST element) Software Hardware - Computational Hardware - Storage ($2M/year) Hardware - Visualization Hardware - Communication Operations ($2M/year for 10 years) Near-Term Effort (FY-02 through 04): LSST: technology development and A-Spec NVO/MSC Architecture $70M $16M $20M $30M $10M $5M $20M $2M $3M $20M $196 $15M $10M 14
Systems of Systems Observatory
Back-up Slides
Observatory Systems of Systems
NEO Threat
NEO -
Near Earth Object =
Asteroids and Comets extreme case of low-probability events / high-consequence effects Binzel Report (NAS Astronomy and Astrophysics Survey Committee) Population: > 1-meter, 1,000 > 100-meter, Earth Impact Rate ~: 150,000 1KM 100m ~ 1 per 100,000 years ~ 1 per 100 years >1 m ~ 100,000 kg /day 20% discovered 1% discovered ~ 10,000 MT TNT energy release ~50 MT TNT energy release Historical Record of Cataclysmic Event Cretaceous-Tertiary Extinction (65 million) Tunguska, Siberia Shoemaker-Levy 9 (1908) (1999) ~ mass extinction ~ 50m ~ 10-20MT (>100KM 2 Annual Hiroshima scale energies dissipate in atmosphere (earth shields upto 30-50M) devastation) Bottom-line = 1% chance of severe regional damage in next century 16
Observatory Systems of Systems
New Approach to Astronomy
in the past, exploratory efforts in astronomy were constrained by the need to carefully select small samples, we can now imagine exploiting the revolution in computing and networking to: - discover patterns revealed from analysis of statistically rich and unbiased image and/or catalog databases and from application of advanced visualization tools; and, - deepen our understanding of complex astrophysical systems through sophisticated numerical simulations with the use of advanced statistical methods erase old barriers of time and distance in carrying out modern astronomical observations 17