Transcript Slide 1
Enterprise-Class GIS Project August 3rd, 2009 GIS STEERING COMMITTEE MEETING: Task 1 Findings and System Requirements 1. 2. 3. 4. 5. Project Status – Discovery and Needs Assessment Task 1 Findings System Requirements Conceptual Design GIS Portal 6. Break-off Sessions Enterprise-Class GIS Project OUTREACH PROCESS 1. Breakout Session at Kick-off Meetings 2. Surveys 3. Follow-up Teleconferences 4. Additional Meetings Enterprise-Class GIS Project FINDINGS – STATE ORGANIZATIONS Agency • Key Findings Data Warehouse / Integration Project – Management Systems • Data Stewardship Program • Data Marts – Replication • Supporting the Data Warehouse Effort • NJGIN • Key Generator of GIS Data • Uses NJGIN as Download Center NJ Transit • Key Generator of Ridership Data PANYNJ • Key Generator of Ridership Data and Freight Data NJDOT NJOIT DEP Enterprise-Class GIS Project FINDINGS – REGIONAL MPO’S Agency NYMTC • Key Findings Data Exchange via FTP DVRPC • Data Exchange via FTP Enterprise-Class GIS Project FINDINGS – MEMBER SUBREGIONS Agency SUBREGIONS • • Key Findings NJTPA and the subregions will begin a series of formal quarterly data exchange programs, initially via ftp drop off Subsequently, as experience with ArcGIS Server’s replication and geodata services increases, and once the NJTPA geodata model is in place, the NJTPA GIS user community will be in a better position to take advantage of a more defined data replication platform. Enterprise-Class GIS Project FINDINGS – DATA REPLICATION NJTPA Subregions Child Geodatabase Replication NJTPA Replication NJ State Agencies Child Geodatabase Parent Geodatabase Replication Concept Regional Agencies Child Geodatabase Data NJTPA ArcGIS Server Details ArcGIS Server Publish Geodata Service Replication (e.g. Quarterly) Direct Consumption SQL ArcSDE Server Geodata Replica NJTPA STAGING DB NJTPA PRODUCTION DB Enterprise-Class GIS Project FINDINGS – NJTPA Agency Overview · · Summarizes NJTPA Planning Activity (Coming 2 yrs) Includes the PDWP Unified Planning Work Program (UPWP) Federal MPO Guidelines Air Quality (Conformity) Monitoring/Forecasting Freight Assessment Investment Strategy Strategy Evaluation Planning Studies Regional Transportation Plan (RTP) Project Development and Prioritization Project Development Work Program (PDWP) Application of Criteria (Project Scoring & Ranking) Project Pool Application of Additional Priority Factors Funding Applied Transportation Improvement Program (TIP) Capital Construction Program Draft TIP · · · Needs & Strategy Ident. Project Identification Investment Policy · · · 25 Year Plan Updated Every 4 Years Establishes Investment Agenda · · · · · Project Schedule Project Planning, Scoping, and Design Local Program Solicitation Local Scoping and Safety Program For the coming year · · Prioritizes and Schedules Funding Over 4 Year Period Enterprise-Class GIS Project FINDINGS – NJTPA Planning – Process Data Inputs 1. Demographic Forecasting 2. Freight System Performance Assessment 3. Regional Safety Priorities 4. Model Integration Potential Projects - 4 Yr. Cycle Regional Capital Investment Strategy (RCIS) - Performance Evaluation - Criteria and Screening Strategy Evaluation Study / Process strategic geographic areas evaluated Every 4 Yrs. Corridor Studies Freight Planning Climate Change Planning Transp. Clean Air Measures Bike/Ped ... Subregional Study Program Regional Transportation Plan (RTP) Subregional Transportation Planning Program (STP) 5. DOT Management Systems 6. Other Authority Plans Performance & Screens Strategy Refinement (Areas) Iterative 7. Sub-regional Studies and Plans Local Sponsored Projects Project Concepts: Every 4 Yrs. Congestion Management Process Compliance Project Development and Prioritization Project Development Work Program (PDWP) Enterprise-Class GIS Project FINDINGS – NJTPA TIP – Agency Culmination Project Pool & Source Project Evaluation NJTPA Pipeline (PDWP) (Includes Local Scoping) New Projects NJDOT Mgt. System Projects Existing TIP Items (Includes Local Lead) Application of Criteria Funding Fiscal Constraint Impossed Applied by NJDOT and NJ Transit Capital Construction Program (CCP) First Draft Capital Construction Program Stakeholder Review & Negotiations NJTPA CCP Committee / Board Endorses DRAFT TIP Application of Additional Priority Factors Authorities: Port, Turnpike, Meadowlands Projects Second Draft (CCP) Legislative Review DRAFT TIP Board Adopts: Public Comment Legislated & ARRA Projects Conformity NJ Transit Projects TIP 1) DRAFT TIP 2) TIP Addendum 3) Conformity 4) Self Certification Enterprise-Class GIS Project FINDINGS – NJTPA Division Key Findings • Key Generator of Data e.g. Travel Demand Model, Capital Project Location, others • Center of NJTPA GIS Activity including NOTIS geography • Oversees Systems-level Planning Analyses linked to several state-wide data sets incl. Regional Capital Investment Strategy, Strategy Evaluation, Congestion Management Process, AQ Conformity, Regional Indicators Regional Planning • Oversees RTP, PDWP, Corridor Studies, Bike/Ped, Subregional Studies Freight Planning • Oversees Freight Studies • TransSearch Database • Oversees TIP, Project Prioritization, Local Projects • Enhancement of Data Management Practices, NOTIS Finance & Administration, Public Affairs, External Affairs • Future Document Management System • Website Information Technology • Hardware, Software, Applications,Telecommunications Systems Planning, Modeling and Data Capital Programming Enterprise-Class GIS Project FINDINGS – NJTPA # Variable Description 1 Organization – Central Staff +/- 60 persons 2 ArcGIS Licenses (Central Staff and Subregions) 8 3 MapInfo Licenses 8 4 Maximum general Geodatabase participants (Central Staff and Subregions) +/- 100 indirect users 5 Maximum direct simultaneous geodatabase users (GIS) +/- 20 direct users 6 Data Editing (features classes in ArcSDE database) 1.) TIP 2.) PDWP 3.) Strategy Areas and Refinement 3 -10 featureclasses 7 Potential business table editors +/- 20 users 8 Peak-period NJTPA web-site visits 400 / hour 9 Estimated requested map displays per hour, per person 40 10 Peak-period web map displays per hour 16,000 Enterprise-Class GIS Project FINDINGS – Server Needs File Server (s) Database Server Application / Web Server • NJTPA Data • Geospatial Data • Web Applications • Incoming Data from Partner Agencies • Business Tables • • Database Views Map and Data Services • GIS Web Portal Enterprise-Class GIS Project Division SYSTEM REQUIREMENTS Key Findings • Develop Series of SQL Server Information Service (SSIS) and Extract, Transfer, Load (ETL) packages for data upload into EGISd • Develop Data Replication Program with NJDOT/NJOIT • Develop Capital Project ArcSDE Layer • Develop routines for Regional Indictor, CMP, Air Quality Conformity, NOTIS • Develop Series of map files • Develop Regional Indicator Map Views Freight Planning • Transfer Freight Database into EGISd Capital Programming • Rewrite Existing TIP Data Management program to integrate with EGISd • Develop Select Statements for Project Prioritization and NOTIS • Develop basic Geprocessing procedures • Develop Data Exchange Portal • Deploy and Configure ESRI Software • Develop “Lightweight” GIS-based Web Application Systems Planning, Modeling and Data Regional Planning Agency-Wide Enterprise-Class GIS Project CONCEPTUAL DESIGN ` ECGD Participants Ftp (Data Exchange) Data Replication Data Replication & Map Consumption WWW Data Catalogs, Menus, and Downloads File Server(s) SQL Server GDB Spatial GIS Data Vector - .lyr (ISO 19115) Administrative and Political Boundaries - SDE Layers - SDE Views - Business Tables - Database Views Agriculture and Farming Atmospheric and Climate Data Base Maps Scanned Maps Biologic and Ecologic Information Incoming from ECGD Participants / ftp ArcGIS Server Business System Data and Capital Program Geodata Service ArcSDE Direct Connect ` NJTPA Non-GIS Map Service *.MXD Capital Program Interface ` GIS Portal ArcSDE Direct Connect SQL Server Reporting Services Data Exchange Portal Web Application NJTPA GIS Image Server Enterprise-Class GIS Project TIP DATA MANAGEMENT Business System Data and Capital Programing Input Format from DOT Critical Data Exchange & TIP Interface - From NJDOT and NJ Transit - Incoming data mapped to new table schema via SSIS / ETLs - Direct individual record updates TIP TIP TIP Reports Reports Reports - Conform to all requirements - Sub-reports (queries) Enterprise-Class GIS Project DATA ACCESS WWW ArcGIS Server GIS Portal Web Site (Adaptive Data Inventory) 1) Layer Name 2) ISO Category 3) NJTPA Category 4) Service Name 4) Any Meta Data Filed Services: - Map - geodata - metadata - Other Level 3 : GIS Portal Use Level 2 : Local Access Network (LAN) Use Metadata Document In GIS Portal (Edit via Security Clearance) Local Consumption .lyr – ISO 19115 (22 folders) lp_CensusTracts Pointers to ArcSDE Layers lpa_ParcelNewark Geospatial Data Production ve_CarbonManoxideDirection D_SYSTEM DATA & CAPITAL PROGRAM Level 1 : Database Use Direct Connect Enterprise-Class GIS Project GIS WEB PORTAL EXAMPLE Enterprise-Class GIS Project NEXT PHASE DATA DESIGN - PHSYICAL One SQL Server Instance: GDB_STAGE GDB_PROD Business System Data and Capital Program GDB_HIST Enterprise-Class GIS Project NEXT PHASE DATA DESIGN - LOGICAL Third Normal Form (Normalization)