Transcript Optimization of RAO and GW Monitoring

The Navy’s Munitions
Response Program – The
MEC UFP-QAPP
Bryan Harre
NAVFAC Engineering Service Center
Uniform Federal Policy for Quality
Assurance Project Plans
 Developed by EPA, DoD, and DOE
 Required for use by DoD for
environmental data collection,
including those from an MR
project
 Contains and describes in detail
specific data requirements or
other information that must be
collected to demonstrate
conformance to requirements
• 37 required elements into 37
worksheets
• Emphasis on systematic planning
2
Acquisitions Policy for Environmental
Sampling or Testing Services
 DoD policy and guidelines for procurement of
environmental sampling or testing services
procured by or on behalf of, the DoD
 Contractor quality systems documents collectively
shall specify the quality assurance responsibilities
of the contractor. Quality systems documentation to
be provided by the contractor will include one or
more of the following:
• Documentation of the organization’s Quality System
(usually called a Quality Management Plan), in
accordance with the Uniform Federal Policy for
Implementing Environmental Quality Systems (UFPQS).
• Documentation of project-specific quality assurance
(QA) and quality control (QC) activities (usually called a
Quality Assurance Project Plan or QAPP) in accordance
with the UFP-QAPP.
• Documentation of the laboratory quality system in
accordance with the DoD Quality Systems Manual for
Environmental Laboratories (DoD QSM).
3
QAPP/SAP
Why is the Quality Assurance Project Plan
QAPP/ Sampling and Analysis Plan (SAP) so
important?
The ultimate success of project depends on the
quality of the environmental data collected. This
quality depends significantly on the adequacy of
the SAP and on its effective implementation.
4
NAVFAC’s Munitions Response
Web Portal
MR Portal at http://www.ert2.org/t2mrportal
MR Portal has an
example MEC UFPQAPP and the MEC
UFP-QAPP Template
5
Adak MEC UFP-QAPP (1)
UFP-QAPP
Worksheet #
Required Information
Included or
Excluded
A. Project Management
Documentation
1
Title and Approval Page
2
SAP Identifying Information
3
Distribution List
4
Project Personnel Sign-Off Sheet
Project Organization
5
Project Organizational Chart
6
Communication Pathways
Personnel Responsibilities and Qualifications
7
Table
8
Special Personnel Training Requirements Table
Project Planning/Problem Definition
9
Project Scoping Session Participants Sheet
10
Problem Definition
Project Quality Objectives/Systematic Planning
11
Process Statements
12
Measurement Performance Criteria Table
13
Secondary Data Criteria and Limitations Table
14
Summary of Project Definable Features of Work
15
Reference Limits and Evaluation Table
16
Project Schedule/Timeline Table
B. Measurement Data Acquisition
Sampling Tasks
17
Sampling Design and Rationale
Sampling Locations and Methods/SOP
18
Requirements Table
19
Analytical Methods/SOP Requirements Table
20
Field Quality Control Sample Summary Table
21
Project SOP References Table
6
Included
Included
Included
Included
Included
Included
Included
Included
Included
Included
Included
Included
Included
Included
Excluded
Included
Included
Included
Excluded
Excluded
Included
Available on the
MR Portal,
along with a
UFP-QAPP
template at
www.ert2.org/
t2mrportal
Adak MEC UFP-QAPP (2)
UFP-QAPP
Worksheet #
Required Information
Field Equipment Calibration, Maintenance,
Testing, and Inspection Table
Analytical Tasks
23
Analytical SOP References Table
24
Analytical Instrument Calibration Table
Analytical Instrument and Equipment
25
Maintenance, Testing, and Inspection Table
Sample Collection
26
Sample Handling System
27
Sample Custody Requirements
Quality Control Samples
Laboratory QC Samples Table
28
Screening/Confirmatory Analysis Decision Tree
Data Management Tasks
29
Project Documents and Records Table
Analytical Services Table
30
Analytical and Data Management SOPs
C. Assessment Oversight
31
Planned Project Assessments Table
32
Change Control Management
33
QC Management Reports Table
D. Data Review
Verification (Step I) Process Table – Preparatory
34
and Initial Inspections
35
Tier 2 QC Process Summary Table
36
Product QC Tier 3 Summary Table
37
Usability Assessment – AOC Certification
22
7
Included or
Excluded
Included
Excluded
Excluded
Excluded
Excluded
Excluded
Excluded
Included
Excluded
Included
Included
Included
Included
Included
Included
Included
Adak MEC UFP-QAPP (3)
Worksheet #22 – Field Equipment Calibration, Maintenance, Testing, and Inspection Table
Field
Equipment
White’s XLT
Vallon (all
metal detector)
DGPS
Activity
Acceptance Criteria
Battery Strength
Test
3 times/day
Audio response over
ferrous object
Standardization
Check
At start of
operations
Audio response over GPO
standardization item
Battery Strength
Test
3 times/day
Audio response over
ferrous object
Standardization
Check
At start of
operations
Audio response over GPO
standardization item
Positional Accuracy
Daily
±25 cm at known
monument
Battery Strength
Test
Static Check
EM61 MK2
Standardization
Check
Visual Data
Reviews
Data Download
Check
8
Frequency
At beginning
and end of each Battery strength no less
grid; after
than 12V at start and no
equipment
less than 10.8 V at finish
restart
Stable instrument drift ±1.5
At beginning
mV over 3-minute interval
and end of each
(after minimum 10-minute
survey day
warm-up)
After equipment
±20% of established value
re-start (min. 3
times/day)
Number of readings
End of each
consistent with walking
grid
pace and sampling rate
2 times/day
100% of files downloaded
Corrective Action
Replace batteries; re-work if
necessary
Assess/correct instrument
set-up (cables, settings);
perform instrument
maintenance; replace unit;
re-work if necessary
Replace batteries; re-work if
necessary
Assess/correct instrument
set-up (cables, settings);
perform instrument
maintenance; replace unit; rework if necessary
Perform instrument
maintenance and, if
discovered after operations,
identify affected points to resurvey at a later date
Responsible
Person
SOP
Reference
Operator
SOP-01
Operator
Operator
SOP-05
Operator
Operator
If post survey is less than
10.8V then replace batteries;
re-work grid
Operator
Perform instrument
maintenance; replace unit if
necessary
Operator
Repair or replace unit;
examine data taken since
last test re-work if necessary
Operator
Perform instrument
maintenance; re-survey grid
Operator
Re-survey grids with lost
data
Operator
SOP-01
SOP-02
SOP-02
MEC UFP-QAPP Template (1)
SAP Worksheet #12 -- Measurement Performance Criteria Table
(UFP-QAPP Manual Section 2.6.2)
Complete this worksheet for each matrix, analytical group, and concentration level.
Identify the data quality indicators (DQIs), measurement performance criteria (MPC),
and QC sample and/or activity used to assess the measurement performance for both
the sampling and analytical measurement systems. Use additional worksheets if
necessary. If MPC for a specific DQI vary within an analytical parameter, i.e., if MPC are
analyte-specific, then provide analyte-specific MPC on additional worksheets. Separate
worksheets should be provided for each matrix (e.g. WS#12.1 Soils, WS#12.2
Sediments, etc.)
RPM Notes: Worksheet #12 was developed for analytical quality control
associated with chemical sampling in various environmental matrices (e.g. air,
groundwater, surface water, surface and subsurface soils). For MEC explosive
hazard projects, sampling is usually limited to a single matrix, surface and
subsurface soils. While the fields developed for WS #12 are not directly applicable
to an MEC Explosive Hazard Project, these projects have their own measurement
performance criteria requirements that must be addressed. For this reason, WS
#12 may be adapted to reflect these unique criteria. Fields that may be considered
are:

9
Analytical or Sampling Procedure changed to Definable Feature of
Work: The specific procedure that is the subject of the QC and QA
effort. An example would be the Anomaly Selection Criteria and
Anomaly Prioritization SOP or process for interpretation of raw
geophysical data to identify anomalies for investigation (generation of a
pick list). For the purposes of an MEC EHP, a geophysical anomaly is
defined as a geophysical measurement that is distinguishable from
nearby background geophysical measurements. Digital geophysical
mapping of anomalies offers the potential for measurements of peak
milli-volt response, spatial extent (area) of above background
measurements, estimated target depth, signal to noise ratios (SNR), as
well as other characteristics.
MEC UFP-QAPP Template (2)
Definable Feature of
Work
Data Type
Geophysical Data
Processing/
Interpretation
Geophysical
Anomaly
Measurement
Data Quality
Indicator
Anomaly Resolution
Data
10
Frequency
Maximum detection
depth assessed
during GPO and
daily instrument
checks
Sensor to identify buried munitions
(or acceptable surrogates) at or
shallower than the 11X detection
line, up to a maximum of 4” bgs.
This metric may be met (for
example) by ensuring that the
instrument can reliably detect an
81mm mortar at a depth of 891mm
(approximately 3’) bgs
At the start of
operations
and daily
Accuracy/
Precision
Last lane of grid is
recollected from
opposite direction
and compared
(repeat line test and
sensor position)
Accuracy – positional difference
≤1.25 ft
Precision – Relative percent
difference in anomaly signal
strength is less than ± 20 percent
At the end of
each grid
Completeness
QC audit of anomaly
identification data;
QC of post
excavation to ensure
removal of targets to
specified depth
Every target anomaly ≤ to 4’ bgs has
been resolved (anomalies > 4’ will
not be resolved)
Daily and
weekly
Processed Positional
and Geophysical Data
Intrusive Operations
Measurement Performance Criteria
Sensitivity
Prioritized Anomaly
Detection List
Geophysical Data
Processing/
Interpretation
QC Sample and/or
Activity to Assess
Measurement
Performance
Project Scoping and
Documentation
What about project scoping?
• The best way to ensure that a project meets its
goals is to have project planning meetings with
all the stakeholders (e.g., data users, data
producers, decision-makers)
• Scoping ensures that all needs are defined
adequately
• The penalty for ineffective planning often is
greater conflict and extensive reworking, which
results in increased cost and lost time
11
Systematic Planning Process and
Project Quality Objectives (PQO’s)
Systematic
planning
requirements
come from the
project team in
the form of
DQO’s/PQO’s
Every project
phase identifies
them, e.g., PA
and SI PQO’s
were developed
for your site
12
PQOs & data
collection
State the problem
Step 1
Identify the goal of study
Step 2
Step 3
Step 4
Identify information inputs
Define study boundaries
Step 5
Step 6
Step 7
Collect data
Develop analytic approach
Specify performance or acceptance criteria
Develop plan for obtaining data
Scoping Session Worksheets (1)
PROJECT TEAM
SCOPING/BUILDING DQO's
Worksheet #
Title
10
Problem Definition
11
13
9
PQO's/Systematic Planning Process
Project Scoping Session/Participant
Sheets
14
Summary of Tasks and Definable
Features of Work
17
Sampling Design Rationale (Partial)
2
QAPP Identifying Information
Scoping Session Worksheets (2)
PROJECT TEAM SCOPING/BUILDING DQO's
Worksheet #
5
8
Title
Project Organizational Chart (Partial)
Personnel Responsibilities and
Qualifications Table (Partial)
Special Personnel Training
Requirements (Partial)
37
34
Data Usability Assessment
SAP Verification (Partial)
35
SAP Validation (Partial)
15
Project Action Limits and Evaluation
7
14
Benefits of the UFP-QAPP Format (1)
 Provides a clear, systematic, planning process
with detailed instructions
 Follows a logical process promoting a
consistent format that meets established
requirements
 Focused on obtaining the type and quantity of
data needed to support decisions
 Establishes clear and explicit project quality
objectives
 Provides a documented starting point for
procedures/SOPs
15
Benefits of the UFP-QAPP Format (2)
• Defines expected QC (contractor) and QA
(third party) roles and responsibilities
 Provides criteria for quality assessment and
contractor oversight
 Documents the planning process and
agreement of stakeholders
• Increases stakeholder buy-in on QC and QA
efforts
16
17