Transcript Slide 1

Operator Performance
Appraisal
Byron Tilly
RS Unit Manager, SEPA
Purpose & Scope of OPA
 SEPA is required to direct resources to
where they are most needed
 SEPA has adopted a risk-based
assessment methodology to determine
inspection frequencies
 System used for RSA premises is the
Operator Performance Assessment - OPA
 OPA assesses and scores the performance
of operators in managing the hazards to
the environment from licensed activities
Purpose & Scope of OPA
Methodology for undertaking OPAs is
intended to:
 Be objective whilst recognising need for
professional judgement of officers
 Provide a numerical indicator to enable
SEPA to prioritise its inspections and
focus its resources
 Note – The OPA is not intended to be used
as a substitute for production of
inspection reports or taking appropriate
enforcement action
Purpose & Scope of OPA
Objective of the OPA scoring scheme:
 To identify sites which are poor performers
 To allow regulatory effort to be targeted
appropriately
 The RSA OPA scheme is an internal guide
for SEPA to focus its inspections and
target resources
Attributes to be assessed
1. Radioactive Substance Security

Physical security of the radioactive
substances with regard to inadvertent
loss or theft from the premises

Physical means by which the operator is
able to restrict access to radioactive
substances by authorised persons only
Attributes to be assessed
2. Knowledge & Implementation of Licence
Requirements

Operators fundamental understanding of
the certificates, the regulations and
relevant duties to apply BPM

Effectiveness of implementing the
certificates’ and regulatory requirements
Attributes to be assessed
3. Recording and Use of Information

Operator would be expected to keep
accurate records of the types, volumes
and activities of all wastes accumulated
and disposed of from the premises

Records should be kept upto date and
utilised to demonstrate compliance
Attributes to be assessed
4. Facility Management




Physical state of the facility and the
management of maintenance activities
Reactive approach to maintenance?
Proactive work undertaken to predict and
prevent future breakdowns or remediate
deteriorating facilities?
The operator should have a rationalised
and documented approach to determining
maintenance strategy
Attributes to be assessed
5. Radioactive Substance Management



Effectiveness of the radioactive
substance management system, including
written procedures
Effectiveness and extent of
implementation of operating procedures
Control of RS operations
Attributes to be assessed
6. Incidents, Complaints & Non-Compliance
Events




Overall compliance with licence
requirements
Incidents & complaints
Non-compliances
SEPA’s improvement requirements and
the operator’s response to such
requirements
Scoring of Attributes
Each of the 6 attributes is given a score
out of 5
Scoring System
 1 - Very few or no features within an
attribute complied with
 2 – Minority of features complied with or a
significant failure observed
 3 – Majority of the features complied with
and no significant failures observed
 4 – Nearly all features complied with and
no significant failures observed
 5 – All features complied with and no
significant failures observed
Satisfactory/Unsatisfactory
Criteria
A score of 3 is considered to be satisfactory and
indicates that the operator is compliant with all
relevant licence conditions relating to that
attribute



If the operator scores one level 2 on any attribute,
the OPA shall be considered satisfactory provided
all other attributes are scored at level 3 or above
If two or more attributes are scored at level 2 or
below, then the assessment is considered
unsatisfactory
A score of 1 against any attribute means the
overall assessment is unsatisfactory
Pass/Fail Mark
Once the total score has been calculated,
it is necessary to determine if the
operator has passed (satisfactory
performance) or failed (unsatisfactory
performance) the assessment
A score of 17 or above indicates a pass
mark, with the following caveats:
 A score of 1 on any attribute
 Two or more attributes which have
scored 2