95-0120 Cometence Assurance For HSE Critical Activities
95-0120 Cometence Assurance For HSE Critical Activities
EP 95-0120
HSE
MANUAL
EP HSE Manual Amendment Record Sheet
CONTENTS
Acknowledgement iii
Appendices
I Requirements for Contractor Competence
Assurance 17
II Categorisation of HSE Roles 19
III Definitions 21
IV 'Not Yet Competent' Procedure 25
V Example Checklist for Approval of
Competence Standards 29
VI Assessment Processes 31
VII Audit of Competence Assurance 35
VIII Sample Competence Assessment Form 39
Glossary 41
References 43
ACKNOWLEDGEMENT
This document is prepared as a guideline for EP Opcos to assist them in the development of a
competence assurance system for HSE-critical activities. Competence assurance is an essential
element of any management system. As HSE management systems are developed it is implicit that the
associated suite of competences must be resident in the workforce and that line management must
assure that the competences are relevant and verified.
Much of this document has been assimilated from work done by and with the approval of Shell
EXPRO.
Skill development
in the workplace.
Do Practice & coaching,
Competence
local training courses
Assurance of
HSE-critical
Group Training Guide Activities
1995
Exploration and Production EP 95-0120
One of Shell's objectives is to have a competence-assured workforce. It is the policy and objective of
Management to ensure that all staff performing HSE-critical roles are competent, in accordance with
the competency standards and assessment criteria for each role or activity. This needs to be
demonstrated in accordance with the agreed HSE Case for each installation.
The objective of this document is to provide guidelines that will enable Opcos to establish to the
satisfaction of their stakeholders that valid and reliable controls are in place to ensure personnel are
competent to discharge their HSE-critical responsibilities in a safe and effective manner. These
stakeholders could include shareholders, management, staff, venture partners, and regulatory
authorities.
Record results
Feedback variances in
performance to management
& to the development process
1 and Level 2 roles are reviewed and evaluated by line supervision through the existing staff appraisal
process and the outcome recorded in the annual staff appraisal report.
Appendix II describes the categorisation and provides some examples of Level 1 roles.
1.5 Approach
To achieve the guideline objective, Shell follows an approach in which:
competence requirements are analysed and prioritised
it is ensured that contractor systems are compatible with the Shell system
standards of competence are defined for all Level 1 roles
assessment methods are based on performance at work or on realistic simulation of the work to
be performed
assessment is carried out by approved assessors (eg competent line supervisors)
assessment standards are monitored to ensure consistency of application
a record is kept of the competence achieved by each person and the information is available to
the supervisor and the individual at the workplace.
The following premises are observed:
there will be consistent use of the terms as defined in Appendix III
there will be common standards used for assessment
the process will be congruent with industry/national standards where applicable
there will be a clear audit trail and improvement loop within the process.
Specific guidelines for treatment of candidates for Level 1 roles who are found to be 'not yet
competent' are given in the Not Yet Competent Procedure in Appendix IV.
Figure 1.1 indicates the key elements of Competence Assurance, their sequence and the links with the
procedures for Competence Assessment and 'Not Yet Competent.'
1.6.1 Opco
The Opco is responsible for ensuring that Competence Assurance requirements are being fulfilled, by
implementing internal audits with the support of line management and functional departments.
Setting priorities
The roles under the HSE management system have been divided into two levels as identified in 1.4.
Representatives of line management and functional departments should review the positions,
categorise them and have them endorsed at the senior management level.
Appendix II describes the process of categorisation of Level 1 and 2 roles. Based on the HSE Case
philosophy, Level 1 roles for each installation or activity are also described in the related HSE Cases.
Assessor
Assigned
Check
Data Base Check
NO
Inform Individual
Pre-requisites & Supervisor
Check Valid
Individual’s YES
Log Book
Assess Against
Element Standards
NO
Standards Inform Individual
Met & Supervisor
YES
Role
Competences
Reviewed
All NO
HSE-critical
Record in Elements
Data Base Valid
YES
Record in
Individual’s
Log Book Inform Invoke
Management ‘Not-Yet-Competent’
Procedures
Management
Deem Individual
As Competent
2.4 Controls
The competence assessment process needs to be quality assured, ie to confirm that assessment results
of different individuals, at different times and places, using different assessment methods, are
comparable. The quality check affirms the reliability of the assessment process as well as the
competence assurance procedures before, during and after assessment.
Review by management
The Competence Assurance System should be reviewed by management at intervals not exceeding
three years to:
assess the degree of compliance with the standards
identify gaps in the system
Keeping records
Actual evidence may vary widely. Written tests are easy to record and store, but performance
evidence and oral questioning require effort by assessors to describe what happened and why they
made a judgement. This need not be complicated. It could be as simple as 'I observed him/her
performing the task under normal operating conditions on (date); all performance criteria were met.'
For those assessed in HSE-critical Level 1 roles, and deemed 'Competent' after the first assessment,
the following minimum information should be copied to the individual's personal file, on a
standardised assessment sheet or a summary sheet specifying:
the staff number
date of assessment
reference to the standards applied
the type of evidence used
the name of the assessor.
This record will remain permanently on file for reference purposes. Certain additional or supporting
evidence of competence generated during assessment may, with the agreement of the relevant
function, be retained by the individual.
For those deemed Not Yet Competent after the first assessment, the summary sheet, along with
additional documents, will be required. Detailed notes which support the assessment of Not Yet
Competent, eg assessor notes, must be retained on file. These details should remain on file as long as
the individual is deemed Not Yet Competent and the Not Yet Competent Procedure is being applied.
If the individual is therefore subsequently assessed as Competent after the initial assessment of Not
Yet Competent the original supporting evidence of Not Yet Competent will be removed from his/her
file.
APPENDIX I
REQUIREMENTS FOR CONTRACTOR COMPETENCE
ASSURANCE
The following applies to contractor organisations providing staff in Level 1 and Level 2 roles as
described below.
Level 1 shall refer to roles where individuals have accountability for HSE-critical
activities. 'HSE-critical' implies that incompetent actions by an individual
could lead directly to serious injury, fatality, loss of containment or major
damage to the assets or environment.
Level 2 shall refer to the remaining roles with HSE-related accountabilities under the
Shell HSE MS.
contractors are required to have in place a scheme for assuring the competence of their staff.
Such schemes shall be capable of internal verification and third party audit. A Contractor may
elect to use Shell, Industry or other standards
in all cases, however, the nominated standards shall be compatible with Shell's standards, as
determined by the relevant function and accepted by the appropriate Line Personnel
agreement and acceptance of standards should be obtained as part of the ongoing dialogue
between Shell and Contractors in accordance with HSE Case requirements
where contract staff are responsible for assessing, the following information must be submitted
to the relevant Line department following successful completion of assessment:
(a) Unit or module of competence
(b) Reference to actual standard used
(c) Restriction (if any) of qualification
(d) Name of competent person
evidence that a competence assurance system is in place to ensure that contract staff are
competent in their job and furthermore competent to carry out the activities associated with
his/her accountabilities (described in the HSE MS), will be submitted at the prequalification
stage and evaluated by the appropriate personnel in the line or function
where, and for whatever reason, the evidence shows that a system is in place but is not of
sufficient quality or quantity to infer competence of an individual, further details may be
requested and submitted at this prequalification appraisal. If these are not produced within a
reasonable time period, or still do not meet the requirements, the tender for work may be
rejected
after a date specified by the Opco, contract organisations with competence assurance systems
not acceptable to Shell will not normally be considered for work on Shell installations or
premises.
Responsibilities
Contractor
guidelines for defining, assessing, verifying and recording role-related competence will be held
in the Contractor's Competence Assurance Manual along with the framework of competences
required for any Level 1 role and the list of Level 2 roles normally resourced by the contract
organisation
in most cases, Contractors will normally be responsible for assessing their staff against the
standards and, further be responsible for providing verifiers to ensure that uniformity of
assessment takes place where more than one assessor is involved
where Contractors are responsible for assessing staff they will be responsible for maintaining
the assessment evidence
the Contractor is responsible for advising each candidate, with appropriate notice, if and when
any reassessment is necessary
it is the responsibility of the contractor to supply experienced staff, who are competent to fulfil
each of the roles designated in their contract to the required standard
it is the responsibility of the Contractor to undertake a regular review of the competence of their
staff
Line (Shell)
The line are responsible for:
ensuring contractor management can demonstrate they have valid and reliable internal systems
in place to carry out competence assurance activities before contractor staff are appointed
ensuring that contract sponsors include in any prequalification exercises an assessment of the
contractor's competence assurance system
ensuring that contract documents reflect need for the contractor to implement such systems over
the course of the contract and to provide appropriately competent personnel
maintaining the assessment evidence and submitting the appropriate details to the Competence
Register for Contractor staff, when designated to do so
monitoring Contractor provision of suitably competent personnel.
Function
It is the responsibility of the Functions, in conjunction with the Line, to satisfy themselves that the
standards adopted by the Contractor are acceptable and approved. The Functions will retain copies of
the relevant documents for Level 1 roles.
APPENDIX II
CATEGORISATION OF HSE ROLES
The first stage of the competence assurance process is to identify key work roles to be covered. This
identification should be based on an assessment of the relative risks (safety, environmental, health or
business) that are relevant to the activities of the role being evaluated.
Level 1: HSE-critical roles (full competence assurance policy to apply).
These include key accountabilities for an HSE-critical role. The term 'HSE-critical' implies that
incompetent actions by an individual could lead directly to serious injury, occupational illness fatality,
significant loss, or major damage either to the assets or the environment. These activities are normally
associated with the Control or Recovery elements of the Hazards and Effects Management Process
(HEMP)..
Another way of identifying a Level 1 role is that the associated competence is the last barrier that
prevents the hazardous event from occurring and that if an incompetent action is undertaken there is
no other barrier to intercede.
Staff in these positions are formally and rigorously assessed against defined standards and would be
referenced in Part 2 of the HSE Cases.
Level 2: HSE-related roles (to be assessed via the Staff Appraisal Review)
Other roles which may be identified in the HSE Cases but do not appear on the list of agreed HSE-
critical roles are Level 2: HSE-related roles. They are a part of HSE-critical activities but are indirect
in their effect.
Notwithstanding the need for competence in all aspects of the business, these roles have HSE
accountabilities but these are arguably not regarded as being directly HSE-critical. These roles contain
the identification and assessment elements of the HEMP but not elements of control or recovery when
dealing with HSE hazards. In this respect they may not initially warrant the rigorous assessment
process defined for the Level 1 roles.
The following list (not all-inclusive) is an example of some Level 1 roles. Opcos would be expected
to review the roles associated with their business and identify those which are HSE-critical. The list
of safety and environmentally sensitive roles in Appendix C of the SIPC document, 'Drugs and
Alcohol Abuse Employment Guidelines' (Ref. 1) provides additional examples of roles that should be
reviewed for applicability as Level 1 HSE-critical roles. This document is available through HRAL/4
in SIPC.
Level 1 roles
Operations
Offshore Installation Manager Control Room Operator
Inspection Engineer Operations Supervisor
Process Unit Operator Production Operator
Area Accountable Technician Crane Operator
Crane Maintainer Systems Supervisor
Gas Tester Discipline/Maintenance Technician
Resident Engineers Emergency Response Team Leader
Fire Squad Leader
Well Engineering
Drilling Supervisor Well Services Supervisor
Toolpusher Driller
Services
Helicopter Landing Officer Muster and Evacuation Co-ordinator
Responsible Person Electrical
Seismic
Party Chief Boat Driver
Vessel Master Aircraft Pilot
Chainsaw Operator Aircraft Maintenance Engineer
HSE
Medic (remote location) First Aider
Construction
Company Site Representative Scaffolder
Crane operator Rigger
Transportation
General vehicle driver HGV driver
Bus driver Vehicle mechanic
APPENDIX III
DEFINITIONS
Competence
the ability in terms of skill, knowledge, and awareness to perform activities within an occupation or
function to specified standards. To be competent implies that a person possesses the essential skills,
knowledge, and awareness, and can apply them appropriately in a particular working environment.
Competence represents the threshold of performance which people must cross before being allowed to
perform the associated work unsupervised.
Standard of competence
a performance specification describing what is expected of a person performing a particular work
activity. It is expressed in elements of work together with performance criteria.
Critical role
an identified function in the company performed by one or more individuals who have the direct
responsibility for activities where incompetent actions by the individual could lead to serious injury,
occupational illness, fatality, or major damage to the business, the installation, or the environment.
A sample listing (not all-inclusive) of HSE-critical roles is shown in Appendix II.
Competence module
an aggregation of the knowledge and of the tasks which reflect what a competent person in a
particular role should be able to perform, eg Permit-to-Work competence module.
The competence modules should include guidance for assessors pertinent to the related standards.
Prerequisite
a pre-condition that must exist relative to a specific activity before a person may be assessed for
competence in regard to that activity. Prerequisites might include specific educational certificates,
training courses, and/or terms of practical experience.
Performance criteria
descriptions of the critical results or outcomes of practical work that are essential evidence of
competent performance. They answer the question 'How is it known that someone is competent in ...?'
They are precise descriptions which are used to structure assessment. In the example of Permit-to-
Work, performance criteria might include:
The associated hazard analysis takes account of human and organisational factors as well as
hardware.
Hazard data is complete, recorded on the PTW according to Opco procedures, and discussed
with the permittees.
(see Appendix VIII)
Assessment guidance
a set of procedures for those involved in assessment, setting out:
the evidence required for each unit
how and when and how often assessment takes place
who assesses the evidence
method of verification
how the assessment is recorded.
Assessment of competence
the means by which evidence of performance is collected, compared with a standard, and a judgement
about acceptable performance is made and formally recorded. The person is either competent or not
competent. There is no rank order, no grades or banding. People's abilities are compared with the
standard, not with each other.
Verification
the checks and balances in the assessment system to ensure that what should happen when people are
assessed, does happen. Its primary purpose is quality assurance, confirming that people in different
places are assessed in the same way, with a common interpretation of the standards.
Skill
the practised ability, dexterity, fluency or co-ordination in the execution of learned physical or mental
tasks.
Knowledge
the condition of possessing a specific understanding through instruction, study, or experience in
regard to particular subject matter. Knowledge enables a person to safely and effectively adapt or
adjust to varying conditions during the performance of work.
Awareness
having a general understanding or a broad perception of particular subject matter. Awareness of a
subject alone normally requires consultation with a knowledgeable person when variances in
conditions arise. Without awareness the need for consultation may not be recognised.
APPENDIX IV
'NOT YET COMPETENT' PROCEDURE
Introduction
The Company wishes to ensure the consequences of finding an individual to be 'not yet competent' are
managed in a fair and consistent manner.
First Assessment
From the First Assessment, two outcomes are possible: the individual is either assessed as Competent
or Not Yet Competent.
Competent
No further action under this procedure is required.
Second Assessment
If after a second assessment an individual is assessed as Not Yet Competent, options would include
further training and development towards a third and final assessment, or redeployment (including
agreed redeployment to a job suitable for the competence level achieved).
A further interview should be held between employee and line supervisor, and the individual advised
that as the required standard has not been met, he or she is still considered Not Yet Competent. The
employee should be further advised that if he/she is still assessed as Not Yet Competent following a
third assessment (for which a date should be specified), and no redeployment opportunities exist, the
Opco may give the employee contractual notice of termination of employment on grounds of
incapability.
After the interview, the individual should be given a formal note from the Company which includes
all of the above points, copied to the individual's personal file.
Third Assessment
If the outcome of the third assessment is that the employee is found as being Not Yet Competent and
no redeployment options have been identified alternate courses of action may be necessary.
It is recognised that there may be cases where both line management and the employee agree not to
complete any stage of this procedure, and forego the opportunities for further assessment. In
exceptional cases, where there is genuine agreement and acceptance by both parties that nothing is to
be gained by further training and assessment, reassignment to other duties or another position may be
considered. Alternatively, termination of employment may be a necessary course of action.
Appeals
If the employee wishes to appeal at any stage of this procedure he or she may do so in accordance
with the Opco Grievance Procedure.
First competence
assessment
Second competence
assessment
Third competence
assessment
APPENDIX V
EXAMPLE CHECKLIST FOR APPROVAL OF COMPETENCE
STANDARDS
Questions for: Module _____________________ YES NO
6. If you are less than satisfied with any part of this unit, please give your reasons and provide
suggestions on the changes you would like made.
APPENDIX VI
ASSESSMENT PROCESSES
Particular care should be exercised over the treatment of candidates for Level 1 roles to ensure that:
candidates who are already in Level 1 roles are provided with all relevant standards,
performance criteria and the Not Yet Competent Procedure. They should be briefed on
assessment methods and all possible outcomes within a pre-defined time before their assessment
(if practicable)
candidates who are not yet in Level 1 roles receive training and development such that
assessment of their competence becomes a validative rather than an investigative process. They
should also be provided with the information in (1) above as early as possible during their
development.
Sources of evidence
There are four basic sources of evidence which demonstrate competence:
1. Performance at work
Performance in the workplace is usually the most convincing evidence, especially if it is drawn from
direct observation.
Performance at work is normally assessed by a workplace supervisor. Self-assessment may be
appropriate as part of the process, as is peer assessment, but both need careful handling. A higher
authority should provide the final approval for the worker to perform the role independent of direct
supervision.
For jobs in a service role, customer feedback is an essential ingredient.
2. Specially set exercises
Performance evaluated on specially set exercises should cover assignments, projects, skill tests,
simulations, etc. These will be essential in some cases where it is impossible to assess at work and has
the added benefit of allowing standardisation and the use of expert assessors. Low realism can
however undermine their usefulness and 'assessment nerves' may lead to under-performance in some
individuals.
In some circumstances (eg well control training) simulators are used to provide for assessment under
realistic conditions without endangering the individuals or the assets.
Performance on specially set exercises can provide valid evidence in a controlled environment,
provided they are designed carefully and are relevant to the abilities to be assessed. They are essential
for emergency response competences. Candidates being assessed should be conversant with the nature
of the set exercises.
3. Questioning
Questioning may be by interview, written examination, or computer-based. It is quick, and extremely
useful for determining knowledge and understanding, however, knowing what should be done is not
the same as being able to do it under the pressure of real work situations.
Questioning produces valuable additional evidence of competence, provided it is used skilfully. On its
own, questioning is rarely sufficient to prove competence.
4. Historical
Historical evidence includes qualifications, reports, portfolios of previous work and references from
previous employers. It can save time and may be essential for assessment of people on transfer or
secondment from other Group companies. It has weaknesses, however. Competence may erode over
time and the competence standards, in use may not be consistent with the assets, or equipment of the
day.
Judging historical evidence needs skilled, experienced assessors, who can sort out useful data from
the irrelevant or unreliable. Regulatory authorities often demand formal qualifications but may be
suspicious of any other historical evidence.
A comprehensive assessment plan will use all four sources, however, it is hard to make a convincing
case for overall competence without evidence from performance, either at work or realistic
simulation.
The right blend of assessment methods depends on the competence to be assessed, the criticality, and
the hard facts of the situation.
It is senseless to expose people or the assets to additional risks in order to assess competence. On the
other hand, merely asking 'What would you do if...' may not provide sufficiently valid information
about the person's ability to respond quickly and correctly to multiple signals during stress conditions.
This highlights the need for the assessor to have a high level of competence in the area being assessed.
A fit-for-purpose assessment plan will set out:
the sources of evidence to be used
how evidence will be produced and collected
when assessment (and reassessment) must take place
who will assess each part of the evidence
who exactly will make the final judgement on competence
how the competence of assessors will be assured
how the assessment will be recorded.
It is also important to consider some of the common mistakes for assessors to avoid:
stereotyping people
comparing people with themselves at the same stage
assuming one performance means all others will be similar
comparing people with one another rather than the standard
going by first impressions
giving the benefit of the doubt to people who have tried hard.
APPENDIX VII
AUDIT OF COMPETENCE ASSURANCE
In order to provide quality assurance for competence assurance the processes should be audited for
consistency of approach and content. Some regulatory jurisdictions define 'audit' in a very legal sense
and 'verification' is often used to avoid conflicts of understanding.
During assessment, audit procedures may include:
using more than one assessor ('panels', etc)
use of independent, expert assessors
having two levels of assessment
exchange of evidence between assessors
someone else observing assessments on a sampling basis.
After assessment, controls may include:
sampling of evidence by an auditor
statistical monitoring of results from different assessors
audit by an independent party.
Auditors may need access to more detailed information including:
the actual standards and assessment guidance used by assessors
record of appointment of appointed assessors
records of actual evidence used in assessment.
The relevant functions appoint verifiers:
to provide advice and support to assessors
to maintain records
to monitor assessor performance
to arrange external audit.
The auditors should be able to meet with assessors and other verifiers to review assessments, explore
technical or administrative difficulties that have arisen, or provide guidance.
The questionnaire may be used initially as part of a high level overview. Used this way, it will take
very little time to form an impression of how close the Opco is to the standard.
If there are only a few areas of weakness, it can then be used as the basis of a remedial action plan.
If the overview reveals major weaknesses, a more detailed review of the Opco's arrangements on
competence may need to be undertaken.
3. Who has the responsibility and authority to responsibilities are clearly defined and
control the key parts of the competence documented
system?
those with responsibility state that they have
adequate authorities
4. What standards of competence are used when key roles are defined and documented
assessing people in key roles?
competence standards are defined,
documented
the standards used relate clearly to what
people actually do at work
5. What methods of assessment are used to assessment methods are appropriate to the
determine whether individuals are competent? competence being assessed
work performance is tested where possible
6. Are assessors adequately trained? those assessed have been briefed in the
system
assessors can describe the process of
assessment as well as the procedures
newcomers to the system are briefed
8. Who co-ordinates and monitors assessment people are identified to verify assessment
practice?
standards exist for internal verifiers and
auditors
9. Who else reviews and audits competence auditors have been identified who are
assurance other than the people directly independent of the Unit management structure
responsible?
11. Which member of the senior management there is single-point responsibility for
team is responsible for maintaining and competence at senior management team level
improving the competence assurance system?
the manager accepts the responsibility
unreservedly
12. How frequently and how regularly is the there is regular review by senior management
effectiveness of the system reviewed by senior
management? the review is at least every two years
13. What records are kept of competence and documentation is clear, simple, fit for purpose
verification?
it is accessible to those who need access
14. What detailed procedures are there in place procedures exist for standard setting,
and how are they controlled? assessment
APPENDIX VIII
SAMPLE COMPETENCE ASSESSMENT FORM
Role Person Assessed Competence Module Prerequisites
Preparations or reinstatement S
work is authorised only when .................................. ...............................
there are no conflicts, .........................................
inconsistencies or omissions.
This sample represents only one of possibly 2 or 3 pages of a complete assessment form that would
pertain to the assessment of the Lead Operator role relative to the Permit to Work. The form should be
supplemented with notes of guidance for the assessors that assist them to interpret the intent of each
of the performance elements to be assessed. Some companies choose to include these notes as part of
the assessment form; others provide notes of assessment guidance in a separate document.
GLOSSARY
A glossary of commonly used terms in HSE is given in both EP 95-0100 HSE Management Systems
and EP 95-0300 Overview Hazards and Effects Management Process.
REFERENCES
1. Drugs and Alcohol Abuse Employment Guidelines, SIPC, 1993.