EPA Manual For Enviornmental Programs
EPA Manual For Enviornmental Programs
QUALITY MANUAL
FOR
ENVIRONMENTAL PROGRAMS
CIO 2105-P-01-0
May 5, 2000
TABLE OF CONTENTS
Page
1. QUALITY SYSTEM POLICY AND RATIONALE . . . . . . . . . . . . . . . . . . . . . . . 1-1
1.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1
1.2 Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2
1.3 Applicability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2
1.3.1 Applicability to Environmental Programs . . . . . . . . . . . . . . . . . . . . . . 1-2
1.3.2 Applicability to Other EPA Programs . . . . . . . . . . . . . . . . . . . . . . . . . 1-3
1.4 Organizational Applicability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4
1.4.1 EPA Organizations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4
1.4.2 Extramural Agreements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4
1.5 Exemptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4
i
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Page
3.2 Preparation, Submission, Review, and Approval . . . . . . . . . . . . . . . . . . . . . . . 3-2
3.2.1 QMP Preparation Responsibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
3.2.2 Internal Submission and Approval . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
3.2.3 Agency Review and Approval of the QMP . . . . . . . . . . . . . . . . . . . . . 3-2
3.2.4 QMP Revisions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
3.3 Quality Management Plan Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
3.3.1 General Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
3.3.2 Management and Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4
3.3.3 Quality System and Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5
3.3.4 Personnel Qualifications and Training . . . . . . . . . . . . . . . . . . . . . . . . . 3-5
3.3.5 Procurement of Items and Services . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6
3.3.6 Documents and Records . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6
3.3.7 Computer Hardware and Software . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7
3.3.8 Planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8
3.3.9 Implementation of Work Processes . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-9
3.3.10 Assessment and Response . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-10
3.3.11 Quality Improvement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-11
ii
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Page
iii
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
CHAPTER 1
QUALITY SYSTEM POLICY AND RATIONALE
1.1 Introduction
EPA Order 5360.1 CHG 2, Policy and Program Requirements for the Mandatory
Agency-wide Quality System, provides requirements for the conduct of quality management
practices, including quality assurance (QA) and quality control (QC) activities, for all
environmental data collection and environmental technology programs performed by or for this
Agency. The primary goal of the Agency-wide Quality System is to ensure that environmental
programs and decisions are supported by data of the type and quality needed and expected for
their intended use, and that decisions involving the design, construction, and operation of
environmental technology are supported by appropriate quality assured engineering standards and
practices. The EPA Quality Manual for Environmental Programs provides program
requirements for implementing the mandatory Quality System defined in EPA Order 5360.1 CHG
2.
All EPA organizational units conducting environmental programs shall comply with EPA
Order 5360.1 CHG 2. Work performed on behalf of EPA through appropriate extramural
agreements shall comply with the quality system requirements defined by EPA Order 5360.1 CHG
2 or applicable regulations, unilateral orders, and negotiated agreements. Environmental data are
any measurements or information that describe environmental processes or conditions, or the
performance of environmental technology. For EPA, environmental data include information
collected directly from measurements, produced from models, and compiled from other sources
such as data bases or the literature. Environmental technology includes treatment systems,
pollution control systems and devices, and waste remediation and storage methods.
In accordance with EPA Order 5360.1 CHG 2, EPA requires that environmental programs
be supported by a quality system that complies with the American National Standard
ANSI/ASQC E4-1994, Specifications and Guidelines for Quality Systems for Environmental
Data Collection and Environmental Technology Programs, incorporated herein by reference.
ANSI/ASQC E4-1994 is a national consensus standard authorized by the American National
Standards Institute (ANSI) and developed by the American Society for Quality (ASQ) that
provides a basis for planning, implementing, documenting, and assessing an effective quality
system for collecting and evaluating environmental data for decisions and for use in the design,
construction, and operation of environmental technologies. Copies of the standard may be
obtained from:
1-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
By invoking this American National Standard as the basis for its internal Quality System,
EPA recognizes that environmental programs are diverse and impact many constituencies,
including Federal, State, local, and Tribal governments and industry. EPA realizes that a uniform,
consistent set of quality management criteria are essential to assure effective environmental
programs by Government and industry alike. ANSI/ASQC E4-1994 provides a stable foundation
upon which quality systems supporting all environmental data and technology work across the
Agency may be based.
1.2 Scope
C the collection, evaluation, and use of environmental data by and for the Agency,
and
Environmental data are critical inputs to decisions involving the protection of the public
and the environment from the adverse effects of pollutants from natural and man-made sources.
Decisions concerning environmental and human health protection often result in requiring
the design, construction, and operation of pollution control or waste remediation systems. For
example, environmental technologies are required to reduce contamination levels in the
environment and to maintain the levels at concentrations that do not threaten the environment or
human health and safety.
1.3 Applicability
This Manual contains the minimum specifications for quality management functions and
activities necessary to support EPA environmental programs and satisfy the requirements of EPA
Order 5360.1 CHG 2. Such programs may include activities encompassing the:
1-2
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C definition and evaluation of methods for use in the collection, analysis, and use of
environmental data;
. C use of environmental data collected for other purposes or from other sources (also
termed “secondary data”), including literature, industry surveys, compilations from
computerized data bases and information systems, results from computerized or
mathematical models of environmental processes and conditions; and
C collection and use of environmental data pertaining to the occupational health and
safety of personnel in EPA facilities (e.g., indoor air quality measurements) and in
the field (e.g., chemical dosimetry, radiation dosimetry).
This Manual applies to the collection and use of medical testing data from Government
and non-Government personnel in EPA facilities for determination of substance abuse.
1-3
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
The Agency-wide Quality System requirements established in EPA Order 5360.1 CHG 2
shall apply to all EPA organizations and components thereof in which the environmental programs
conducted involve the activities described in Section 1.2 above.
The Agency-wide Quality System requirements defined by Order 5360.1 CHG 2 shall
apply to non-EPA organizations as defined by terms and conditions in EPA-funded extramural
agreements. Compliance with the Agency-wide Quality System requirements may be specified in
applicable regulations for these extramural agreements. In other cases, such requirements may be
invoked as part of negotiated agreements such as memoranda of understanding. These extramural
agreements include:
C State, local, and Tribal governments receiving financial assistance under the
authority of 40 CFR 31 and 35; and
Extramural (non-EPA) quality systems that provide objective evidence (such as a Quality
Management Plan, quality manual, or audit report acceptable to EPA) of complying fully with the
specifications of ANSI/ASQC E4-1994 are in compliance with EPA policy.
1.5 Exemptions
Statutory requirements for quality may supersede the specifications in this Manual or be
more rigorous. In such cases, affected programs shall be exempt from the requirements of this
Manual. EPA organizations conducting exempted activities shall comply with EPA Order 5360.1
CHG 2 in all other respects. The following exemptions from these requirements apply:
1-4
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
1-5
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
1-6
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
CHAPTER 2
QUALITY SYSTEM IMPLEMENTATION
2.1 Introduction
This chapter addresses the implementation of quality management activities to satisfy EPA
Order 5360.1 CHG 2, including limitations on the use of extramural support to implement quality
systems for programs involving environmental data operations; reporting requirements;
requirements for extramural agreements; requirements for reporting results from applicable
environmental programs; QA and QC requirements and guidance documents; user-specific QA
and QC guidance; and dispute resolution.
2.2.1 Background
Many quality system activities involving environmental data operations are inherently
governmental functions and must be performed only by EPA personnel or by personnel explicitly
authorized by EPA based on statute, regulation, or by the terms of an extramural agreement.
Such representatives may include other governmental personnel and with specific authorization,
contractor personnel. When such quality management tasks are performed by a contractor, the
contract must be appropriately managed and must remain under the control of the authorized EPA
contracting representatives. EPA cannot use cooperative agreements or grants to provide quality
management activities such as QA and QC services for EPA because it is an inappropriate use of
financial assistance (Office of General Counsel memorandum, August 2, 1994).
This section describes the quality management tasks necessary to comply with the Order
and identifies those tasks that may be performed by non-government personnel under appropriate
management controls.
2-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
In the situations involving the other associated functions, there may be instances involving
sensitive contracting services, advisory and assistance services, and vulnerable contracting
practices as defined by the Federal Acquisition Regulations, Office of Federal Procurement Policy
(OFPP), and the EPA Contracts Management Manual (EPA Order 1900). Such situations are
identified by italicized text in the following sections. In addition, management approval of
services contracts as defined by OFPP Letter 93-1 must be obtained for many of the associated
tasks.
C the providing of directions or instructions that are inconsistent with the terms of an
extramural agreement,
This section describes the activities and tasks integral to an effective quality system.
These tasks are required to implement EPA Order 5360.1 CHG 2.
C acting as liaison between the organization and the OEI Quality Staff on matters of
QA policy.
2-2
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
management and to the OEI Quality Staff in the QA Annual Report and Work
Plan.
2.2.2.2 Review and Approve Procurement and Financial Assistance Documents for QA
Requirements
C reviewing work assignments, delivery orders, and task orders to certify that
appropriate QA and QC requirements have been established and that the necessary
instructions are being communicated to the contractor to carry out the required
QA and QC tasks. Approving by signature appropriate Quality Assurance Review
Form (EPA Order 1900, Chapter 2).
C reviewing Quality Assurance Project Plans (QAPPs) for all projects, work
assignments, delivery orders, task orders, grants, cooperative agreements, and
interagency agreements involving data acquisition, data generation, and/or
measurement activities that are performed on behalf of EPA.
2-3
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C coordinating the correction of deficient QAPPs with the Project Officer and his/her
management.
C reviewing, at the specific technical direction of the QAM, QA Project Plans and
other QA-related planning documents, such as sampling and analysis plans, Data
Quality Objectives (DQO) specifications, etc., and providing specific
substantiated recommendations to the QAM on the adequacy of the QA approach
in meeting the criteria provided by the QAM. (The reviews should identify
specific technical deficiencies in the planning documents.)
C tracking critical quality system deliverables for the organization and make periodic
reports to senior management on the status of reporting actions and deliverables.
2.2.2.5 Manage Contractor Support Work Assignments, Delivery Orders, and Task
Orders
2-4
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C planning and directing with the responsible EPA project officials the
implementation of periodic technical assessments of ongoing environmental data
operations to provide information to management to assure that technical and
quality objectives are being met and that the needs of the customer are being
satisfied. Such assessments may include technical systems audits, surveillance,
performance evaluations, and data quality assessments.
C determining conclusions and necessary corrective actions (if any) based on the
findings of the assessments.
2-5
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C developing and presenting detailed guidance and training for QA and QC activities
based on interpretation of Agency-wide requirements and guidance.
C approving for publication those papers and reports that meet the defined criteria.
2-6
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
This section describes other activities and tasks integral to an effective quality system.
They are not explicitly required to implement EPA Order 5360.1 CHG 2, but if implemented, they
must be implemented as described below.
2.2.3.1 Review and Assist in the Development and Preparation of Environmental Data
Collection Survey Designs
2.2.3.2 Prepare and Present Quality Management Information in the Technical Literature
and at Meetings/Symposia
2-7
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
symposia, and papers or articles in the technical literature, including peer reviewed
journal papers, oral presentations, and panel discussions.
All Agency organizational units governed by EPA Order 5360.1 CHG 2 shall document
their quality system in a Quality Management Plan (QMP). The QMP is a policy statement
describing how an EPA organization shall comply with the requirements of EPA Order 5360.1
CHG 2. Quality systems encompass the management and technical activities necessary to plan,
implement, and assess the effectiveness of QA and QC operations applied to environmental
programs. The QMP provides the blueprint for how an individual EPA Program Office, Region,
and National Laboratory or Center will plan, implement, and assess its quality system for the
environmental work to be performed as part of its mission. QMPs are reviewed and approved by
2-8
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
the OEI. Approval is valid for a period of up to five years. Specific QMP requirements are
described in Chapter 3.
All Agency organizations subject to the requirements of EPA Order 5360.1 CHG 2 must
submit a Quality Assurance Annual Report and Work Plan (QAARWP) annually to the OEI. The
QAARWP shall summarize the results of having implemented the quality system the previous
fiscal year and describe QA activities planned for the fiscal year beginning in October. The
QAARWP may be used to identify limited changes or updates to the organizations’s approved
QMP. The QAARWP should provide helpful information to management by documenting the
past fiscal year’s activities and estimating the current year’s workload based on the prior year and
the expected activities in the current year. QAARWPs are described in Chapter 4.
All environmental data operations performed under extramural agreements shall comply
with the Agency-wide Quality System requirements as defined by the relevant regulations.
Accordingly, all acquisitions and assistance agreements must be reviewed by an authorized QA
Manager, Officer, or Coordinator, as specified in the organization’s Quality Management Plan, to
determine if environmental data operations are to be performed and, if so, to ensure that
appropriate QA and QC specifications are included or identified in the acquisition and assistance
agreement solicitation package. Upon their receipt in response to the solicitation, proposals or
applications must be reviewed by the QA approval authority to evaluate the adequacy with which
the offeror or applicant addressed stated specification, as well as the adequacy of Quality
Management Plans and QA Project Plans when submitted.
2.4.1 Contracts
The requirements for QA and QC activities in contracts are given in 48 CFR 46 and in the
Contract Management Manual, EPA Order 1900. The requirements and the specifications set
forth in this Manual extend to all contract forms involving environmental programs, including
work assignments, delivery orders, and task orders.
The Quality Assurance Review Form (QARF) (EPA Order 1900, Chapter 2) provides
confirmation to the Office of Acquisition Management (OAM) that appropriate QA and QC
requirements have been determined. OAM officials shall then incorporate the necessary standard
clauses or conditions to assure that the minimum specifications for compliance with EPA policy
are included. The specific statement of work may include additional QA and QC specifications
and requirements identified by the project officer in consultation with the organization’s QAM.
2-9
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Approved QARFs are required for work assignments, delivery orders, and task orders.
For level-of-effort and delivery order contracts, only general QA and QC requirements are
specified in the contract. Since not all work assignments, delivery orders, and task orders issued
involve data collection, QA and QC specifications may not be necessary. The QARF attached to
the work assignment shall identify clearly those work assignments that need QA and QC
specifications and shall identify the necessary requirements.
The regulatory requirements for QA and QC activities in assistance agreements are given
in 40 CFR 30, for assistance to institutions of higher education, hospitals, and other non-profit
organizations, and in 40 CFR 31, for assistance agreements to State, local, and Tribal
governments. The requirements and the specifications set forth in this Manual extend to all
assistance agreement forms involving environmental programs, including grants and cooperative
agreements.
EPA cannot unilaterally require other Federal agencies to comply with Agency-wide
Quality System requirements for interagency agreements funded by EPA. QA and QC
specifications for interagency agreements must be negotiated between EPA and the other agency.
When agreement is reached on the QA and QC specifications, the specifications must be included
in the interagency agreement.
When EPA receives funding from another Agency through an interagency agreement, the
EPA QA and QC requirements shall apply in addition to any specifications provided by the
funding organization. If the funding agency does not specify any requirements, EPA QA and QC
requirements given by the Order and this Manual shall apply.
Agency reports shall be reviewed by the QA manager (or other authorized official) before
publication to ensure that an adequate discussion of QA and QC activities is enclosed. Adequacy
2-10
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
is a subjective determination that should be based on the nature of the environmental data
operations performed and the intended and likely use of the data by others, or on the objectives of
the study. The purpose of the review is to ensure that sufficient information is provided to enable
a knowledgeable reader to determine if the technical and quality goals were met for the intended
use of the data. Reports should include applicable statements regarding the use of any
environmental data presented as a caution about possible misuse of the data for other purposes.
Data management and electronic transfer and storage of environmental data shall conform
with applicable Agency information resources management policies and procedures, or with
applicable American National Standards. Agency policy requires that environmental data shall
have their location reported and documented as well (2100, Chapter 13). Other applicable EPA
Orders include 2180.1, 2180.2, 2180.3, and 7500.1A.
The OEI Quality Staff shall develop quality management practices and "tools" for use
Agency-wide to enable effective planning, implementation, documentation, and assessment of
individual quality systems. The Quality Staff produces the following types of documents for this
purpose:
Guidance Documents contain non-mandatory guidelines for use by EPA and non-
EPA organizations in implementing quality management practices or QA and QC
activities. Such documents often provide suggestions on how to meet
specifications given in Requirements Documents. Guidance Documents are
designated the QA/G-series and issued as OEI reports following peer review and
approval.
2-11
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
All EPA quality-related Requirements Documents and Guidance Documents shall be valid
for a period of five (5) years from the approval date. After five years, some action must be taken
to reaffirm the document’s validity, revise it, or delete it from the Agency-wide Quality System.
Any changes to approved documents must comply with the procedures used for the original
review and approval.
Management shall ensure that all changes to the guidance documents are available to all
personnel using that guidance, including active contractors and assistance agreement recipients
(e.g., grantees, cooperative agreement holders). The changes do not become binding on
contractors and assistance agreement holders until the Office of Acquisition Management or the
Office of Grants and Debarment revises the extramural agreement at the request of the EPA
project officer.
EPA regulations often require the regulated community to collect and submit
environmental data to EPA or the State as part of compliance or enforcement actions. Some
regulations include specific QA and QC requirements while others are less specific. Because
critical decisions are often made based on data collected from the regulated community, the
adequacy of those data are very important, both to EPA and to the regulated community. The
inclusion of appropriate QA and QC requirements in EPA regulations helps to assure that data of
the type and quality needed for a particular decision are obtained. The authoring organization
shall ensure that appropriate and effective specifications for QA and QC activities are included in
proposed regulations.
2-12
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
For those situations in which technical issues regarding QA and QC activities are in
dispute, resolution should be sought at the lowest management level practicable. All parties
should make every effort to resolve disputes through discussion and negotiation. If unsuccessful,
final resolution should be made by the senior manager for the organization.
Disagreements should be resolved at the lowest administrative level possible. The dispute
resolution officials for management systems issues are as follows:
C Between OEI and the National Program Offices or Regional Offices - the AA/OEI
and the respective National Program Office Assistant Administrator (AA) or
Regional Administrator (RA).
Should agreement not be reached at this level, the issue shall be resolved by the Deputy
Administrator.
(1) The process begins when either disagreeing party declares an issue to be
unresolvable and sends a memorandum to the other party invoking this dispute
resolution process, defining the disputed issue, and presenting supporting
arguments for the first party’s position on the issue.
(2) Within 30 days, the second party must send a draft dispute resolution package to
the first party. As soon as possible after this, the two parties, working together,
must submit a dispute resolution package to the dispute resolution official. This
2-13
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
package would contain both party’s arguments, both party’s rebuttals, and any
supporting materials.
(3) The dispute resolution official shall schedule a meeting for resolving the dispute
within 30 to 60 days from receipt of the dispute resolution package, and for
notifying both parties of this date. Both parties are invited to attend the resolution
meeting to present arguments and answer questions. The dispute resolution
official may get advice from third parties. The decision of the dispute resolution
official shall be binding on both parties.
2-14
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
CHAPTER 3
QUALITY MANAGEMENT PLANS
3.1 Introduction
All Agency organizational units governed by EPA Order 5360.1 CHG 2 shall document
their quality system in a Quality Management Plan (QMP). The QMP is a policy statement
describing how an EPA organization shall comply with the requirements of EPA Order 5360.1
CHG 2. Quality systems encompass the management and technical activities necessary to plan,
implement, document, and assess the effectiveness of QA and QC operations applied to
environmental programs. The QMP provides the blueprint for how an individual EPA Program
Office, Region, and National Laboratory or Center will plan, implement, document, and assess its
quality system for the environmental work to be performed as part of its mission.
The QMP, therefore, is a management tool that should be appropriately tailored to the needs of
the organization. The QMP must be sufficiently inclusive, explicit, and readable to enable
managers and supervisors to understand the priority that senior management places on QA, the
established QA policies and procedures, and their respective QA roles. The QMP must be
constructed and written so that an assessment of its effectiveness following implementation can be
made. This enables managers to determine whether or not the quality system is being
implemented in a way that ensures successful results from environmental programs. The QMP
should focus on the processes used to plan, implement, document, and assess the programs to
which it is applied. The level of detail should be based on a common sense, graded approach that
establishes QA and QC requirements commensurate with the importance of the work, the
available resources, and the unique needs of the organization.
3-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
The senior manager for each EPA organization is responsible for the preparation of a
QMP that covers all environmental programs for which the manager is accountable. A senior
manager is a manager who is responsible and accountable for mission accomplishment and overall
operations. Senior management shall ensure that the quality system documented in the QMP
complies with the requirements in this Manual.
The QMP must be approved and signed by the senior manager of the organization
preparing the QMP. The senior manager shall indicate his/her approval of the QMP on the
signature page of the document. The senior managers are designated as follows:
The QMP must also be approved and signed by the QA manager of the organization, the OEI
Quality Staff Director, and the AA/OEI. The senior manager may require the concurrence on the
QMP by appropriate subordinate line managers to encourage the acceptance and implementation
of the quality system. Subordinate line managers may include Division Directors, Branch Chiefs,
and other supervisory personnel as defined for a particular organization.
The QMP must be submitted to the OEI Quality Staff for review and approval. Each
QMP will be reviewed to determine compliance with Agency-wide Quality System requirements.
The review of the QMP shall focus on the substance of the group's QA management process and
not on format or technical details. QMPs that address all mandatory program elements and
include acceptable QA policies, procedures, administrative criteria, and management systems for
3-2
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
key QA elements including systematic planning processes, QA Project Plans, other QMPs,
Standard Operating Procedures, assessments, and oversight of delegated programs shall be
approved. QMP approval shall be valid for a period not to exceed five years.
Although the QMP approval by the Agency is valid for up to five years, all Agency quality
systems must be reviewed at least annually by their organizations to reconfirm the effectiveness of
the approved quality management practices. This assessment must include an evaluation of the
effectiveness of the QMP. The process of developing and annually updating the QMP provides an
opportunity for management and staff to review and clarify roles and responsibilities, to address
problem areas, and to acknowledge successes. Having an accurate QMP at all times is an
essential element in every quality system. Changes in QA policy and procedures shall be
documented in a timely fashion by QMP revisions. In general, a copy of any QMP revision(s)
made during the year should be submitted to the OEI Quality Staff as an attachment to or as part
of the QA Annual Report and Work Plan (see Chapter 4).
A revised QMP may be submitted at any time, but is required under certain conditions
including:
All appropriate personnel performing work for the organization, including active
contractors and assistance agreement holders, shall be notified of all changes to the quality system
and the QMP that may affect their work for EPA and to keep them apprised of the current
requirements.
The QMP describes the processes by which the organization plans, implements,
documents, and determines the effectiveness of quality management practices, including QA and
QC activities, to help management to obtain results of its technical work that are of the type and
quality needed for their intended use. Specifically, the QMP must discuss:
3-3
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C the specific roles and responsibilities of management and staff with respect to QA
and QC activities,
C the process(es) used to plan, implement, and assess the work performed,
The QMP should reflect the organization's commitment to quality management principles and
practices, tailored by senior management to meet the organization's needs.
To reduce duplication between QMPs and QAPPs, the QMP shall include discussion of
those activities, policies, and procedures that are common to all projects. Such discussions
provide an “umbrella” under which individual project activities may be performed.
C an organization chart that identifies all of the components of the organization and,
in particular, the organizational position and lines of reporting for the QA Manager
(and any QA staff) that confirms and documents the independence of the QA
Manager from groups generating, compiling, and evaluating environmental data;
3-4
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C a brief discussion of the technical activities or programs that are supported by the
quality system and to which it applies; that is, the specific programs that require
extensive quality management controls; where oversight of delegated, contracted,
or other extramural programs is needed to assure data quality; and where internal
coordination of QA and QC activities among the group's organizational units needs
to occur;
C an approval page for the signatures of the senior manager, senior line management
(as appropriate), the QA manager of the organization, the OEI Quality Staff
Director, and the AA/OEI. This approval page may be part of a title page or a
separate sheet following the title page. Approving officials whose signatures must
be contained on the approval page are described in section 3.2.2.
Discuss the principal components (or "tools") comprising the quality system and how they
are used to implement the quality system. These components include, but are not limited to
QMPs, management assessments (self and independent), systematic planning processes, QA
Project Plans, Standard Operating Procedures, technical assessments (self and independent), and
Data Quality Assessments. This discussion shall also identify how and when the components of
the quality system are to be applied to individual projects and tasks.
State the organization's policy regarding training for management and staff. Describe the
processes and the management and/or staff responsible for:
3-5
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Describe and discuss the organization's process for ensuring that all appropriate
extramural agreements, including grants, cooperative agreements, and contracted and
subcontracted activities, involving or affecting environmental programs shall:
C receive the same review and approval for changes as for the original documents;
C for handling documents and records to assure their accessibility, protection from
damage and deterioration, and means of retention, including discussion of the roles
and responsibilities for management and staff;
3-6
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C by which all planning documents (e.g., QA Project Plans, Sampling and Analysis
Plans) are prepared, reviewed, approved, issued, used, and revised; and
C that ensures compliance with all statutory, contractual, and assistance agreement
requirements for records from environmental programs and that provides adequate
preservation of key records necessary to support the mission of the organization.
Documents and records, including revisions, must be reviewed for conformance with the quality
system requirements and approved by authorized personnel before general use.
Describe or provide a reference to the management process that ensures that records
accurately reflect completed work and/or fulfill statutory and contractual requirements, including
any specific record keeping requirements defined in EPA Order 2160 and EPA Directive 2100,
Chapter 10. The maintenance of records includes defining requirements and responsibilities for
record transmittal, distribution, retention, protection, preservation, traceability, disposition, and
retrievability.
Describe or discuss:
C the process for ensuring that computer hardware used in environmental programs
meets technical requirements and quality expectations (i.e., configuration testing);
C how changes to hardware shall be controlled to assess the impact of the change on
performance;
C the process for developing computer software, for validating, verifying, and
documenting the software for its use, and for assuring that the software meets the
requirements of the user (EPA Directive 2182);
3-7
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C the process for ensuring that data and information produced from or collected by
computers meet applicable EPA information resources management requirements
and standards (EPA Directive 2100).
These discussions shall include the roles and responsibilities assigned to management and staff.
The QMP shall document how the organization manages its computer hardware and software
operations that directly impact the quality of the results of environmental programs. Computer
programs covered by this Manual include, but are not limited to, design, design analysis, data
handling, data analysis, modeling of environmental processes and conditions, operations or
process control, and data bases.
3.3.8 Planning
Environmental data operations shall be planned using a systematic planning process that is
based on the scientific method. The planning process shall be based on a common sense, graded
approach to ensure that the level of detail in planning is commensurate with the importance and
intended use of the work and the available resources. Elements of a systematic planning approach
that shall be documented include:
C Identification of the type of data needed and how the data will be used to support
the project’s objectives;
C Description of how, when, and where the data will be obtained (including existing
data) and identification of any constraints on data collection;
3-8
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C Description of how the acquired data will be analyzed (either in the field or the
laboratory), evaluated (i.e., QA review, validation, verification), and assessed
against its intended use and the quality performance criteria.
A systematic planning process shall ensure that all organizations and/or parties who
contribute to the quality of the environmental program or use the results are identified and that
they participate in this process. The planning process shall also provide for direct communication
between the customer and the supplier to ensure that there is a clear understanding by all
participants of the needs and expectations of the customer and the product or results to be
provided by the supplier. EPA has developed a systematic planning process called the Data
Quality Objectives Process (EPA, 1994). While not mandatory, this process is the recommended
planning approach for many EPA data collection activities.
Describe the process for planning environmental programs, including identification of who
is responsible and how general project planning is documented. Describe who uses the planning
"tools" (as defined in the Quality System Description section of the QMP) and the roles and
responsibilities of all management and staff involved in planning.
Discuss how the results of planning for environmental data operations shall be
documented in a Quality Assurance Project Plan (QAPP) (see Chapter 5) and approved by
authorized personnel for implementation. The process for developing, reviewing, approving,
implementing, and revising a QAPP, must be described in this section of the QMP. Identify the
staff who is authorized to approve QAPPs.
Describe or discuss how data obtained from sources outside EPA that did not use an
EPA-approved QAPP (or equivalent planning document) for data collection shall be evaluated
and qualified for use. Discuss the process for qualifying such data, including the application of
any statistical methods used.
Describe the process of how and by whom work shall be implemented within the
organization for:
3-9
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Describe how appropriate measures for controlling the release, change, and use of planned
procedures are implemented. These measures provide for the necessary approvals, specific times
and points for implementing changes, removal of obsolete documentation from work areas, and
verification that the changes are made as prescribed.
C how the process for the planning, scheduling, and implementation of assessments
works, as well as how the organization shall respond to needed changes;
C responsibilities, levels of participation, and authorities for all management and staff
participating in the assessment process; and
C how, when, and by whom actions shall be taken in response to the findings of the
assessment, and how the effectiveness of the response shall be determined.
3-10
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Describe how the level of competence, experience, and training necessary to ensure the
capability of personnel conducting assessments are determined. Personnel conducting
assessments shall be qualified, based on project-specific requirements, to perform the assigned
assessment. Management is responsible for choosing the assessors, defining acceptance criteria,
approving audit procedures and check lists, and identifying goals prior to initiation of an
assessment. Assessors shall be technically knowledgeable with no real or perceived conflict of
interest. If the assessors are chosen from within the organization, they must have no direct
involvement or responsibility for the work being assessed, except for self-assessments.
Describe how personnel conducting assessments shall have sufficient authority, access to
programs and managers, access to documents and records, and organizational freedom to:
C identify and cite noteworthy practices that may be shared with others to improve
the quality of their operations and products;
The QMP shall also discuss conditions under which a “stop work” order may be needed and when
and how authority for such decisions shall be made.
Describe how assessment results shall be documented, reported to, and reviewed by
management. Describe how management shall respond to the results (or findings) and
recommendations from assessments in a timely manner. When conditions needing corrective
action are identified, the appropriate response must be made promptly. Indicate how follow-up
action shall be taken and documented to confirm the implementation and effectiveness of the
response action. Describe how disputes, if encountered, as a result of assessments are addressed
and by whom.
Describe how the organization shall detect and prevent quality problems. Describe the
organization's process for ensuring continual quality improvement, including the management
process for determining, planning, implementing, and evaluating the effectiveness of quality
improvement activities; who (organizationally) is responsible for quality improvement; and the
corrective action program to ensure that conditions adverse to quality are identified promptly and
corrected as soon as practical.
3-11
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Corrective actions shall include the identification of root causes of problems, the
determination of whether the problem is unique or has more generic implications, and a
recommendation of procedures to prevent recurrence.
The QMP shall describe how staff at all levels are encouraged to identify and establish
communications among customers and suppliers, identify process improvement opportunities,
identify problems, and offer solutions to those problems.
3-12
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
CHAPTER 4
QUALITY ASSURANCE ANNUAL REPORT AND WORK PLAN
4.1 Background
Careful annual planning is necessary to the success of the Agency-wide Quality System.
In order for management to budget adequate resources to implement the quality system for an
organization, estimates of the quality system workload are needed. Moreover, management must
give priority to quality system resource needs with respect to other mission requirements.
All Agency organizations subject to the requirements of EPA Order 5360.1 CHG 2 shall
submit a Quality Assurance Annual Report and Work Plan (QAARWP) annually. The QAARWP
shall summarize the results of having implemented the quality system the previous fiscal year and
describe QA activities planned for the fiscal year beginning in October. The QAARWP may be
used to identify limited changes or updates to the organizations’s approved Quality Management
Plan (QMP) (see Chapter 3). The QAARWP should provide helpful information to management
by documenting the past fiscal year’s activities and estimating the current year’s workload based
on the prior year and the expected activities in the current year.
The contents of the QAARWPs shall be used by OEI Quality Staff to evaluate the overall
effectiveness of the Agency-wide Quality System. As problems related to QA are identified by
EPA organizations, the Quality Staff shall use the QAARWP information to identify systemic or
Agency-wide problems and shall initiate plans to address such problems. The QAARWPs shall
not be approved as are QMPs.
4.3 Requirements
The QAARWP must be submitted under the signature of the senior manager for the
organization to the AA/OEI. Organization is defined here as an ORD Center, Laboratory, or
Office; individual Program Office one level under an AA-ship; or Region. In order to simplify the
submittal, the QAARWP and its attachments may be submitted electronically to the OEI Quality
Staff Director along with a copy of the original signature page. The QAARWP has two parts, the
annual report for the previous fiscal year and the proposed work plan for the new fiscal year.
Specifications for the QAARWP are contained in Sections 4.3.1 - 4.3.2.
4-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Resources provided here may be estimated if not strictly accounted for by position or
expense tracking. For example, if 10% of the time of all project officers is spent on quality
assurance activities, then an estimate can be made by multiplying 10% times the number of project
officers. If such an estimate is made, the algorithm should be provided to clarify the response.
C State the total EPA (and other Federal) FTE (to the nearest tenth of an FTE)
involved in the management of QA and QC activities. Examples of these activities
include providing input to management on the need for and use of QA resources,
disseminating Agency QA policy, developing and ensuring the implementation of
the organization’s QMP (including document tracking, auditing, and training), and
acting as a liaison with OEI Quality Staff. Vacancies should be listed separately.
C State the total EPA (and other Federal) FTE involved in QA and QC support
activities. Examples of these activities include writing and reviewing QAPPs and
Standard Operating Procedures (SOPs) and validating data.
C If your organization uses contractor support to implement the quality system, state
the total contractor FTEs involved in QA and QC support activities. Include the
technical QA and QC support activities of Senior Environmental Employment
Program (SEEP) grantees or other grantees.
C State the total FTEs involved in other non-technical QA and QC support activities.
This category would include the non-technical SEEP employees and clerical staff.
C State the total dollar amounts (rounded to nearest $K) of other QA supporting
funds, not including travel funds or training.
C State the total dollar amounts of travel funds used for QA activities such as
oversight, surveillance, and audits/assessments.
C State the total dollar amount of funds used for QA and QC training, including
travel for training, and the total number of people who attended the training.
Include training for QA staff.
C Discuss the adequacy of the above listed resources in relation to their impact on
your quality system, including the ability to implement last year’s work plan.
4-2
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
4.3.1.2 Training
C Briefly describe the method used to assess the organization’s QA training needs
and the results of the assessment; i.e., what needs were identified. Discuss
separately any needs assessment made of other organizations participating in your
quality system (i.e., States, Tribes, Regions).
C List courses and name the supplier(s) for QA and QC courses given to your
organization and other non-EPA organizations participating in your quality system.
The courses attended by the QA staff, while critically important for educating new
QA staff members, are not the primary concern. For example, contract
administration and field/lab equipment techniques are not considered QA courses.
Statistics courses, however, are considered related to QA in terms of project
planning and data analysis.
C List the attendance for each course. If course attendees included persons from
outside your organization, identify the total attendance by each organization
represented.
C For each course, indicate whether the course goals were achieved; that is, were the
training needs fulfilled? If not, please indicate why and what you believe needs to
be done to satisfy the remaining needs.
C Discuss any innovative quality management practices you have developed and used
in planning, implementing, or assessing your quality system. Include any proposed
revisions to your Quality Management Plan reflecting changes to your operating
practices for QA and QC activities.
4-3
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
assessment was performed, and who did the assessment. Also provide a general
statement of the assessment results and any corrective actions.
C Summarize technical assistance given on planning, data review, etc. For QAPPs,
the numbers of QAPPs reviewed (or re-reviewed) and an indication of average
turnaround time is sufficient. Note, if tracking program outputs are attached, give
totals for intramural and extramural projects. Include QA assistance given by the
organization or individuals to non-EPA organizations, including states, private
industry, and foreign countries. Organizations participating in your quality system
that have QMPs reviewed and approved by you should also be listed.
4-4
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C State the total EPA (and other Federal) FTE (to the nearest tenth of an FTE)
proposed for supporting quality management activities in your organization.
Examples of these activities include providing input to management on the need
for and use of QA resources, disseminating Agency QA policy, developing and
ensuring the implementation of the organization’s QMP (including document
tracking, auditing, and training), and acting as a liaison with the OEI Quality Staff.
Vacancies should be listed separately.
C State the total EPA (and other Federal) FTE proposed for QA and QC support
activities. Examples of these activities include writing and reviewing QAPPs and
SOPs and validating data.
C If your organization uses contractor support to implement the quality system, state
the total contractor FTEs proposed for the QA and QC support activities.
C State the total FTEs proposed for other non-technical QA and QC support
activities. This category would include Senior Environmental Employment
Program employees, other grantees, and clerical staff.
C State the total dollar amounts (rounded to nearest $K) of proposed QA and QC
support funds, not including travel funds or training.
C State the total dollar amounts of proposed travel funds for QA activities such as
oversight, surveillance, and audits.
C State the total dollar amounts of proposed funds for training, including travel.
4.3.2.2 Activities
C List and briefly describe anticipated major QA and QC activities expected during
the year including QA and QC-related training to be given, taken, or developed,
guidance to be developed or revised, technical and management assessments of
your organization and others participating in your quality system, and
implementation of corrective actions from prior MSRs of your quality system.
4-5
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
CHAPTER 5
QUALITY ASSURANCE PROJECT PLANS
5.1 Introduction
EPA policy requires that all work performed by or on behalf of EPA involving the
collection of environmental data shall be implemented in accordance with an Agency-approved
Quality Assurance Project Plan (QAPP). The QAPP defines and documents how specific data
collection activities shall be planned, implemented, and assessed during a particular project. This
chapter presents detailed specifications on the information that must be addressed in a QAPP for
environmental data operations performed by or on behalf of EPA and on the procedures for its
review and approval. Guidance on developing QAPPs, including examples of QAPP elements,
may be found in Guidance on Quality Assurance Project Plans (QA/G-5) (EPA 1998).
The QAPP is a critical planning document for any environmental data operation since it
documents how environmental data operations are planned, implemented, documented, and
assessed during the life cycle of a program, project, or task. The ultimate success of an
environmental program or project depends on the adequacy and sufficiency of the quality of the
environmental data collected and used in decision-making. This may depend significantly on the
adequacy of the QAPP and its effective implementation. Quality planning (Section 3.3.8.1) is an
absolutely essential component of project management and the QAPP provides the mechanism for
documenting the results of the planning process. This planning must include the "stakeholders"
(i.e., the data users, data producers, decision makers, etc.) to ensure that all needs are defined
adequately at the outset and that the planning for quality addresses the specific needs defined.
In the sections to follow, the elements of the QAPP are discussed in detail. These
elements represent the information generally required for most data operations involving the
characterization of environmental processes and conditions. Because of the diversity of Agency
programs, some elements described in this chapter may not be applicable to all programs. The
final decision on the applicability or use of any or all of these elements for QAPPs shall be made
by individual EPA organizations. EPA organizations may tailor these requirements in their own
implementation documents to better fit their specific needs.
The EPA organization's Quality Management Plan (QMP) establishes how, when, and by
whom development, review, approval, and effective oversight of QAPPs occurs, including
situations in which QAPPs are prepared by extramural (non-EPA) organizations. In some cases,
it may be necessary to add special requirements to the QAPP. The EPA organization sponsoring
the work shall define any specific requirements beyond those listed in this manual.
5-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
No environmental data collection work shall be started until the QAPP has been approved
and distributed to project personnel except under circumstances requiring immediate action to
protect human health and the environment or operations conducted under police powers. Some
non-data collection activities such as equipment procurement, instrument calibration, etc., may be
conducted prior to the approval of the QAPP. In limited circumstances, EPA may grant
conditional approval to a QAPP to permit some work to begin while non-critical deficiencies in
the QAPP are being resolved.
All QAPPs shall be implemented as approved by EPA. The organization performing the
work shall implement the approved QAPP and ensure that all personnel involved in the work have
copies of the approved QAPP and all other necessary documents. Personnel implementing the
approved QAPP should understand the requirements prior to the start of data generation
activities.
Because of the complex and diverse nature of environmental data operations, changes to
original plans are often needed. The EPA Project Manager, with the assistance of the QA
Manager as appropriate, must determine the impact of such changes on the technical and quality
objectives of the project. When a substantive change is warranted, the originator of the QAPP
shall modify the QAPP to document the change and submit the revision for approval by the same
authorities that performed the original review. Only after the revision has been approved and
received (at least verbally with written follow-up) by project personnel, shall the change be
implemented.
It is essential that the QAPP be kept current and that all personnel involved in the work
have easy access to a current version of the QAPP. For programs or projects of long duration,
such as multi-year monitoring programs, the QAPPs shall be reviewed at least annually by the
Project Manager. If revisions are necessary to reflect current needs, the QAPP must be revised
and resubmitted for review and approval.
The QAPP requirements in this chapter apply to all (intramural and extramural)
environmental data operations that acquire, generate, or compile environmentally-related data and
that are performed by or on behalf of EPA. Extramural data operations may include contracts and
work assignments, delivery orders, task orders, cooperative agreements, interagency agreements,
State-EPA agreements, State, local, and Tribal Financial Assistance/Grants, Research Grants, and
responses to statutory or regulatory requirements and to consent agreements negotiated as part of
enforcement actions. QA and QC requirements shall be negotiated into applicable interagency
agreements, including sub-agreements since EPA cannot unilaterally impose its QA and QC
requirements in these agreements. Where specific Federal regulations require QA and QC
5-2
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
activities, QAPPs shall be prepared, reviewed, and approved in accordance with the specifications
contained in this document for the data collection activity unless superseded by the regulation.
Environmental data operations encompass diverse and complex activities, including rule
making, compliance with regulations, and research. As a result, some environmental data
operations may only require a qualitative discussion of the experimental process and its objectives
while others may require extensive documentation in order to adequately describe a complex
environmental program. The content and level of detail in each QAPP may vary according to the
nature of the work being performed and the intended use of the data. The final decision on QAPP
content and level of detail belongs to the EPA organization responsible for the work to be done,
consistent with the approved QMP.
C the project technical and quality objectives (e.g., Data Quality Objectives) are
identified;
C assessment procedures are sufficient for confirming that data of the type and
quality needed and expected are obtained; and
C any limitations on the use of the data can be identified and documented.
Most environmental data operations require the coordinated efforts of many individuals, possibly
including managers, engineers, scientists, statisticians, and others. The QAPP must integrate the
contributions and requirements of everyone involved into a clear, concise statement of what needs
to be accomplished, how it shall be done, and by whom. It must provide understandable
instructions to those who must implement the QAPP, including the field sampling team, the
analytical laboratory, and the data reviewers. The use of standard operating procedures and
national standards and practices is encouraged in all aspects of the QAPP.
In order to be effective, the QAPP must specify the level or degree of QA and QC
activities needed for the particular environmental data operations. The QA and QC technical
requirements of a project should commensurate with:
5-3
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C the type of work to be done (e.g., monitoring, site characterization, bench level
proof of concept), and
C how the results shall be used (e.g., regulatory enforcement, permit approval).
The QAPP must be composed of standardized, recognizable elements covering the entire
project from planning, through implementation, to assessment. The QAPP elements that follow
are presented in that order and have been arranged for convenience into four general groups. The
four groups of elements and their intent are summarized as follows:
C D. Data Validation and Usability - These elements cover the QA activities that
occur after the data collection phase of the project is completed. Implementation
of these elements ensures that the data conform to the specified criteria, thus
achieving the project objectives.
All applicable elements defined by the EPA organization sponsoring the work must be
addressed in the QAPP. Documentation, such as an approved Work Plan, Standard Operating
Procedures (SOPs), etc., may be referenced in response to a particular required QAPP element to
reduce the size of the QAPP and the time required for preparation and review. All referenced
documents must be attached to the QAPP itself or be placed on file with the appropriate EPA
office and available for routine referencing when needed. Such references must be kept current by
the submitter. The QAPP shall also address related QA planning documentation (e.g., Quality
5-4
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Management Plans) from subcontractors or suppliers of services critical to the technical and
quality objectives of the project or task.
This group of QAPP elements covers the basic area of project management, including:
Include the title of the plan, name of the organization(s) implementing the project, and
names, titles, signatures of appropriate approving officials and their approval dates. Approving
officials include the Organization's Project Manager, Organization's Quality Assurance Manager,
EPA Project Manager, and EPA Quality Assurance Manager, as appropriate. Other officials, as
needed, may include the field operations manager, laboratory manager, State officials, and other
Federal Agency officials.
List the sections, figures, tables, references, and appendices. Document control format
may be required at the option of the Project Manager and QA Manager. When required, use a
document control format on each page following the Title and Approval Sheet. For example, the
following may be placed on the upper right hand corner of each page:
5-5
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
5-6
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
List the individuals and their organizations who shall receive copies of the approved
QAPP and any subsequent revisions. Include all persons responsible for implementation
(including managers), the QA managers, and representatives of all groups involved.
Identify the individuals or organizations participating in the project and discuss their
specific roles and responsibilities. Include the principal data users, the decision-makers, the
project QA manager, and all persons responsible for implementation. The project quality
assurance manager must be independent of the unit generating the data. (This does not include
being independent of senior officials, such as corporate managers or agency administrators, who
are nominally, but not functionally, involved in data generation, data use, or decision-making.) If
someone other than the project manager is responsible for approving and accepting final products
and deliverables, then that individual shall be identified. The individual responsible for
maintaining the official, approved QAPP shall also be identified.
Provide a concise organization chart showing the relationships and the lines of
communication among all project participants. Include other data users who are outside of the
organization generating the data, but for whom the data are nevertheless intended; e.g., modelers,
risk assessors, design engineers, toxicologists, etc. The organization chart must also identify any
subcontractor relationships relevant to environmental data operations. Where direct contact
among project managers and data users does not occur, such as a Superfund Potentially
Responsible Party and the EPA Risk Assessment staff, the organization chart should show the
pathway by which information is exchanged.
Provide a description of the work to be performed and schedule for implementation. This
discussion may not need to be lengthy or overly detailed, but it should give an overall picture of
how the project shall resolve the problem or question described in A5. Describe in general terms
the following, as needed:
5-7
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
C The assessment tools needed (i.e., program technical reviews, surveillances, and
technical audits as needed by the project or specified by the QMP) for the project.
C Project and QA and QC records required, including the types of reports needed.
Describe the process and responsibilities for ensuring that the most current approved
version of the QAPP is available.
Itemize the information and records which must be included in a data report package and
specify the desired reporting format. Documentation can include raw data, field logs, instrument
printouts, and results of calibration and QC checks. Specify the level of detail of the field
sampling and/or laboratory analysis narrative needed to provide a complete description of any
difficulties encountered during sampling or analysis. The narrative refers to an annotated
summary of the analytical work performed by a laboratory that describes in narrative form what
activities were performed and identifies any problems encountered that provides additional
information to users in interpreting the data received.
Specify any requirements for the final disposition of records and documents from the
project, including location and length of retention period.
5-8
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
This group of QAPP elements covers all aspects of measurement systems design and
implementation, including:
Describe the experimental design or data collection design for the project, including as
appropriate the types and numbers of samples required, the design of the sampling network,
sampling locations and frequencies, sample matrices, measurement parameters of interest, and the
rationale for the design. Classify each measurement as critical (i.e., required to achieve project
objectives) or non-critical (informational purposes only).
Describe the procedures for collecting samples and identify the sampling methods and
equipment, including any implementation requirements, sample preservation requirements,
decontamination procedures, and materials needed. Identifying sampling methods by number,
date, and regulatory citation (as appropriate) is often sufficient. If a method allows the user to
select from various options, then the method citations should state exactly which options are
being selected. Describe specific performance requirements for the method. For each sampling
method, identify any support facilities needed. The discussion should also address what to do
when a failure in the sampling or measurement system occurs and who is responsible for
corrective action and how the effectiveness of the corrective action shall be determined and
documented.
Describe the process for the preparation and decontamination of sampling equipment,
including the disposal of decontamination by-products; the selection and preparation of sample
containers, sample volumes, preservation methods, and maximum holding times to sample
extraction and/or analysis.
5-9
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Describe the requirements and provisions for sample handling and custody in the field,
laboratory, and transport, taking into account the nature of the samples, the maximum allowable
sample holding times before extraction or analysis, and available shipping options and schedules.
Sample handling includes preservation, packaging, shipment from the site, and storage at the
laboratory. Examples of sample labels, custody forms, and sample custody logs should be
included.
Identifying analytical methods by number, date, and regulatory citation (as appropriate) is
often sufficient. If a method allows the user to select from various options, then the method
citations should state exactly which options are being selected. For non-standard methods, such
as unusual sample matrices and situations, appropriate method performance study information is
needed to confirm the performance of the method for the particular matrix. If previous
performance studies are not available, they must be developed during the project and included as
part of the project results.
Identify required measurement QC checks for both the field and the laboratory; for
example, blanks, duplicates, matrix spikes, laboratory control samples, surrogates, or second
column confirmation. State the frequency of analysis for each type of QC check, and the spike
compounds sources and levels. State or reference the required control limits for each QC check
and corrective action required when control limits are exceeded and how the effectiveness of the
corrective action shall be determined and documented.
5-10
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Identify all tools, gauges, instruments, and other sampling, measuring, and test equipment
used for data collection activities affecting quality that must be controlled and, at specified
periods, calibrated to maintain performance within specified limits. Describe or reference how
calibration shall be conducted using certified equipment and/or standards with known valid
relationships to nationally recognized performance standards. If no such nationally recognized
standards exist, document the basis for the calibration. Identify the certified equipment and/or
standards used for calibration. Indicate how records of calibration shall be maintained and be
traceable to the instrument.
Describe how and by whom supplies and consumables shall be inspected and accepted for
use in the project. State acceptance criteria for such supplies and consumables. They include, but
are not limited to: sample bottles, calibration gases, reagents, hoses, materials for decontamination
of sampling equipment, deionized water, and potable water.
5-11
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Identify any types of data needed for project implementation or decision making that are
obtained from non-measurement sources such as computer data bases, spreadsheets, programs,
and literature files. Define acceptance criteria for the use of such data in the project. Discuss any
limitations on the use of the data resulting from uncertainty in its quality and from the impact of
adding more error to the results.
Describe the project data management scheme, tracing the path of the data from their
generation in the field or laboratory to their final use or storage. Describe or reference the
standard record-keeping procedures, document control system, and the approach used for data
storage and retrieval on electronic media. Discuss the control mechanism for detecting and
correcting errors and for preventing loss of data during data reduction (i.e., calculations), data
reporting, and data entry to forms, reports, and databases. Provide examples of any forms or
checklists to be used.
Identify and describe all data handling equipment and procedures to process, compile, and
analyze the data including procedures for addressing data generated as part of the project as well
as data from other sources. Include any required computer hardware and software and address
any specific performance requirements for the hardware/software configuration used. Describe
the procedures that shall be followed to demonstrate acceptability of the hardware/software
configuration required.
Describe the process for assuring that applicable Agency information resource
management requirements (EPA Directive 2100) are satisfied. Agency policy requires that
locational data be collected and reported with environmental data. If other Agency data
management requirements are applicable, such as the Chemical Abstract Service Registry Number
Data Standard (EPA Order 2180.1), Data Standards for the Electronic Transmission of
Laboratory Measurement Results (EPA Order 2180.2), or the Minimum Set of Data Elements for
Ground-Water Quality (EPA Order 7500.1A), discuss how these requirements are addressed.
This group of QAPP elements addresses the activities for assessing the effectiveness of the
implementation of the project and associated QA and QC activities, including:
5-12
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Identify the number, frequency, and type of assessment activities needed for this project.
Assessments include, but are not limited to surveillance, management systems review, readiness
review, technical systems audit, performance evaluation, audit of data quality, and data quality
assessment.
List and describe the assessments to be used in the project. Discuss the information
expected and the success criteria (i.e., goals, performance objectives, acceptance criteria
specifications, etc.) for each assessment proposed. List the approximate schedule of activities.
For any planned self-assessments (utilizing personnel from within the project groups), identify
potential participants and their exact relationship within the project organization. For independent
assessments, identify the organization and person(s) that shall perform the assessments if this
information is available. Describe how and to whom the results of the assessments shall be
reported.
Define the scope of authority of the assessors, including stop work orders. Define
explicitly the unsatisfactory conditions under which the assessors are authorized to act and
provide an approximate schedule for the assessments to be performed.
Identify the frequency and distribution of reports issued to inform management of the
status of the project; results of performance evaluations and system audits; results of periodic data
quality assessments; and significant quality assurance problems and recommended solutions.
Identify the preparer and the recipients of the reports.
This group of QAPP elements covers the QA activities that occur after the data collection
phase of the project is completed, including :
5-13
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
State the criteria used to review and validate - that is, accept, reject, or qualify - data, in an
objective and consistent manner. Provide examples of any forms or checklists to be used.
Identify any project-specific calculations required.
Describe the process to be used for validating and verifying data, including the chain of
custody for data throughout the life cycle of the project or task. Discuss how issues shall be
resolved and the authorities for resolving such issues. Describe how the results are conveyed to
data users.
Describe how the results obtained from the project or task shall be reconciled with the
requirements defined by the user. Describe how issues shall be resolved. Discuss how limitations
on the use of the data shall be reported to decision makers.
5-14
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
APPENDIX A
GLOSSARY
assessment - the evaluation process used to measure the performance or effectiveness of a system
and its elements. As used here, assessment is an all-inclusive term used to denote any of the
following: audit, performance evaluation, management systems review, peer review, inspection, or
surveillance.
bias - the systematic or persistent distortion of a measurement process which causes errors in one
direction (i.e., the expected sample measurement is different from the sample's true value).
data quality assessment (DQA) - a statistical and scientific evaluation of the data set to
determine the validity and performance of the data collection design and statistical test, and to
determine the adequacy of the data set for its intended use.
data quality objectives (DQOs) - qualitative and quantitative statements derived from the DQO
Process that clarify study objectives, define the appropriate type of data, and specify tolerable
levels of potential decision errors that will be used as the basis for establishing the quality and
quantity of data needed to support decisions.
data quality objectives process - a systematic planning tool to facilitate the planning of
environmental data collection activities. Data quality objectives are the qualitative and
quantitative outputs from the DQO Process.
design - specifications, drawings, design criteria, and performance requirements. Also the result
of deliberate planning, analysis, mathematical manipulations, and design processes.
document - any compilation of information which describes, defines, specifies, reports, certifies,
requires, or provides data or results pertaining to environmental programs.
environmental conditions - the description of a physical medium (e.g., air, water, soil, sediment)
or biological system expressed in terms of its physical, chemical, radiological, or biological
characteristics.
A-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
environmental processes - manufactured or natural processes that produce discharges to, or that
impact, the ambient environment.
environmental programs - work or activities involving the environment, including but not
limited to: characterization of environmental processes and conditions; environmental monitoring;
environmental research and development; and the design, construction, and operation of
environmental technologies; and laboratory operations on environmental samples
environmental technology - an all-inclusive term used to describe pollution control devices and
systems, waste treatment processes and storage facilities, and site remediation technologies and
their components that may be utilized to remove pollutants or contaminants from or prevent them
from entering the environment. Examples include wet scrubbers (air), soil washing (soil),
granulated activated carbon unit (water), and filtration (air, water). Usually, this term applies to
hardware-based systems; however, it also applies to methods or techniques used for pollution
prevention, pollutant reduction, or containment of contamination to prevent further movement of
the contaminants, such as capping, solidification or vitrification, and biological treatment.
extramural agreement - a legal agreement between EPA and an organization outside EPA for
items or services to be provided. Such agreements include contracts, work assignments, delivery
orders, task orders, cooperative agreements, research grants, state and local grants, and EPA-
funded interagency agreements.
financial assistance - the process by which funds are provided by one organization (usually
government) to another organization for the purpose of performing work or furnishing services or
items. Financial assistance mechanisms include grants, cooperative agreements, and government
interagency agreements.
graded approach - the process of basing the level of application of managerial controls applied
to an item or work according to the intended use of the results and the degree of confidence
needed in the quality of the results.
A-2
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
management - those individuals directly responsible and accountable for planning, implementing,
and assessing work.
management systems review (MSR) - the qualitative assessment of a data collection operation
and/or organization(s) to establish whether the prevailing quality management structure, policies,
practices, and procedures are adequate for ensuring that the type and quality of data needed are
obtained.
measurement and testing equipment - tools, gauges, instruments, sampling devices or systems
used to calibrate, measure, test, or inspect in order to control or acquire data to verify
conformance to specified requirements.
method - a body of procedures and techniques for performing an activity (e.g., sampling,
chemical analysis, quantification) systematically presented in the order in which they are to be
executed.
peer review - a documented critical review of work by qualified individuals (or organizations)
who are independent of those who performed the work, but are collectively equivalent in technical
expertise. A peer review is conducted to ensure that activities are technically adequate,
A-3
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
competently performed, properly documented, and satisfy established technical and quality
requirements. The peer review is an in-depth assessment of the assumptions, calculations,
extrapolations, alternate interpretations, methodology, acceptance criteria, and conclusions
pertaining to specific work and of the documentation that supports them.
performance evaluation (PE) - a type of audit in which the quantitative data generated in a
measurement system are obtained independently and compared with routinely obtained data to
evaluate the proficiency of an analyst or laboratory.
precision - a measure of mutual agreement among individual measurements of the same property,
usually under prescribed similar conditions, expressed generally in terms of the standard deviation.
process - a set of interrelated resources and activities which transforms inputs into outputs.
Examples of processes include analysis, design, data collection, operation, fabrication, and
calculation.
quality - the totality of features and characteristics of a product or service that bear on its ability
to meet the stated or implied needs and expectations of the user.
quality assurance manager (QAM) - the individual designated as the principal manager within
the organization having management oversight and responsibilities for planning, documenting,
coordinating, and assessing the effectiveness of the quality system for the organization.
quality assurance project plan (QAPP) - a document describing in comprehensive detail the
necessary QA, QC, and other technical activities that must be implemented to ensure that the
results of the work performed will satisfy the stated performance criteria.
quality control (QC) - the overall system of technical activities that measures the attributes and
performance of a process, item, or service against defined standards to verify that they meet the
stated requirements established by the customer; operational techniques and activities that are
used to fulfill requirements for quality.
quality improvement - a management program for improving the quality of operations. Such
management programs generally entail a formal mechanism for encouraging worker
recommendations with timely management evaluation and feedback or implementation.
A-4
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
quality management - that aspect of the overall management system of the organization that
determines and implements the quality policy. Quality management includes strategic planning,
allocation of resources, and other systematic activities (e.g., planning, implementation,
documentation, and assessment) pertaining to the quality system.
quality management plan (QMP) - a document that describes a quality system in terms of the
organizational structure, policy and procedures, functional responsibilities of management and
staff, lines of authority, and required interfaces for those planning, implementing, documenting,
and assessing all activities conducted.
quality system - a structured and documented management system describing the policies,
objectives, principles, organizational authority, responsibilities, accountability, and implementation
plan of an organization for ensuring quality in its work processes, products (items), and services.
The quality system provides the framework for planning, implementing, documenting, and
assessing work performed by the organization and for carrying out required QA and QC activities.
readiness review - a systematic, documented review of the readiness for the start-up or
continued use of a facility, process, or activity. Readiness reviews are typically conducted before
proceeding beyond project milestones and prior to initiation of a major phase of work.
record - a completed document that provides objective evidence of an item or process. Records
may include photographs, drawings, magnetic tape, and other data recording media.
scientific method - the principles and processes regarded as necessary for scientific investigation,
including rules for concept or hypothesis formulation, conduct of experiments, and validation of
hypotheses by analysis of observations.
standard operating procedure (SOP) - a written document that details the method for an
operation, analysis, or action with thoroughly prescribed techniques and steps, and that is
officially approved as the method for performing certain routine or repetitive tasks.
A-5
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
technical assessment - the evaluation process used to measure the performance or effectiveness
of a technical system and its elements with respect to documented specifications and objectives.
Such assessments may include qualitative and quantitative evaluations. A technical assessment
may either be performed by those immediately responsible for overseeing and/or performing the
work (i.e., a technical self-assessment) or by someone other that the group performing the work
(i.e., a technical independent assessment).
technical review - a documented critical review of work that has been performed within the state
of the art. The review is accomplished by one or more qualified reviewers who are independent
of those who performed the work, but are collectively equivalent in technical expertise to those
who performed the original work. The review is an in-depth analysis and evaluation of
documents, activities, material, data, or items that require technical verification or validation for
applicability, correctness, adequacy, completeness, and assurance that established requirements
are satisfied.
technical systems audit (TSA) - a thorough, systematic, on-site, qualitative audit of facilities,
equipment, personnel, training, procedures, record keeping, data validation, data management,
and reporting aspects of a system.
user - an organization, group, or individual that utilizes the results or products from
environmental programs or a customer for whom the results or products were collected or
created.
validation - confirmation by examination and provision of objective evidence that the particular
requirements for a specific intended use are fulfilled. In design and development, validation
concerns the process of examining a product or result to determine conformance to user needs.
A-6
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
APPENDIX B
REFERENCES
Title 40, Part 30, Code of Federal Regulations, "Grants and Agreements With Institutions of
Higher Education, Hospitals, and Other Non-Profit Organizations.”
Title 40, Part 31, Code of Federal Regulations, "Uniform Administrative Requirements for Grants
and Cooperative Agreement to State and Local Governments."
Title 40, Part 160, Code of Federal Regulations, “Good Laboratory Practices (Pesticides).”
Title 40, Part 792, Code of Federal Regulations, “Good Laboratory Practices (Toxic Substances
Control Act).”
ANSI/ASQC E4-1994, Specifications and Guidelines for Quality Systems for Environmental
Data Collection and Environmental Technology Programs, American National Standard,
January 1995.
EPA Directive 2182, EPA System Design and Development Guidance, December 1996.
EPA Order 1900.1A, Use of Contractor Services to Avoid Improper Contractor Relationships,
April 1994.
EPA Order 2180.1, Chemical Abstract Service Registry Number Data Standard, June 1987.
EPA Order 2180.2, Data Standards for the Electronic Transmission of Laboratory Measurement
Results, December 1988.
EPA Order 5360.1 CHG 2, Policy and Program Requirements for the Mandatory Agency-wide
Quality System, XXXX 1999.
EPA Order 7500.1A, Minimum Set of Data Elements for Ground-Water Quality, October 1992.
B-1
EPA Quality Manual for Environmental Programs 5360 A1
05/05/2000
Office of Federal Procurement Policy, 1992. OFPP Policy Letter 92-1, "Inherently Governmental
Functions," 57 FR 45096, Washington, DC.
Office of Federal Procurement Policy, 1993. OFPP Policy Letter 93-1, "Management Oversight
of Service Contracting," 58 FR 63593, Washington, DC.
U.S. Environmental Protection Agency, 1998. Guidance for Quality Assurance Project Plans
(QA/G-5), EPA/600/R-98/018, Office of Research and Development.
U.S. Environmental Protection Agency, 1996. Guidance for the Data Quality Assessment
Process: Practical Methods for Data Analysis (QA/G-9), EPA/600/R-96/084, Office of
Research and Development.
U.S. Environmental Protection Agency, 1995. The Directives Clearance Process - What It Is
and How It Works, EPA/200/F-95/001, Office of Administration and Resource
Management.
U.S. Environmental Protection Agency, 1994. Guidance for the Data Quality Objectives Process
(QA/G-4), EPA/600/R-96/055, Office of Research and Development.
U.S. Environmental Protection Agency, 1994. Memorandum from Ray E. Spears, Associate
General Council, to H. Matthew Bills, Director for Modeling, Monitoring Systems and
Quality Assurance, “Use of Extramural Support to Implement Quality Systems for
Environmental Programs Involving Environmental Data Operations.”
B-2