Assessment and Grading System Manual
Assessment and Grading System Manual
MANUAL 6-1
(TM) 6.1 GENERAL
6.1. GENERAL
For all Theoretical Training a minimum score of 80% must be achieved to pass, except for CPL to ATP
and ATP Theoretical part for MPL programs, where a minimum score of 75% and 90% of attendance is
required. Ref to CPL to ATP and MPL programs for more details.
d
For practical training part BAA Training Vietnam is adopting the COMPETENCY BASED TRAINING AND
ASSESSMENT (CBTA) framework derived from the ICAO Doc.9995 Evidence-Based Training
te
Implementation Guide, from the ICAO Doc. 9868, PANS- TRG, and from the IATA Guidance Material for
Instructor and Evaluator Training and from Guidance Material and Best Practices for MPL
Implementation.
in
6.2. DESCRIPTION OF THE GRADING SYSTEM
pr
The proper application of the grading system relies on the user's understanding and application of the
underlying principles. Any assessment and grading of maneuvers and scenarios in a session follows the
same stepped process:
1. Consult
syllabus regarding
the objectives &
competencies to
2. Observe the
pilot performance
if
3. Verify the
achievement of
the session
4. Assess
performance in
the competencies
5. Grade
competencies by
using the word
d
objectives to be graded picture
be assessed
lle
(1) The objectives and competencies to be assessed are defined in the Flight Crew Instructor data
(FCID) for each session.
(2) The instructor observes and analyzes the candidate's performance.
(3) The instructor verifies achievement of session objectives.
tro
(4) The instructor assesses the observed performance in each of the pilot, instructor or examiner
competencies that has to be graded.
(5) The instructor grades his/her observation by assigning a grade according to the 5-point competency
grade scale.
on
SESSION
OBJECTIVES
OUTCOME OF THE COMPETENCY
-
SESSION LEVEL ACHIEVED
ACHIEVED/
NOT ACHIEVED
nc
d
INSTRUCTOR
OUTCOME
te
INPUT HOW HOW HOW
MARKERS GRADING (task or event
(method of MANY OFTEN WELL
completion)
instruction)
Discuss options
Ideal (safe,
in
EXCEED and exchange 5 ALL ALWAYS EXEMPLARILY
effective, efficient)
experience
Encourage to
PROFICIENT further increase 4 MOST REGULARLY EFFECTIVELY Safe and effective
efficiency
pr
Facilitate self- Safe (acceptable
CONSOLIDATE 3 MANY OFTEN ADEQUATELY
learning skill test tolerance)
Teach and Improvement
PRACTICE 2 SOME OCCASIONALLY MARGINALLY
Facilitate required
DESCRIBE
APPLY
NOT
OBSERVED
AND Explain
demonstrate
NOT
OBSERVED
and
1
0
FEW
NOT
if
OBSERVED
RARELY
NOT
OBSERVED
NOT
EFFECTIVELY
NOT
OBSERVED
Improvement
required
NOT
OBSERVED
d
lle
(1) This section applies to graded training sessions conducted by an instructor in a Flight Simulation
Training Device (FSTD).
(2) This section does apply to all training programs with the exemption of the theoretical courses
tro
(3) Whenever a task, maneuver or scenario is executed with an underlying level of competence that
might result in an overall competency grade 1 or 2 steps lower than the minimum required (NORM
aka MIN REQ), maximum effort in the session will be made to enable the trainee to develop his/her
competency to the required level (NORM aka MIN REQ) or above.
(4) Additional training is required in case of:
on
a. A grade 1 step lower than the minimum required (NORM aka MIN REQ) in any competency
supported by the instructor’s negative judgement about the present and/or the future session
outcomes. In case of 1 step lower in grade, however, training may continue if the instructor
is convinced at the end of the debriefing that the trainee will be able to achieve grade 3 at
nc
acquired during the last training session of a course must trigger "additional training" and the non-
readiness for either the Skill Test or Proficiency Check.
(1) In compliance with the actual CAAV and related CAAs Regulations and in function of training quality
monitoring, the grading process may be used during instructor and examiner assessment of
competence.
(2) According to CAAV and related CAAs regulatory criteria (Ref: CAAV VAR AC 07-013), a pilot
applicant must demonstrate the ability to apply aeronautical knowledge and to complete all
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-3
(TM) 6.2 DESCRIPTION OF THE GRADING SYSTEM
maneuvers with smoothness and accuracy. The applicant must also maintain control of the
aeroplane in such a manner that the successful (safe) outcome of a procedure or maneuver is
always assured. Above all, the applicant must exercise good judgment and airmanship.
Consequently, according to the performance indicators and word pictures (competency grades), a
"pass" skill test should imply that all core competencies are graded at or above the NORM. Any
grade 1 step below the NORM must at least lead to "partial pass" or test failure, depending upon the
DPE judgement.
(3) For any instructor or examiner Assessment of Competence (AoC), a "pass" must imply that all
d
instructor or examiner core competencies are graded at or above 3. Any grade 2 must lead to the
AoC failure.
te
6.2.5. Instructor and ATO Internal Evaluator (Examiner) Standardization (as per CAAV and
related CAAs approval)
in
The Standardization of Instructors and Internal Evaluator (Examiner) is pertinent to the Training
Programs
Nevertheless, as the Competency Based Training and Assessment (CBTA) is peculiar in its framework
pr
to achieve higher margin of Safety throughout higher level of Pilot’s Performance, it is recommended
that:
(1) Prior to the conduct of training utilizing the grading system, and to ensure effective assessments
with strong inter-rater reliability, instructors and examiners must be competent in its use. A
if
successful assessment includes the provision of guidance to trainees, in order to improve their
performance, and also recommendations for additional training where necessary.
(2) Prior to the conduct of training utilizing the grading system instructors and examiners must
demonstrate their competence in assessment and facilitation techniques. In addition, instructors
d
must undertake specific training to fully understand the CBTA system, the session objectives the
performance indicators and the philosophy behind the competency-based approach.
lle
Different grading sheets exist for pilot, instructor and examiner training and assessment of competence
tro
(1) Where a particular competency is assessed 1 level below the NORM, full details will be recorded in
the FREE TEXT box of the grading sheet using the grading method
(2) Improved or exemplary performance (grade above 4 and +2 above the NORM) must also be
documented additionally in the FREE TEXT section at the instructor's discretion using the grading
method
U
(3) As a general rule, the performance description recorded in the free text box will refer to performance
indicators using appropriate word pictures.
(4) All information related to trainee performance in training or assessment of competence will be
provided in a timely manner to:
a) the trainee;
b) the customer airline;
c) the training center.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-4
(TM) 6.3 THE PILOT COMPETENCIES
In the European CBTA Framework, there are 9 competencies stated, while in the ICAO one 8
competencies only are included.
The following table shows the complete list of competencies, their descriptions and observable
behaviours.
d
Competency Description Observable behaviours (OBs)
te
a. Demonstrates practical and applicable knowledge of
limitations and systems and their interaction.
b. Demonstrates required knowledge of published
Demonstrates knowledge operating instructions.
in
and understanding of c. Demonstrates knowledge of the physical
Application of relevant information, environment, the air traffic environment including
Knowledge operating instructions, routings, weather, airports and the operational
(KNOW) aircraft systems and the infrastructure.
pr
operating environment. d. Demonstrates appropriate knowledge of applicable
legislation.
e. Knows where to source required information.
f. Demonstrates a positive interest in acquiring
knowledge.
regulations
applicable regulations. equipment correctly
(PROC)
e. Monitor aircraft systems status
f. Complies with applicable regulations.
g. Applies relevant procedural knowledge
tro
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-5
(TM) 6.3 THE PILOT COMPETENCIES
d
Aeroplane Flight
thrust, and navigation signals or visual information
Path Controls the flight path d. Manages the flight path safely to achieve optimum
Management, through manual control. operational performance
te
manual control
e. Maintains the intended flight path during manual flight
(FPM-M)
while managing other tasks and distractions
f. Uses appropriate flight management and guidance
systems, as installed and applicable to the conditions
in
(See Part I, Chapter 1, definitions)
g. Effectively monitors flight guidance systems including
engagement and automatic mode transitions.
pr
a. Determines that the recipient is ready and able to
receive information
b. Selects appropriately what, when, how and with
whom to communicate
c. Conveys messages clearly, accurately and concisely
Communication
Communicates through
appropriate means in the
if
d. Confirms that the recipient
understanding of important information
demonstrates
procedures
j. Accurately reads, interprets, constructs and responds
to datalink messages in English
a. Encourages team participation and open
communication
b. Demonstrates initiative and provides direction when
on
required
c. Engages others in planning
Influences others to
d. Considers inputs from others
contribute to a shared
e. Gives and receives feedback constructively
Leadership and purpose.
f. Addresses and resolves conflicts and disagreements
Teamwork
nc
in a constructive manner
(LEAD) Collaborates to
g. Exercises decisive leadership when required
accomplish the goals of
h. Accepts responsibility for decisions and actions
the team.
i. Carries out instructions when directed
j. Applies effective intervention strategies to resolve
U
identified deviations
k. Manages cultural and language challenges, as
applicable
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-6
(TM) 6.3 THE PILOT COMPETENCIES
d
Problem Solving Identifies precursors, d. Perseveres in working through problems while
and Decision mitigates problems; and prioritizing safety
Making e. Identifies and considers appropriate options
te
makes decisions.
(PSDM) f. Applies appropriate and timely decision- making
techniques
g. Monitors, reviews and adapts decisions as required
h. Adapts when faced with situations where no guidance
in
or procedure exists
i. Demonstrates resilience when encountering an
unexpected event
pr
a. Monitors and assesses the state of the aeroplane and
its systems
b. Monitors and assesses the aeroplane’s energy state,
and its anticipated flight path.
c. Monitors and assesses the general environment as it
Situation
awareness and
management of
Perceives, comprehends
and manages information
and anticipates its effect
ifmay affect the operation
d. Validates the accuracy of information and checks for
gross errors
d
information on the operation. e. Maintains awareness of the people involved in or
(SITA) affected by the operation and their capacity to
perform as expected
lle
outcome
i. Manages and recovers from interruptions,
distractions, variations and failures effectively while
performing tasks
U
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-7
(TM) 6.4 THE PILOT COMPETENCY GRADES
6.4.1. Introduction
This part describes the five grades of the Grading system (using word pictures) in reference to
each of the 9 pilot competencies.
The ICAO (Doc 9995) definition of an "unsafe situation" is "a situation which has led to an
unacceptable reduction in safety margin".
d
6.4.2. Communications
te
(1) The pilot did not communicate effectively, by rarely demonstrating few of the performance indicators
when required, which resulted in an unacceptable reduction in safety margin.
(2) The pilot communicated at a marginal level, by only occasionally demonstrating some of the
in
performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot communicated adequately, by regularly demonstrating many of the performance indicators
pr
when required, which resulted in a safe operation.
(4) The pilot communicated effectively, by regularly demonstrating most of the performance indicators
when required, which enhanced safety and effectiveness.
(5) The pilot communicated in an ex exemplary manner, by always demonstrating all the performance
(2) The pilot led and worked as a team member at a marginal level, by only occasionally demonstrating
some of the performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot led and worked as a team member adequately, by regularly demonstrating many of the
performance indicators when required, which resulted in a safe operation.
tro
(4) The pilot led and worked as a team member effectively, by regularly demonstrating most of the
performance indicators when required, which enhanced safety and effectiveness.
(5) The pilot led and worked as a team member in an exemplary manner, by always demonstrating all
the performance indicators when required, which significantly enhanced safety effectiveness and
efficiency.
on
(1) The pilot did not manage the workload appropriately, by rarely demonstrating few of the performance
indicators when required, which resulted in an unacceptable reduction in safety margin.
nc
(2) The pilot managed the workload at a marginal level, by only occasionally demonstrating some of the
performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot managed the workload adequately, by regularly demonstrating many of the performance
U
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-8
(TM) 6.4 THE PILOT COMPETENCY GRADES
(1) The pilot's situation awareness was not adequate, by rarely demonstrating few of the performance
indicators when required, which resulted in an unacceptable reduction in safety margin.
(2) The pilot's situation awareness was at a marginal level, by only occasionally demonstrating some of
the performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot's situation awareness was adequate, by regularly demonstrating many of the performance
d
indicators when required, which resulted in a safe operation.
(4) The pilot's situation awareness was effective, by regularly demonstrating most of the performance
te
indicators when required, which enhanced safety and effectiveness.
(5) The pilot's situation awareness was exemplary; all performance indicators were always
demonstrated when required, which significantly enhanced safety, effectiveness and efficiency.
in
6.4.6. Problem Solving and Decision Making
(1) The pilot did not solve problems or make decisions effectively, by rarely demonstrating few of the
performance indicators when required, which resulted in an unacceptable reduction in safety margin.
pr
(2) The pilot solved problems and made decisions at a marginal level, by only occasionally
demonstrating some of the performance indicators when required, which resulted in a reduction of
safety margin or effectiveness.
(3) The pilot solved problems and made decisions adequately, by regularly demonstrating many of the
performance indicators when required, which resulted in a safe operation.
if
(4) The pilot solved problems and made decisions effectively, by regularly demonstrating most of the
performance indicators when required, which enhanced safety and effectiveness.
(5) The pilot solved problems and made decisions in an ex exemplary manner, by always demonstrating
d
all of the performance indicators when required, which significantly enhanced safety effectiveness
and efficiency.
lle
(1) The pilot did not apply procedures correctly, by rarely demonstrating few of the performance
indicators when required, which resulted in an unacceptable reduction in safety margin.
tro
(2) The pilot applied procedures at a marginal level, by only occasionally demonstrating some of the
performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot applied procedures adequately, by regularly demonstrating many of the performance
indicators when required, which resulted in a safe operation.
on
(4) The pilot applied procedures effectively, by regularly demonstrating most of the performance
indicators when required, which enhanced safety and effectiveness.
(5) The pilot applied procedures in an exemplary manner, by always demonstrating all of the
performance indicators when required, which significantly enhanced safety effectiveness and
efficiency.
nc
(1) The pilot did not manage the automation effectively, by rarely demonstrating few of the performance
indicators when required, which resulted in an unacceptable reduction in safety margin.
U
(2) The pilot managed the automation at a marginal level, by only occasionally demonstrating some of
the performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot managed the automation adequately, by regularly demonstrating many of the performance
indicators when required, which resulted in a safe operation.
(4) The pilot managed the automation effectively, by regularly demonstrating most of the performance
indicators when required, which enhanced safety and effectiveness.
(5) The pilot managed the automation in an exemplary manner, by always demonstrating all of the
performance indicators when required, which significantly enhanced safety effectiveness and
efficiency.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-9
(TM) 6.4 THE PILOT COMPETENCY GRADES
(1) The pilot did not control the aircraft effectively, by rarely demonstrating few of the performance
indicators when required, which resulted in an unacceptable reduction in safety margin.
(2) The pilot controlled the aircraft at a marginal level, by only occasionally demonstrating some of the
performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot controlled the aircraft adequately, by regularly demonstrating many of the performance
d
indicators when required, which resulted in a safe operation.
(4) The pilot controlled the aircraft effectively, by regularly demonstrating most of the performance
te
indicators when required, which enhanced safety and effectiveness.
(5) The pilot controlled the aircraft in an exemplary manner, by always demonstrating all of the
performance indicators when required, which significantly enhanced safety effectiveness and
efficiency.
in
6.4.10. Knowledge
(1) The pilot did not have adequate knowledge, by rarely demonstrating few of the performance
pr
indicators when required, which resulted in an unacceptable reduction in safety margin.
(2) The pilot had knowledge of a marginal level, by only occasionally demonstrating some of the
performance indicators when required, which resulted in a reduction of safety margin or
effectiveness.
(3) The pilot had adequate knowledge, by regularly demonstrating many of the performance indicators
if
when required, which resulted in a safe operation.
(4) The pilot had good knowledge, by regularly demonstrating most of the performance indicators when
required, which enhanced safety and effectiveness.
d
(5) The pilot had exemplary knowledge, by always demonstrating all of the performance indicators when
required, which significantly enhanced safety, effectiveness and efficiency.
lle
tro
on
nc
U
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-10
(TM) 6.5 THE INSTRUCTOR COMPETENCIES
This competency framework consists of competency units, competency elements, and performance
criteria. The competency framework is derived from the ICAO Doc. 9868, PANS-TRG, the ICAO
Doc.9995 Evidence-Based Training Implementation Guide and from the IATA Guidance Material for
Instructor and Evaluator Training.
Competency Observable Behaviors
d
Manage safety Ensures a safe training environment
The competent instructor/evaluator
te
must ensure a safe training/ • Ensures that required equipment meets safety
evaluation environment at all times. requirements.
The competent instructor must • Communicates evacuation procedures.
ensure the safety of trainees in • Ensures a safe operating environment (e.g. for aircraft:
in
his/her care. weather, fuel).
• Identifies hazards and manages them.
• Creates an appropriate safe learning environment.
pr
• Identifies and takes appropriate action to prevent
physical or mental stress.
Intervenes when required for safety
• Transfer control of aircraft or equipment safely.
if
• Intervenes when required for safety appropriately at the
correct time and level (e.g. verbally or by taking control).
• Re-commences training as soon as practicable (after
d
any safety intervention).
lle
will ensure that the training • Ensures the training is logically structured (where there
environment provides for effective is a need for the instructor/evaluator to design training
learning. The training environment programs).
includes facilities, equipment, and • Ensures the training is realistic and relevant.
instructional materials. The • Ensures there are specific and measurable objectives.
on
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-11
(TM) 6.5 THE INSTRUCTOR COMPETENCIES
d
as appropriate.
Coaches trainees
te
• Demonstrates awareness of any measurable indicators
of trainee readiness for training (as far as possible).
• Is flexible and supportive to trainees' performance and
in
needs.
• Develops appropriate relationship with trainees.
• Develops and sustains trainees' motivation.
pr
Conduct training Establish and maintain credibility
The competent instructor/evaluator
must demonstrate a variety of
instructional methods as required for
the training.
if
• Demonstrates an exemplary role model's behavior
(meaning the behaviors expected in the technical role
being trained, according to the competencies and
d
related KSA).
• Establishes credentials.
• Demonstrates respect for organizational goals and
lle
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-12
(TM) 6.5 THE INSTRUCTOR COMPETENCIES
d
confirm understanding.
• Answers questions, correctly and adequately.
te
• Generates content by questioning, redirecting,
balancing participation, etc.
• Provides structure by confirming understanding,
paraphrasing, summarizing, etc.
in
Creates and sustains realism
pr
• Ensures realism in the choice of scenario administered.
• Maintains a realistic approach in the conduct of the
scenario.
Manages time
if
• Allocates time appropriately on activities.
• Adjusts time spent on activities to ensure that objectives
d
are met.
• Implements contingency plans for situations in which
activities must be eliminated, reduced or replaced.
lle
objectives.
• Applies performance standards fairly and consistently.
• Ensures a level of knowledge and skill that achieves an
appropriate level of safety.
• Observes and encourages self-assessment of
performance against performance standards.
• Confidently makes decision on outcome of the task.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-13
(TM) 6.5 THE INSTRUCTOR COMPETENCIES
d
• Develops and seeks agreement on any plan for
improvement or remediation.
te
Produces training and performance reports
in
• Keeps appropriate and adequate training and
performance records.
• Reports clearly and accurately on trainee's performance
pr
using only observed behaviors reflecting knowledge,
skills and attitudes.
• Follows up corrective actions.
• Reports recognized training opportunities within the
training system for the purpose of process improvement.
• Respects confidentiality.
if
d
Self-evaluates the effectiveness of his/her own
Perform Course Evaluation
performance as an instructor
lle
course
• Evaluates trainee's feedback on the training process.
• Evaluates trainee's mastery of end-of-course objectives.
• Evaluates the effect of facilities on trainee's
nc
performance.
• Evaluates the effect of equipment on trainee's
performance.
• Evaluates the effect of training materials on trainee's
U
performance.
• Evaluates the effect of the management of the training
program on trainee's performance.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-14
(TM) 6.5 THE INSTRUCTOR COMPETENCIES
d
• Makes recommendations for improvements to course
design.
te
• Makes recommendations for improvements to course
in
performance
• Encourages and welcomes feedback on his/her own
performance as an instructor.
• Evaluates his/her own performance as an instructor and
pr
learns from the results.
• Actively seeks feedback on the training course from
trainees and peers.
if
Sustains personal development
• Maintains required qualifications.
• Strives to increase and updates relevant knowledge and
d
skills.
• Demonstrates continuous improvement of instructor
lle
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-15
(TM) 6.6 THE INSTRUCTOR COMPETENCIES GRADES
(1) The instructor did not ensure a safe training environment at all times by rarely demonstrating few of
the performance indicators when required.
(2) The instructor marginally ensured a safe training environment at all times, by only occasionally
demonstrating some of the performance indicators when required.
d
(3) The instructor adequately ensured a safe training environment at all times, by regularly
demonstrating many of the performance indicators when required.
te
(4) The instructor effectively ensured a very safe training environment at all times, by regularly
demonstrating most of the performance indicators when required.
(5) The instructor exemplarily ensured an extremely safe training environment at all times, by always
demonstrating all of the performance indicators when required.
in
6.6.2. Prepare the Training Environment
pr
(1) The instructor did not ensure that the training environment provided for effective training, by rarely
demonstrating few of the performance indicators when required.
(2) The instructor marginally ensured that the training environment provided for effective training, by
only occasionally demonstrating some of the performance indicators when required.
(3) The instructor adequately ensured that the training environment provided for effective training, by
if
regularly demonstrating many of the performance indicators when required.
(4) The instructor effectively ensured that the training environment provided for very effective training,
by regularly demonstrating most of the performance indicators when required.
(5) The instructor exemplarily ensured that the training environment provided for extremely effective
d
training, by always demonstrating all of the performance indicators when required.
lle
(1) The instructor did not ensure that the training was appropriate for the trainee, by rarely demonstrating
few of the performance indicators when required.
tro
(2) The instructor marginally ensured that the training was appropriate for the trainee, by only
occasionally demonstrating some of the performance indicators when required.
(3) The instructor adequately ensured that the training was appropriate for the trainee, by regularly
demonstrating many of the performance indicators when required.
(4) The instructor effectively ensured that the training was appropriate for the trainee, by regularly
demonstrating most of the performance indicators when required.
on
(5) The instructor exemplarily ensured that the training was appropriate for the trainee, by always
demonstrating all of the performance indicators when required.
(1) The instructor did not use appropriate training techniques for the training, by rarely demonstrating
few of the performance indicators when required.
(2) The instructor marginally used appropriate training techniques for the training, by only occasionally
demonstrating some of the performance indicators when required.
U
(3) The instructor adequately used appropriate training techniques for the training, by regularly
demonstrating many of the performance indicators when required.
(4) The instructor effectively used appropriate training techniques for the training, by regularly
demonstrating most of the performance indicators when required.
(5) The instructor exemplarily used appropriate training techniques for the training, by always
demonstrating all of the performance indicators when required, in an exemplary manner.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-16
(TM) 6.6 THE INSTRUCTOR COMPETENCIES GRADES
(1) The instructor did not assess the trainee appropriately, objectively and correctly, by rarely
demonstrating few of the performance indicators when required.
(2) The instructor marginally assessed the trainee appropriately, objectively and correctly, by only
occasionally demonstrating some of the performance indicators when required.
(3) The instructor adequately assessed the trainee appropriately, objectively and correctly, by regularly
demonstrating many of the performance indicators when required.
d
(4) The instructor effectively assessed the trainee very appropriately, objectively and correctly, by
regularly demonstrating most of the performance indicators when required.
te
(5) The instructor exemplarily assessed the trainee extremely appropriately, objectively and correctly,
by always demonstrating all of the performance indicators when required.
in
(1) The instructor did not evaluate the effectiveness of the training system, by rarely demonstrating few
of the performance indicators when required.
(2) The instructor marginally evaluated the effectiveness of the training system, by only occasionally
pr
demonstrating some of the performance indicators when required.
(3) The instructor adequately evaluated the effectiveness of the training system, by regularly
demonstrating many of the performance indicators when required.
(4) The instructor effectively evaluated the effectiveness of the training system effectively, by regularly
demonstrating most of the performance indicators when required.
if
(5) The instructor exemplarily evaluated the effectiveness of the training system extremely effectively,
by always demonstrating all of the performance indicators when required.
d
6.6.7. Continuously Improve Performance
(1) The instructor did not evaluate nor take appropriate action of their own performance, by rarely
lle
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-17
ATO INTERNAL EVALUATOR (EXAMINER)
(TM) 6.7
COMPETENCIES
d
flight test.
Inspect and assess pilot's log book, medical certificate,
te
training records, licenses and Chief Flight Instructor (CFI)
recommendation to ensure applicant fulfils all requirements
to undertake flight test.
in
Identify competency standards that must be assessed and
plan methods of gathering evidence.
Plan evidence-gathering activities to provide sufficient,
pr
reliable, valid and fair evidence of competency
Formulate questions to assess candidates corrected
knowledge when appropriate.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-18
ATO INTERNAL EVALUATOR (EXAMINER)
(TM) 6.7
COMPETENCIES
d
operating in a flight environment and transferring skills and
knowledge to new situations and contexts.
te
Make the assessment decision in accordance with the
Assessment of Standards.
in
Conduct post flight test debriefing Advise candidate of achievement of competency or failure
to achieve competency.
Provide clear and constructive feedback about
pr
performance to candidate using appropriate language and
strategies including guidance on further training if
appropriate.
Explore opportunities for overcoming any gaps in
if
competency as revealed by the assessment with the
candidate.
Advise the candidate of reassessment procedures and the
d
appeals mechanism if the decision is challenged.
Conduct post flight test debriefing Advises trainer and/or training organization of flight test
lle
Regulations.
Complete student training records.
Forward Flight Test application form and Flight Test form
to local Authorities in accordance with Civil Aviation Safety
nc
Regulations.
U
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-1
ATO INTERNAL EVALUATOR (EXAMINER)
(TM) 6.8
COMPETENCY GRADES
6.8.1. General
The regulatory criteria are pertinent with CAAV VAR set. DEP is the solely guarantor for the application
of the CAAV and related CAAs regulatory criteria and procedures. DEP is designated by CAAV and
related CAAs only. BAA Training Vietnam will not promote any DPE without consent from CAAV.
d
The below paragraphs shall be FOR INFO ONLY.
te
6.8.2. Plan a Flight Test
(1) The examiner did not plan the flight test by rarely demonstrating few of the performance indicators
when required.
in
(2) The examiner marginally planned the flight test, by only occasionally demonstrating some of the
performance indicators when required.
(3) The examiner adequately planned the flight test, by regularly demonstrating many of the
pr
performance indicators when required.
(4) The examiner effectively planned the flight test, by regularly demonstrating most of the performance
indicators when required.
(5) The examiner exemplarily planned the flight test, by always demonstrating all the performance
indicators when required.
(1) The examiner did not ensure a safe flight test environment at all times, by rarely demonstrating few
of the performance indicators when required.
(2) The examiner marginally ensured a safe flight test environment, by only occasionally demonstrating
some of the performance indicators when required.
nc
(3) The examiner adequately ensured a safe flight test environment, by regularly demonstrating many
of the performance indicators when required.
(4) The examiner effectively ensured a very safe flight test environment, by regularly demonstrating
most of the performance indicators when required.
(5) The examiner exemplarily ensured an extremely safe flight test environment, by always
U
(1) The examiner did not assess the trainee appropriately, objectively and correctly, by rarely
demonstrating few of the performance indicators when required.
(2) The examiner marginally assessed the trainee appropriately, objectively and correctly, by only
occasionally demonstrating some of the performance indicators when required.
(3) The examiner adequately assessed the trainee appropriately, objectively and correctly, by regularly
demonstrating many of the performance indicators when required.
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
TRAINING 6 ASSESSMENT AND GRADING SYSTEM
MANUAL 6-2
ATO INTERNAL EVALUATOR (EXAMINER)
(TM) 6.8
COMPETENCY GRADES
(4) The examiner effectively assessed the trainee very appropriately, objectively and correctly, by
regularly demonstrating most of the performance indicators when required.
(5) The examiner exemplarily assessed the trainee extremely appropriately, objectively and correctly,
by always demonstrating all the performance indicators when required.
(1) The examiner did not conduct the debriefing appropriately, by rarely demonstrating few of the
d
performance indicators when required.
(2) The examiner marginally conducted an appropriate debriefing, by only occasionally demonstrating
te
some of the performance indicators when required.
(3) The examiner adequately conducted an appropriate debriefing, by regularly demonstrating many of
the performance indicators when required.
(4) The examiner effectively conducted an effective debriefing, by regularly demonstrating most of the
in
performance indicators when required.
(5) The examiner exemplarily conducted a very effective debriefing, by always demonstrating all of the
performance indicators when required.
pr
6.8.7. Conduct Post Flight Test Briefing with Training Organization
(1) The examiner did not report the flight test outcome to the training organization, by rarely
demonstrating few of the performance indicators when required.
(2) The examiner marginally reported the flight test outcome, by only occasionally demonstrating some
of the performance indicators when required. if
(3) The examiner adequately reported the flight test outcome, by regularly demonstrating many of the
performance indicators when required.
d
(4) The examiner effectively reported the flight test outcome, by regularly demonstrating most of the
performance indicators when required.
lle
(5) The examiner exemplarily reported the flight test outcome very effectively, by always demonstrating
all the performance indicators when required.
(1) The examiner did not complete the administrative requirements appropriately, by rarely
demonstrating few of the performance indicators when required.
(2) The examiner marginally completed the administrative requirements, by only occasionally
demonstrating some of the performance indicators when required.
(3) The examiner adequately completed the administrative requirements, by regularly demonstrating
on
Issue No: 04 Date of issue: 2024-01-20 Revision No: 00 Date of revision: 2024-01-20
Inter-rater reliability is crucial to ensure consistent and accurate assessment outcomes across different evaluators. It requires instructors and examiners to be competent in using the grading system, offering standardized assessments, guidance, and recommendations for additional training, thereby influencing training effectiveness .
The minimum passing scores for theoretical training are 80% for general programs, 75% for CPL to ATP programs, and 90% attendance for ATP Theoretical part for MPL programs .
The European CBTA Framework lists 9 competencies, whereas the ICAO lists 8, including Application of Knowledge, Application of Procedures and Compliance with Regulations, Aeroplane Flight Path Management (automation), Leadership and Teamworking, Workload Management, and Situation Awareness .
The CBTA framework integrates principles from the ICAO Doc.9995 Evidence-Based Training Implementation Guide, ICAO Doc. 9868, PANS-TRG, and the IATA Guidance Material for Instructor and Evaluator Training. It incorporates best practices for MPL implementation to ensure competency-based training focuses on the skills and behaviors required for safe and effective performance .
Effective workload management in pilots is defined by regularly demonstrating performance indicators that enhance safety and effectiveness. It requires managing tasks efficiently to maintain safety margin, with exemplary management showing significant enhancement of operation safety and efficiency .
Free-text boxes are used to record full details when performance is assessed one level below NORM or when performance is exemplary. This includes descriptive performance indicators and word pictures, providing detailed feedback to trainees, airlines, and training centers .
Achieving a grade two steps lower than the minimum required in the final training session triggers additional training and indicates non-readiness for the Skill Test or Proficiency Check .
Good judgment and airmanship are crucial as they ensure safe and smooth flight operations. They involve the ability to apply knowledge, complete maneuvers accurately, maintain control, and assure a safe outcome, aligning with regulatory standards for safe aviation practices .
Key observable behaviors for managing safety include ensuring equipment safety compliance, communicating evacuation procedures, identifying hazards, maintaining a safe learning environment, and intervening appropriately for safety. These behaviors ensure a comprehensive approach to safety management .
The grading process involves continuous observation, recording, analysis, and determination of pilot, instructor, or examiner performance using a 5-point scale. The expected minimum grade is 3 at the end of each training phase. If performance deviates from the norm, specific observable behaviors must be indicated .